llvm-project/llvm/lib/CodeGen
James Molloy f01488e2bc [InstCombine] Rewrite bswap/bitreverse handling completely.
There are several requirements that ended up with this design;
  1. Matching bitreversals is too heavyweight for InstCombine and doesn't really need to be done so early.
  2. Bitreversals and byteswaps are very related in their matching logic.
  3. We want to implement support for matching more advanced bswap/bitreverse patterns like partial bswaps/bitreverses.
  4. Bswaps are best matched early in InstCombine.

The result of these is that a new utility function is created in Transforms/Utils/Local.h that can be configured to search for bswaps, bitreverses or both. InstCombine uses it to find only bswaps, CGP uses it to find only bitreversals.

We can then extend the matching logic in one place only.

llvm-svn: 257875
2016-01-15 09:20:19 +00:00
..
AsmPrinter Rename WinCodeViewLineTables to CodeViewDebug, similar to DwarfDebug 2016-01-14 19:25:04 +00:00
MIRParser Replace uint16_t with the MCPhysReg typedef in many places. A lot of physical register arrays already use this typedef. 2015-12-05 07:13:35 +00:00
SelectionDAG [CodeGen] Don't assume fp_to_fp16 produces i16 when legalizing it. 2016-01-14 19:45:36 +00:00
AggressiveAntiDepBreaker.cpp [CodeGen]: Fix bad interaction with AntiDep breaking and inline asm. 2015-12-02 18:58:51 +00:00
AggressiveAntiDepBreaker.h
AllocationOrder.cpp
AllocationOrder.h
Analysis.cpp Remove assert(false) in favor of asserting the if conditional it is contained within. 2015-10-26 18:41:13 +00:00
AntiDepBreaker.h
AtomicExpandPass.cpp Speculative fix for windows build 2015-12-16 01:24:05 +00:00
BasicTargetTransformInfo.cpp constify the Function parameter to the TTI creation callback and 2015-09-16 23:38:13 +00:00
BranchFolding.cpp [BranchFolding] Set correct mem refs (2nd try) 2016-01-11 07:15:38 +00:00
BranchFolding.h [WinEH] Permit branch folding in the face of funclets 2015-10-04 02:22:52 +00:00
CMakeLists.txt [TLS] New lower emutls pass, fix linkage bugs. 2016-01-13 23:56:37 +00:00
CalcSpillWeights.cpp Trace copies when checking for rematerializability in spill weight calculation 2015-08-10 11:59:44 +00:00
CallingConvLower.cpp Update to use new name alignTo(). 2016-01-14 21:06:47 +00:00
CodeGen.cpp Recommit LiveDebugValues pass after fixing a couple of minor issues. 2015-12-16 11:09:48 +00:00
CodeGenPrepare.cpp [InstCombine] Rewrite bswap/bitreverse handling completely. 2016-01-15 09:20:19 +00:00
CoreCLRGC.cpp [GC] Make GCStrategy::isGCManagedPointer a type predicate not a value predicate [NFC] 2015-12-23 01:42:15 +00:00
CriticalAntiDepBreaker.cpp MachineBasicBlock: Factor out common code into isReturnBlock() 2015-09-25 21:25:19 +00:00
CriticalAntiDepBreaker.h
DFAPacketizer.cpp [Packetizer] Code cleanup, NFC 2016-01-14 21:17:04 +00:00
DeadMachineInstructionElim.cpp Save LaneMask with livein registers 2015-09-09 18:08:03 +00:00
DwarfEHPrepare.cpp Move EH-specific helper functions to a more appropriate place 2015-12-02 23:06:39 +00:00
EarlyIfConversion.cpp Normalize MBB's successors' probabilities in several locations. 2015-12-13 09:26:17 +00:00
EdgeBundles.cpp
ErlangGC.cpp
ExecutionDepsFix.cpp use range-based for-loops; NFCI 2015-12-29 17:15:22 +00:00
ExpandISelPseudos.cpp CodeGen: Remove a few more ilist iterator implicit conversions, NFC 2015-10-09 18:44:40 +00:00
ExpandPostRAPseudos.cpp
FaultMaps.cpp
FuncletLayout.cpp [WinEH] Update CATCHRET's operand to match its successor 2015-10-05 20:09:16 +00:00
GCMetadata.cpp
GCMetadataPrinter.cpp
GCRootLowering.cpp CodeGen: Remove a few more ilist iterator implicit conversions, NFC 2015-10-09 18:44:40 +00:00
GCStrategy.cpp
GlobalMerge.cpp CodeGen: Use range-based for in GlobalMerge, NFC 2015-10-09 18:57:47 +00:00
IfConversion.cpp Fix PR25838. 2015-12-17 01:29:08 +00:00
ImplicitNullChecks.cpp [ImplicitNulls] Add some clarifying comments; NFC 2015-11-13 08:14:00 +00:00
InlineSpiller.cpp Use range-based for loops. NFC 2015-12-24 05:20:40 +00:00
InterferenceCache.cpp CodeGen: Remove more ilist iterator implicit conversions, NFC 2015-10-09 19:13:58 +00:00
InterferenceCache.h
InterleavedAccessPass.cpp [ARM][AArch64] Turn on by default interleaved access lowering 2015-09-01 11:12:35 +00:00
IntrinsicLowering.cpp getParent() ^ 3 == getModule() ; NFCI 2015-12-14 17:24:23 +00:00
LLVMBuild.txt LLVMCodeGen: Update libdeps corresponding to r246236. 2015-08-28 05:38:49 +00:00
LLVMTargetMachine.cpp [TLS] New lower emutls pass, fix linkage bugs. 2016-01-13 23:56:37 +00:00
LatencyPriorityQueue.cpp
LexicalScopes.cpp
LiveDebugValues.cpp Speed up LiveDebugValues 2016-01-10 18:08:32 +00:00
LiveDebugVariables.cpp Fix PR24563 (LiveDebugVariables unconditionally propagates all DBG_VALUEs) 2015-12-21 20:03:00 +00:00
LiveDebugVariables.h Erase unused FunctionDIs variables after r252219. 2015-11-07 10:21:25 +00:00
LiveInterval.cpp LiveInterval: A LiveRange is enough for ConnectedVNInfoEqClasses::Classify() 2016-01-08 01:16:35 +00:00
LiveIntervalAnalysis.cpp LiveInterval: A LiveRange is enough for ConnectedVNInfoEqClasses::Classify() 2016-01-08 01:16:35 +00:00
LiveIntervalUnion.cpp
LivePhysRegs.cpp LivePhysRegs: Fix live-outs of return blocks 2015-09-25 23:50:53 +00:00
LiveRangeCalc.cpp TargetRegisterInfo: Add typedef unsigned LaneBitmask and use it where apropriate; NFC 2015-09-25 21:51:14 +00:00
LiveRangeCalc.h TargetRegisterInfo: Add typedef unsigned LaneBitmask and use it where apropriate; NFC 2015-09-25 21:51:14 +00:00
LiveRangeEdit.cpp TargetRegisterInfo: Add typedef unsigned LaneBitmask and use it where apropriate; NFC 2015-09-25 21:51:14 +00:00
LiveRegMatrix.cpp TargetRegisterInfo: Introduce PrintLaneMask. 2015-09-25 21:51:24 +00:00
LiveStackAnalysis.cpp
LiveVariables.cpp LiveVariables should not clobber MachineOperand::IsDead, ::IsKill on reserved physical registers 2015-11-24 20:06:56 +00:00
LocalStackSlotAllocation.cpp CodeGen: Remove more ilist iterator implicit conversions, NFC 2015-10-09 19:13:58 +00:00
LowerEmuTLS.cpp [TLS] New lower emutls pass, fix linkage bugs. 2016-01-13 23:56:37 +00:00
MIRPrinter.cpp Replace all weight-based interfaces in MBB with probability-based interfaces, and update all uses of old interfaces. 2015-12-01 05:29:22 +00:00
MIRPrinter.h
MIRPrintingPass.cpp Re-commit r247216: "Fix Clang-tidy misc-use-override warnings, other minor fixes" 2015-09-10 16:49:58 +00:00
MachineBasicBlock.cpp Remove extra whitespace. NFC. 2016-01-07 10:26:32 +00:00
MachineBlockFrequencyInfo.cpp CodeGen: Avoid ilist iterator implicit conversions in a few more places, NFC 2015-10-09 19:23:20 +00:00
MachineBlockPlacement.cpp Add command line options to force function/loop alignments. 2015-12-29 18:18:07 +00:00
MachineBranchProbabilityInfo.cpp Use getEdgeProbability() instead of getEdgeWeight() in BFI and remove getEdgeWeight() interfaces from MBPI. 2015-12-18 21:53:24 +00:00
MachineCSE.cpp rangify; NFCI 2016-01-06 00:45:42 +00:00
MachineCombiner.cpp less indent; NFCI 2015-11-10 20:09:02 +00:00
MachineCopyPropagation.cpp
MachineDominanceFrontier.cpp
MachineDominators.cpp
MachineFunction.cpp Add command line options to force function/loop alignments. 2015-12-29 18:18:07 +00:00
MachineFunctionAnalysis.cpp
MachineFunctionPass.cpp [PM/AA] Rebuild LLVM's alias analysis infrastructure in a way compatible 2015-09-09 17:55:00 +00:00
MachineFunctionPrinterPass.cpp Recommit r256952 "Filtering IR printing for print-after-all/print-before-all" 2016-01-06 22:55:03 +00:00
MachineInstr.cpp Consolidate MemRefs handling from BranchFolding and correct latent bug 2016-01-06 19:33:12 +00:00
MachineInstrBundle.cpp MachineInstrBundle: Fix reversed isSuperRegisterEq() call 2016-01-05 00:45:35 +00:00
MachineLICM.cpp rangify; NFCI 2016-01-06 23:45:05 +00:00
MachineLoopInfo.cpp CodeGen: Continue removing ilist iterator implicit conversions 2015-10-09 19:40:45 +00:00
MachineModuleInfo.cpp Move EH-specific helper functions to a more appropriate place 2015-12-02 23:06:39 +00:00
MachineModuleInfoImpls.cpp
MachinePassRegistry.cpp
MachinePostDominators.cpp
MachineRegionInfo.cpp
MachineRegisterInfo.cpp Scheduler / Regalloc: use unique_ptr[] instead of std::vector 2015-12-02 18:32:59 +00:00
MachineSSAUpdater.cpp
MachineScheduler.cpp MachineScheduler: Add a target hook for deciding which RegPressure sets to 2015-12-16 18:31:01 +00:00
MachineSink.cpp Refine the definition of convergent to only disallow the addition of new control dependencies. 2015-10-09 18:06:13 +00:00
MachineTraceMetrics.cpp use range-based for loops; NFCI 2015-12-09 22:45:45 +00:00
MachineVerifier.cpp LiveInterval: A LiveRange is enough for ConnectedVNInfoEqClasses::Classify() 2016-01-08 01:16:35 +00:00
Makefile
OcamlGC.cpp
OptimizePHIs.cpp
PHIElimination.cpp [WinEH] Add some support for code generating catchpad 2015-08-27 23:27:47 +00:00
PHIEliminationUtils.cpp [WinEH] Add some support for code generating catchpad 2015-08-27 23:27:47 +00:00
PHIEliminationUtils.h
ParallelCG.cpp [LTO] Add option to emit assembly from LTOCodeGenerator 2015-11-19 23:59:24 +00:00
Passes.cpp Recommit LiveDebugValues pass after fixing a couple of minor issues. 2015-12-16 11:09:48 +00:00
PeepholeOptimizer.cpp fix formatting; NFC 2015-12-29 19:34:53 +00:00
PostRASchedulerList.cpp MachineScheduler: Add regpressure information to debug dump 2015-11-06 20:59:02 +00:00
ProcessImplicitDefs.cpp CodeGen: Avoid more ilist iterator implicit conversions, NFC 2015-10-09 21:08:19 +00:00
PrologEpilogInserter.cpp Update to use new name alignTo(). 2016-01-14 21:06:47 +00:00
PseudoSourceValue.cpp Refactor: Simplify boolean conditional return statements in lib/CodeGen. 2015-10-24 23:11:13 +00:00
README.txt
RegAllocBase.cpp
RegAllocBase.h
RegAllocBasic.cpp [PM/AA] Rebuild LLVM's alias analysis infrastructure in a way compatible 2015-09-09 17:55:00 +00:00
RegAllocFast.cpp Save LaneMask with livein registers 2015-09-09 18:08:03 +00:00
RegAllocGreedy.cpp [PM/AA] Rebuild LLVM's alias analysis infrastructure in a way compatible 2015-09-09 17:55:00 +00:00
RegAllocPBQP.cpp raw_ostream: << operator for callables with raw_ostream argument 2015-12-04 01:31:59 +00:00
RegisterClassInfo.cpp
RegisterCoalescer.cpp [NFC] Fix whitespace. 2016-01-11 19:17:36 +00:00
RegisterCoalescer.h
RegisterPressure.cpp RegisterPressure: Expose RegisterOperands API 2016-01-12 22:57:35 +00:00
RegisterScavenging.cpp TargetRegisterInfo: Add typedef unsigned LaneBitmask and use it where apropriate; NFC 2015-09-25 21:51:14 +00:00
ScheduleDAG.cpp MachineScheduler: Add regpressure information to debug dump 2015-11-06 20:59:02 +00:00
ScheduleDAGInstrs.cpp RegisterPressure: Expose RegisterOperands API 2016-01-12 22:57:35 +00:00
ScheduleDAGPrinter.cpp Make the SelectionDAG graph printer use SDNode::PersistentId labels. 2015-10-27 23:09:03 +00:00
ScoreboardHazardRecognizer.cpp
ShadowStackGC.cpp
ShadowStackGCLowering.cpp CodeGen: Avoid more ilist iterator implicit conversions, NFC 2015-10-09 21:08:19 +00:00
ShrinkWrap.cpp [ShrinkWrapping] Give up on irreducible CFGs. 2016-01-07 01:23:49 +00:00
SjLjEHPrepare.cpp CodeGen: Remove implicit ilist iterator conversions, NFC 2015-10-09 22:56:24 +00:00
SlotIndexes.cpp CodeGen: Continue removing ilist iterator implicit conversions 2015-10-09 19:40:45 +00:00
SpillPlacement.cpp CodeGen: Remove implicit ilist iterator conversions, NFC 2015-10-09 22:56:24 +00:00
SpillPlacement.h
Spiller.h
SplitKit.cpp CodeGen: Remove implicit ilist iterator conversions, NFC 2015-10-09 22:56:24 +00:00
SplitKit.h
StackColoring.cpp Reapply r257105 "[Verifier] Check that debug values have proper size" 2016-01-15 00:46:17 +00:00
StackMapLivenessAnalysis.cpp
StackMaps.cpp
StackProtector.cpp [BPI] Replace weights by probabilities in BPI. 2015-12-22 18:56:14 +00:00
StackSlotColoring.cpp PseudoSourceValue: Replace global manager with a manager in a machine function. 2015-08-11 23:09:45 +00:00
StatepointExampleGC.cpp [GC] Make GCStrategy::isGCManagedPointer a type predicate not a value predicate [NFC] 2015-12-23 01:42:15 +00:00
TailDuplication.cpp Minor change to TailDuplication.cpp to turn on normalization when removing successor 2015-12-16 06:03:30 +00:00
TargetFrameLoweringImpl.cpp HHVM calling conventions. 2015-09-29 22:09:16 +00:00
TargetInstrInfo.cpp replace MachineCombinerPattern namespace and enum with enum class; NFCI 2015-11-05 19:34:57 +00:00
TargetLoweringBase.cpp [Statepoints] Use Indirect operands for spill slots 2015-12-23 23:44:28 +00:00
TargetLoweringObjectFileImpl.cpp [PGO] [Coverage] put covmap into note section with no 'alloc flag' (Linux) 2016-01-14 18:09:45 +00:00
TargetOptionsImpl.cpp
TargetRegisterInfo.cpp raw_ostream: << operator for callables with raw_ostream argument 2015-12-04 01:31:59 +00:00
TargetSchedule.cpp [MISched] Explanatory error message when machine model is not complete. NFC 2016-01-05 14:50:15 +00:00
TwoAddressInstructionPass.cpp use range-based for loops; NFCI 2015-12-01 19:57:43 +00:00
UnreachableBlockElim.cpp CodeGen: Remove implicit ilist iterator conversions, NFC 2015-10-09 22:56:24 +00:00
VirtRegMap.cpp Assume lane masks are always precise 2015-11-17 00:50:55 +00:00
WinEHPrepare.cpp [WinEH] Update WinEHFuncInfo if StackColoring merges allocas 2016-01-08 08:03:55 +00:00
module.modulemap

README.txt

//===---------------------------------------------------------------------===//

Common register allocation / spilling problem:

        mul lr, r4, lr
        str lr, [sp, #+52]
        ldr lr, [r1, #+32]
        sxth r3, r3
        ldr r4, [sp, #+52]
        mla r4, r3, lr, r4

can be:

        mul lr, r4, lr
        mov r4, lr
        str lr, [sp, #+52]
        ldr lr, [r1, #+32]
        sxth r3, r3
        mla r4, r3, lr, r4

and then "merge" mul and mov:

        mul r4, r4, lr
        str r4, [sp, #+52]
        ldr lr, [r1, #+32]
        sxth r3, r3
        mla r4, r3, lr, r4

It also increase the likelihood the store may become dead.

//===---------------------------------------------------------------------===//

bb27 ...
        ...
        %reg1037 = ADDri %reg1039, 1
        %reg1038 = ADDrs %reg1032, %reg1039, %NOREG, 10
    Successors according to CFG: 0x8b03bf0 (#5)

bb76 (0x8b03bf0, LLVM BB @0x8b032d0, ID#5):
    Predecessors according to CFG: 0x8b0c5f0 (#3) 0x8b0a7c0 (#4)
        %reg1039 = PHI %reg1070, mbb<bb76.outer,0x8b0c5f0>, %reg1037, mbb<bb27,0x8b0a7c0>

Note ADDri is not a two-address instruction. However, its result %reg1037 is an
operand of the PHI node in bb76 and its operand %reg1039 is the result of the
PHI node. We should treat it as a two-address code and make sure the ADDri is
scheduled after any node that reads %reg1039.

//===---------------------------------------------------------------------===//

Use local info (i.e. register scavenger) to assign it a free register to allow
reuse:
        ldr r3, [sp, #+4]
        add r3, r3, #3
        ldr r2, [sp, #+8]
        add r2, r2, #2
        ldr r1, [sp, #+4]  <==
        add r1, r1, #1
        ldr r0, [sp, #+4]
        add r0, r0, #2

//===---------------------------------------------------------------------===//

LLVM aggressively lift CSE out of loop. Sometimes this can be negative side-
effects:

R1 = X + 4
R2 = X + 7
R3 = X + 15

loop:
load [i + R1]
...
load [i + R2]
...
load [i + R3]

Suppose there is high register pressure, R1, R2, R3, can be spilled. We need
to implement proper re-materialization to handle this:

R1 = X + 4
R2 = X + 7
R3 = X + 15

loop:
R1 = X + 4  @ re-materialized
load [i + R1]
...
R2 = X + 7 @ re-materialized
load [i + R2]
...
R3 = X + 15 @ re-materialized
load [i + R3]

Furthermore, with re-association, we can enable sharing:

R1 = X + 4
R2 = X + 7
R3 = X + 15

loop:
T = i + X
load [T + 4]
...
load [T + 7]
...
load [T + 15]
//===---------------------------------------------------------------------===//

It's not always a good idea to choose rematerialization over spilling. If all
the load / store instructions would be folded then spilling is cheaper because
it won't require new live intervals / registers. See 2003-05-31-LongShifts for
an example.

//===---------------------------------------------------------------------===//

With a copying garbage collector, derived pointers must not be retained across
collector safe points; the collector could move the objects and invalidate the
derived pointer. This is bad enough in the first place, but safe points can
crop up unpredictably. Consider:

        %array = load { i32, [0 x %obj] }** %array_addr
        %nth_el = getelementptr { i32, [0 x %obj] }* %array, i32 0, i32 %n
        %old = load %obj** %nth_el
        %z = div i64 %x, %y
        store %obj* %new, %obj** %nth_el

If the i64 division is lowered to a libcall, then a safe point will (must)
appear for the call site. If a collection occurs, %array and %nth_el no longer
point into the correct object.

The fix for this is to copy address calculations so that dependent pointers
are never live across safe point boundaries. But the loads cannot be copied
like this if there was an intervening store, so may be hard to get right.

Only a concurrent mutator can trigger a collection at the libcall safe point.
So single-threaded programs do not have this requirement, even with a copying
collector. Still, LLVM optimizations would probably undo a front-end's careful
work.

//===---------------------------------------------------------------------===//

The ocaml frametable structure supports liveness information. It would be good
to support it.

//===---------------------------------------------------------------------===//

The FIXME in ComputeCommonTailLength in BranchFolding.cpp needs to be
revisited. The check is there to work around a misuse of directives in inline
assembly.

//===---------------------------------------------------------------------===//

It would be good to detect collector/target compatibility instead of silently
doing the wrong thing.

//===---------------------------------------------------------------------===//

It would be really nice to be able to write patterns in .td files for copies,
which would eliminate a bunch of explicit predicates on them (e.g. no side 
effects).  Once this is in place, it would be even better to have tblgen 
synthesize the various copy insertion/inspection methods in TargetInstrInfo.

//===---------------------------------------------------------------------===//

Stack coloring improvements:

1. Do proper LiveStackAnalysis on all stack objects including those which are
   not spill slots.
2. Reorder objects to fill in gaps between objects.
   e.g. 4, 1, <gap>, 4, 1, 1, 1, <gap>, 4 => 4, 1, 1, 1, 1, 4, 4

//===---------------------------------------------------------------------===//

The scheduler should be able to sort nearby instructions by their address. For
example, in an expanded memset sequence it's not uncommon to see code like this:

  movl $0, 4(%rdi)
  movl $0, 8(%rdi)
  movl $0, 12(%rdi)
  movl $0, 0(%rdi)

Each of the stores is independent, and the scheduler is currently making an
arbitrary decision about the order.

//===---------------------------------------------------------------------===//

Another opportunitiy in this code is that the $0 could be moved to a register:

  movl $0, 4(%rdi)
  movl $0, 8(%rdi)
  movl $0, 12(%rdi)
  movl $0, 0(%rdi)

This would save substantial code size, especially for longer sequences like
this. It would be easy to have a rule telling isel to avoid matching MOV32mi
if the immediate has more than some fixed number of uses. It's more involved
to teach the register allocator how to do late folding to recover from
excessive register pressure.