llvm-project/llvm/lib/CodeGen
Nikita Popov 0a5dc7effb [DAGCombiner] Fold fmin/fmax of NaN
fminnum(X, NaN) is X, fminimum(X, NaN) is NaN. This mirrors the
behavior of existing InstSimplify folds.

This is expected to improve the reduction lowerings in D87391,
which use NaN as a neutral element.

Differential Revision: https://reviews.llvm.org/D87415
2020-09-09 23:53:32 +02:00
..
AsmPrinter Reduce the number of memory allocations when displaying 2020-09-07 17:04:00 +01:00
GlobalISel [GlobalISel] Enable usage of BranchProbabilityInfo in IRTranslator. 2020-09-09 14:31:12 -07:00
LiveDebugValues Fix Wdocumentation warning. NFCI. 2020-09-03 17:43:34 +01:00
MIRParser [AArch64][SVE] Preserve full vector regs over EH edge. 2020-09-02 10:54:18 +01:00
SelectionDAG [DAGCombiner] Fold fmin/fmax of NaN 2020-09-09 23:53:32 +02:00
AggressiveAntiDepBreaker.cpp
AggressiveAntiDepBreaker.h
AllocationOrder.cpp
AllocationOrder.h
Analysis.cpp
AtomicExpandPass.cpp Align store conditional address 2020-07-30 10:42:00 -05:00
BasicBlockSections.cpp [llvm][CodeGen] Machine Function Splitter 2020-08-28 11:10:14 -07:00
BasicTargetTransformInfo.cpp
BranchFolding.cpp BranchFolding.cpp - removes includes already included by BranchFolding.h. NFC. 2020-08-13 12:14:31 +01:00
BranchFolding.h [NFC] Clean up uses of MachineModuleInfoWrapperPass 2020-07-01 09:45:05 -07:00
BranchRelaxation.cpp
BreakFalseDeps.cpp [BreakFalseDeps][X86] Move operand loop out of X86's getUndefRegClearance and put in the pass. 2020-08-10 10:32:29 -07:00
BuiltinGCs.cpp
CFGuardLongjmp.cpp Revert rG5dd566b7c7b78bd- "PassManager.h - remove unnecessary Function.h/Module.h includes. NFCI." 2020-07-24 13:02:33 +01:00
CFIInstrInserter.cpp Call Frame Information (CFI) Handling for Basic Block Sections 2020-07-14 12:54:12 -07:00
CMakeLists.txt [MIRVRegNamer] Experimental MachineInstr stable hashing (Fowler-Noll-Vo) 2020-09-03 16:13:09 -04:00
CalcSpillWeights.cpp [CalcSpillWeights] Propagate the fact that a live-interval is not spillable 2020-07-15 17:57:36 -07:00
CallingConvLower.cpp CallingConvLower.h - remove unnecessary MachineFunction.h include. NFC. 2020-09-04 12:16:48 +01:00
CodeGen.cpp [NFC] Rename BBSectionsPrepare -> BasicBlockSections. 2020-08-06 13:12:06 -07:00
CodeGenPrepare.cpp [CodeGenPrepare][X86] Teach optimizeGatherScatterInst to turn a splat pointer into GEP with scalar base and 0 index 2020-09-02 20:44:12 -07:00
CommandFlags.cpp [llvm][CodeGen] Machine Function Splitter 2020-08-28 11:10:14 -07:00
CriticalAntiDepBreaker.cpp
CriticalAntiDepBreaker.h
DFAPacketizer.cpp
DeadMachineInstructionElim.cpp
DetectDeadLanes.cpp
DwarfEHPrepare.cpp
EarlyIfConversion.cpp Fix Wdocumentation trailing comments warnings. NFCI. 2020-09-03 17:43:34 +01:00
EdgeBundles.cpp
ExecutionDomainFix.cpp
ExpandMemCmp.cpp
ExpandPostRAPseudos.cpp
ExpandReductions.cpp [SVE] Remove calls to VectorType::getNumElements from CodeGen 2020-07-09 12:43:36 -07:00
FEntryInserter.cpp
FaultMaps.cpp
FinalizeISel.cpp
FixupStatepointCallerSaved.cpp [NFC] Silence variables unused in release builds 2020-08-14 08:35:58 -07:00
FuncletLayout.cpp
GCMetadata.cpp
GCMetadataPrinter.cpp
GCRootLowering.cpp [NFC] Clean up uses of MachineModuleInfoWrapperPass 2020-07-01 09:45:05 -07:00
GCStrategy.cpp
GlobalMerge.cpp
HardwareLoops.cpp [HWLoops] Stop converting to a while loop when it would be unsafe to 2020-07-17 11:47:08 +01:00
IfConversion.cpp [NFC] Clean up uses of MachineModuleInfoWrapperPass 2020-07-01 09:45:05 -07:00
ImplicitNullChecks.cpp [ImplicitNullChecks] NFC: Refactor dependence safety check 2020-09-02 10:29:44 -04:00
IndirectBrExpandPass.cpp
InlineSpiller.cpp [Statepoints] Operand folding in presense of tied registers. 2020-08-05 20:18:28 +07:00
InterferenceCache.cpp
InterferenceCache.h
InterleavedAccessPass.cpp [SVE] Remove calls to VectorType::getNumElements from CodeGen 2020-07-09 12:43:36 -07:00
InterleavedLoadCombinePass.cpp [SVE] Remove calls to VectorType::getNumElements from CodeGen 2020-07-09 12:43:36 -07:00
IntrinsicLowering.cpp
LLVMBuild.txt lib/CodeGen doesn't depend on lib/Passes. 2020-08-08 13:40:24 +02:00
LLVMTargetMachine.cpp [NFC] remove unneeded TargetLoweringObjectFile init after 85c30f3374 2020-07-20 10:43:28 -07:00
LatencyPriorityQueue.cpp
LazyMachineBlockFrequencyInfo.cpp
LexicalScopes.cpp
LiveDebugVariables.cpp [LiveDebugVariables] Delete unneeded doInitialization 2020-09-04 13:27:42 -07:00
LiveDebugVariables.h [LiveDebugVariables] Delete unneeded doInitialization 2020-09-04 13:27:42 -07:00
LiveInterval.cpp
LiveIntervalCalc.cpp
LiveIntervalUnion.cpp
LiveIntervals.cpp [AArch64][SVE] Preserve full vector regs over EH edge. 2020-09-02 10:54:18 +01:00
LivePhysRegs.cpp
LiveRangeCalc.cpp
LiveRangeEdit.cpp RegAlloc: Start using Register 2020-06-30 12:13:08 -04:00
LiveRangeShrink.cpp
LiveRangeUtils.h
LiveRegMatrix.cpp
LiveRegUnits.cpp LiveRegUnits.h - reduce MachineRegisterInfo.h include. NFC. 2020-09-08 17:27:00 +01:00
LiveStacks.cpp
LiveVariables.cpp [LiveVariables] Replace std::vector with SmallVector. 2020-07-16 11:39:54 -07:00
LocalStackSlotAllocation.cpp [SVE] Don't use LocalStackAllocation for SVE objects 2020-07-27 08:22:01 +01:00
LoopTraversal.cpp
LowLevelType.cpp [SVE] Remove calls to VectorType::getNumElements from CodeGen 2020-07-09 12:43:36 -07:00
LowerEmuTLS.cpp LowerEmuTLS.cpp - remove unused TargetLowering.h include. NFC. 2020-09-03 14:40:09 +01:00
MBFIWrapper.cpp
MIRCanonicalizerPass.cpp
MIRNamerPass.cpp
MIRPrinter.cpp MachineBasicBlock: add printName method 2020-07-24 18:18:09 +02:00
MIRPrintingPass.cpp
MIRVRegNamerUtils.cpp [MIRVRegNamer] Experimental MachineInstr stable hashing (Fowler-Noll-Vo) 2020-09-03 16:13:09 -04:00
MIRVRegNamerUtils.h
MachineBasicBlock.cpp [Propeller]: Use a descriptive temporary symbol name for the end of the basic block. 2020-08-05 13:17:19 -07:00
MachineBlockFrequencyInfo.cpp [llvm][NFC] refactor setBlockFrequency for clarity. 2020-07-28 13:04:11 -07:00
MachineBlockPlacement.cpp [MBP] Use profile count to compute tail dup cost if it is available 2020-07-21 11:18:06 -07:00
MachineBranchProbabilityInfo.cpp
MachineCSE.cpp DomTree: Remove getChildren() accessor 2020-07-06 21:58:11 +02:00
MachineCombiner.cpp
MachineCopyPropagation.cpp [MachineCopyPropagation] In isNopCopy, check the destination registers match in addition to the source registers. 2020-09-01 12:44:32 -07:00
MachineDebugify.cpp
MachineDominanceFrontier.cpp
MachineDominators.cpp
MachineFrameInfo.cpp
MachineFunction.cpp CodeGen: Don't drop AA metadata when splitting MachineMemOperands 2020-08-20 16:17:30 -04:00
MachineFunctionPass.cpp
MachineFunctionPrinterPass.cpp
MachineFunctionSplitter.cpp [llvm][CodeGen] Machine Function Splitter 2020-08-28 11:10:14 -07:00
MachineInstr.cpp Fix a couple of typos. NFC 2020-08-20 14:56:57 -06:00
MachineInstrBundle.cpp
MachineLICM.cpp DomTree: Remove getChildren() accessor 2020-07-06 21:58:11 +02:00
MachineLoopInfo.cpp
MachineLoopUtils.cpp
MachineModuleInfo.cpp Fix the move constructor of MMI to move MachineFunctions map 2020-07-27 14:10:05 -07:00
MachineModuleInfoImpls.cpp
MachineOperand.cpp [codegen] Ensure target flags are cleared/set properly. NFC. 2020-09-03 18:37:39 -04:00
MachineOptimizationRemarkEmitter.cpp
MachineOutliner.cpp LiveRegUnits.h - reduce MachineRegisterInfo.h include. NFC. 2020-09-08 17:27:00 +01:00
MachinePassManager.cpp [NewPM][PassInstrumentation] Add PreservedAnalyses parameter to AfterPass* callbacks 2020-08-21 16:10:42 +07:00
MachinePipeliner.cpp [MachinePipeliner] Fix II_setByPragma initialization 2020-09-09 13:38:35 +00:00
MachinePostDominators.cpp
MachineRegionInfo.cpp
MachineRegisterInfo.cpp
MachineSSAUpdater.cpp MachineSSAUpdater: Allow initialization with just a register class 2020-08-21 23:04:35 +02:00
MachineScheduler.cpp [Scheduling] Implement a new way to cluster loads/stores 2020-08-26 12:33:59 +00:00
MachineSink.cpp [llvm][NFC] refactor setBlockFrequency for clarity. 2020-07-28 13:04:11 -07:00
MachineSizeOpts.cpp Revert rG5dd566b7c7b78bd- "PassManager.h - remove unnecessary Function.h/Module.h includes. NFCI." 2020-07-24 13:02:33 +01:00
MachineStableHash.cpp MachineStableHash.h - remove MachineInstr.h include. NFC. 2020-09-07 13:33:48 +01:00
MachineStripDebug.cpp
MachineTraceMetrics.cpp
MachineVerifier.cpp [ARM] Make MachineVerifier more strict about terminators 2020-08-27 07:10:20 +01:00
MacroFusion.cpp
ModuloSchedule.cpp [ModuloSchedule] Make PeelingModuloScheduleExpander inheritable. 2020-06-30 15:56:13 -07:00
NonRelocatableStringpool.cpp
OptimizePHIs.cpp
PHIElimination.cpp [PHIElimination] Fix the killed flag for LowerPHINode() 2020-07-30 08:18:50 +00:00
PHIEliminationUtils.cpp PHIEliminationUtils.cpp - remove unnecessary MachineBasicBlock.h include. NFCI. 2020-09-03 17:43:34 +01:00
PHIEliminationUtils.h
ParallelCG.cpp
PatchableFunction.cpp
PeepholeOptimizer.cpp [PeepholeOptimizer] Remove dead code 2020-08-20 16:48:57 +01:00
PostRAHazardRecognizer.cpp
PostRASchedulerList.cpp
PreISelIntrinsicLowering.cpp
ProcessImplicitDefs.cpp
PrologEpilogInserter.cpp
PseudoSourceValue.cpp
RDFGraph.cpp [RDF] Really remove remaining uses of PhysicalRegisterInfo::normalize 2020-08-04 18:23:38 -05:00
RDFLiveness.cpp Use properlyDominates in RDFLiveness when sorting on dominance. 2020-08-26 15:16:40 -07:00
RDFRegisters.cpp [RDF] Add operator<<(raw_ostream&, RegisterAggr), NFC 2020-08-04 18:40:07 -05:00
README.txt
ReachingDefAnalysis.cpp [ARM][LowOverheadLoops] Liveouts and reductions 2020-08-28 13:56:16 +01:00
RegAllocBase.cpp Revert rG5dd566b7c7b78bd- "PassManager.h - remove unnecessary Function.h/Module.h includes. NFCI." 2020-07-24 13:02:33 +01:00
RegAllocBase.h RegAlloc: Start using Register 2020-06-30 12:13:08 -04:00
RegAllocBasic.cpp RegAlloc: Start using Register 2020-06-30 12:13:08 -04:00
RegAllocFast.cpp
RegAllocGreedy.cpp RegAllocGreedy: Use TargetInstrInfo already in the class 2020-07-01 18:58:59 -04:00
RegAllocPBQP.cpp [llvm][NFC] Add comments and common-case API to MachineBlockFrequencyInfo 2020-07-23 08:42:34 -07:00
RegUsageInfoCollector.cpp
RegUsageInfoPropagate.cpp
RegisterClassInfo.cpp
RegisterCoalescer.cpp Change the INLINEASM_BR MachineInstr to be a non-terminating instruction. 2020-07-01 12:51:50 -04:00
RegisterCoalescer.h
RegisterPressure.cpp
RegisterScavenging.cpp [RegisterScavenging] Delete dead function unprocess(). 2020-08-27 13:19:32 -07:00
RegisterUsageInfo.cpp
RenameIndependentSubregs.cpp
ResetMachineFunctionPass.cpp
SafeStack.cpp
SafeStackLayout.cpp
SafeStackLayout.h
ScalarizeMaskedMemIntrin.cpp [ScalarizeMaskedMemIntrin] Scalarize constant mask expandload as shuffle(build_vector,pass_through) 2020-08-10 11:05:57 +01:00
ScheduleDAG.cpp
ScheduleDAGInstrs.cpp [NFC] Remove unused GetUnderlyingObject paramenter 2020-07-31 02:10:03 -07:00
ScheduleDAGPrinter.cpp
ScoreboardHazardRecognizer.cpp
ShadowStackGCLowering.cpp
ShrinkWrap.cpp Change the INLINEASM_BR MachineInstr to be a non-terminating instruction. 2020-07-01 12:51:50 -04:00
SjLjEHPrepare.cpp
SlotIndexes.cpp
SpillPlacement.cpp
SpillPlacement.h
SplitKit.cpp SplitKit.cpp - removes includes already included by SplitKit.h. NFC. 2020-08-13 11:43:28 +01:00
SplitKit.h Change the INLINEASM_BR MachineInstr to be a non-terminating instruction. 2020-07-01 12:51:50 -04:00
StackColoring.cpp [NFC] Remove unused GetUnderlyingObject paramenter 2020-07-31 02:10:03 -07:00
StackMapLivenessAnalysis.cpp
StackMaps.cpp [Statepoints] Properly handle const base pointer. 2020-09-09 14:07:00 +07:00
StackProtector.cpp [StackProtector] Fix crash with vararg due to not checking LocationSize validity. 2020-09-03 00:08:48 -07:00
StackSlotColoring.cpp
SwiftErrorValueTracking.cpp
SwitchLoweringUtils.cpp SelectionDAG.h - remove unnecessary FunctionLoweringInfo.h include. NFCI. 2020-09-03 18:33:25 +01:00
TailDuplication.cpp
TailDuplicator.cpp Change the INLINEASM_BR MachineInstr to be a non-terminating instruction. 2020-07-01 12:51:50 -04:00
TargetFrameLoweringImpl.cpp
TargetInstrInfo.cpp [Statepoint] Turn assert into check in foldPatchpoint. 2020-08-28 20:00:23 +07:00
TargetLoweringBase.cpp [SVE] Make ElementCount members private 2020-08-28 14:43:53 +01:00
TargetLoweringObjectFileImpl.cpp [TargetLoweringObjectFileImpl] Make .llvmbc and .llvmcmd non-SHF_ALLOC 2020-08-25 13:37:29 -07:00
TargetOptionsImpl.cpp [DWARF] Avoid entry_values production for SCE 2020-07-24 13:34:05 +02:00
TargetPassConfig.cpp [llvm][CodeGen] Machine Function Splitter 2020-08-28 11:10:14 -07:00
TargetRegisterInfo.cpp
TargetSchedule.cpp
TargetSubtargetInfo.cpp [X86][MC][Target] Initial backend support a tune CPU to support -mtune 2020-08-14 15:31:50 -07:00
TwoAddressInstructionPass.cpp Remove TwoAddressInstructionPass::sink3AddrInstruction. 2020-07-16 10:02:52 -04:00
TypePromotion.cpp
UnreachableBlockElim.cpp [NFC] Clean up uses of MachineModuleInfoWrapperPass 2020-07-01 09:45:05 -07:00
ValueTypes.cpp [SVE] Make ElementCount members private 2020-08-28 14:43:53 +01:00
VirtRegMap.cpp Unbundle KILL bundles in VirtRegRewriter 2020-08-10 11:58:37 -07:00
WasmEHPrepare.cpp
WinEHPrepare.cpp Revert rG5dd566b7c7b78bd- "PassManager.h - remove unnecessary Function.h/Module.h includes. NFCI." 2020-07-24 13:02:33 +01:00
XRayInstrumentation.cpp [Attributes] Add a method to check if an Attribute has AttrKind None. Use instead of hasAttribute(Attribute::None) 2020-08-28 13:23:45 -07:00

README.txt

//===---------------------------------------------------------------------===//

Common register allocation / spilling problem:

        mul lr, r4, lr
        str lr, [sp, #+52]
        ldr lr, [r1, #+32]
        sxth r3, r3
        ldr r4, [sp, #+52]
        mla r4, r3, lr, r4

can be:

        mul lr, r4, lr
        mov r4, lr
        str lr, [sp, #+52]
        ldr lr, [r1, #+32]
        sxth r3, r3
        mla r4, r3, lr, r4

and then "merge" mul and mov:

        mul r4, r4, lr
        str r4, [sp, #+52]
        ldr lr, [r1, #+32]
        sxth r3, r3
        mla r4, r3, lr, r4

It also increase the likelihood the store may become dead.

//===---------------------------------------------------------------------===//

bb27 ...
        ...
        %reg1037 = ADDri %reg1039, 1
        %reg1038 = ADDrs %reg1032, %reg1039, %noreg, 10
    Successors according to CFG: 0x8b03bf0 (#5)

bb76 (0x8b03bf0, LLVM BB @0x8b032d0, ID#5):
    Predecessors according to CFG: 0x8b0c5f0 (#3) 0x8b0a7c0 (#4)
        %reg1039 = PHI %reg1070, mbb<bb76.outer,0x8b0c5f0>, %reg1037, mbb<bb27,0x8b0a7c0>

Note ADDri is not a two-address instruction. However, its result %reg1037 is an
operand of the PHI node in bb76 and its operand %reg1039 is the result of the
PHI node. We should treat it as a two-address code and make sure the ADDri is
scheduled after any node that reads %reg1039.

//===---------------------------------------------------------------------===//

Use local info (i.e. register scavenger) to assign it a free register to allow
reuse:
        ldr r3, [sp, #+4]
        add r3, r3, #3
        ldr r2, [sp, #+8]
        add r2, r2, #2
        ldr r1, [sp, #+4]  <==
        add r1, r1, #1
        ldr r0, [sp, #+4]
        add r0, r0, #2

//===---------------------------------------------------------------------===//

LLVM aggressively lift CSE out of loop. Sometimes this can be negative side-
effects:

R1 = X + 4
R2 = X + 7
R3 = X + 15

loop:
load [i + R1]
...
load [i + R2]
...
load [i + R3]

Suppose there is high register pressure, R1, R2, R3, can be spilled. We need
to implement proper re-materialization to handle this:

R1 = X + 4
R2 = X + 7
R3 = X + 15

loop:
R1 = X + 4  @ re-materialized
load [i + R1]
...
R2 = X + 7 @ re-materialized
load [i + R2]
...
R3 = X + 15 @ re-materialized
load [i + R3]

Furthermore, with re-association, we can enable sharing:

R1 = X + 4
R2 = X + 7
R3 = X + 15

loop:
T = i + X
load [T + 4]
...
load [T + 7]
...
load [T + 15]
//===---------------------------------------------------------------------===//

It's not always a good idea to choose rematerialization over spilling. If all
the load / store instructions would be folded then spilling is cheaper because
it won't require new live intervals / registers. See 2003-05-31-LongShifts for
an example.

//===---------------------------------------------------------------------===//

With a copying garbage collector, derived pointers must not be retained across
collector safe points; the collector could move the objects and invalidate the
derived pointer. This is bad enough in the first place, but safe points can
crop up unpredictably. Consider:

        %array = load { i32, [0 x %obj] }** %array_addr
        %nth_el = getelementptr { i32, [0 x %obj] }* %array, i32 0, i32 %n
        %old = load %obj** %nth_el
        %z = div i64 %x, %y
        store %obj* %new, %obj** %nth_el

If the i64 division is lowered to a libcall, then a safe point will (must)
appear for the call site. If a collection occurs, %array and %nth_el no longer
point into the correct object.

The fix for this is to copy address calculations so that dependent pointers
are never live across safe point boundaries. But the loads cannot be copied
like this if there was an intervening store, so may be hard to get right.

Only a concurrent mutator can trigger a collection at the libcall safe point.
So single-threaded programs do not have this requirement, even with a copying
collector. Still, LLVM optimizations would probably undo a front-end's careful
work.

//===---------------------------------------------------------------------===//

The ocaml frametable structure supports liveness information. It would be good
to support it.

//===---------------------------------------------------------------------===//

The FIXME in ComputeCommonTailLength in BranchFolding.cpp needs to be
revisited. The check is there to work around a misuse of directives in inline
assembly.

//===---------------------------------------------------------------------===//

It would be good to detect collector/target compatibility instead of silently
doing the wrong thing.

//===---------------------------------------------------------------------===//

It would be really nice to be able to write patterns in .td files for copies,
which would eliminate a bunch of explicit predicates on them (e.g. no side
effects).  Once this is in place, it would be even better to have tblgen
synthesize the various copy insertion/inspection methods in TargetInstrInfo.

//===---------------------------------------------------------------------===//

Stack coloring improvements:

1. Do proper LiveStacks analysis on all stack objects including those which are
   not spill slots.
2. Reorder objects to fill in gaps between objects.
   e.g. 4, 1, <gap>, 4, 1, 1, 1, <gap>, 4 => 4, 1, 1, 1, 1, 4, 4

//===---------------------------------------------------------------------===//

The scheduler should be able to sort nearby instructions by their address. For
example, in an expanded memset sequence it's not uncommon to see code like this:

  movl $0, 4(%rdi)
  movl $0, 8(%rdi)
  movl $0, 12(%rdi)
  movl $0, 0(%rdi)

Each of the stores is independent, and the scheduler is currently making an
arbitrary decision about the order.

//===---------------------------------------------------------------------===//

Another opportunitiy in this code is that the $0 could be moved to a register:

  movl $0, 4(%rdi)
  movl $0, 8(%rdi)
  movl $0, 12(%rdi)
  movl $0, 0(%rdi)

This would save substantial code size, especially for longer sequences like
this. It would be easy to have a rule telling isel to avoid matching MOV32mi
if the immediate has more than some fixed number of uses. It's more involved
to teach the register allocator how to do late folding to recover from
excessive register pressure.