LLVM: llvm::LegalizerHelper Class Reference (original) (raw)

#include "[llvm/CodeGen/GlobalISel/LegalizerHelper.h](LegalizerHelper%5F8h%5Fsource.html)"

Public Types
enum LegalizeResult { AlreadyLegal, Legalized, UnableToLegalize }
Public Member Functions
const LegalizerInfo & getLegalizerInfo () const
Expose LegalizerInfo so the clients can re-use.
const TargetLowering & getTargetLowering () const
GISelValueTracking * getValueTracking () const
LLVM_ABI LegalizerHelper (MachineFunction &MF, GISelChangeObserver &Observer, MachineIRBuilder &B)
LLVM_ABI LegalizerHelper (MachineFunction &MF, const LegalizerInfo &LI, GISelChangeObserver &Observer, MachineIRBuilder &B, GISelValueTracking *VT=nullptr)
LLVM_ABI LegalizeResult legalizeInstrStep (MachineInstr &MI, LostDebugLocObserver &LocObserver)
Replace MI by a sequence of legal instructions that can implement the same operation.
LLVM_ABI LegalizeResult libcall (MachineInstr &MI, LostDebugLocObserver &LocObserver)
Legalize an instruction by emiting a runtime library call instead.
LLVM_ABI LegalizeResult narrowScalar (MachineInstr &MI, unsigned TypeIdx, LLT NarrowTy)
Legalize an instruction by reducing the width of the underlying scalar type.
LLVM_ABI LegalizeResult widenScalar (MachineInstr &MI, unsigned TypeIdx, LLT WideTy)
Legalize an instruction by performing the operation on a wider scalar type (for example a 16-bit addition can be safely performed at 32-bits precision, ignoring the unused bits).
LLVM_ABI LegalizeResult bitcast (MachineInstr &MI, unsigned TypeIdx, LLT Ty)
Legalize an instruction by replacing the value type.
LLVM_ABI LegalizeResult lower (MachineInstr &MI, unsigned TypeIdx, LLT Ty)
Legalize an instruction by splitting it into simpler parts, hopefully understood by the target.
LLVM_ABI LegalizeResult fewerElementsVector (MachineInstr &MI, unsigned TypeIdx, LLT NarrowTy)
Legalize a vector instruction by splitting into multiple components, each acting on the same scalar type as the original but with fewer elements.
LLVM_ABI LegalizeResult moreElementsVector (MachineInstr &MI, unsigned TypeIdx, LLT MoreTy)
Legalize a vector instruction by increasing the number of vector elements involved and ignoring the added elements later.
LLVM_ABI Register coerceToScalar (Register Val)
Cast the given value to an [LLT::scalar](classllvm%5F1%5F1LLT.html#a67021459c7ef8f9a634b4eac7ffd0f96 "Get a low-level scalar or aggregate "bag of bits".") with an equivalent size.
LLVM_ABI void widenScalarSrc (MachineInstr &MI, LLT WideTy, unsigned OpIdx, unsigned ExtOpcode)
Legalize a single operand OpIdx of the machine instruction MI as a Use by extending the operand's type to WideTy using the specified ExtOpcode for the extension instruction, and replacing the vreg of the operand in place.
LLVM_ABI void narrowScalarSrc (MachineInstr &MI, LLT NarrowTy, unsigned OpIdx)
Legalize a single operand OpIdx of the machine instruction MI as a Use by truncating the operand's type to NarrowTy using G_TRUNC, and replacing the vreg of the operand in place.
LLVM_ABI void widenScalarDst (MachineInstr &MI, LLT WideTy, unsigned OpIdx=0, unsigned TruncOpcode=TargetOpcode::G_TRUNC)
Legalize a single operand OpIdx of the machine instruction MI as a Def by extending the operand's type to WideTy and truncating it back with the TruncOpcode, and replacing the vreg of the operand in place.
LLVM_ABI void narrowScalarDst (MachineInstr &MI, LLT NarrowTy, unsigned OpIdx, unsigned ExtOpcode)
LLVM_ABI void moreElementsVectorDst (MachineInstr &MI, LLT MoreTy, unsigned OpIdx)
Legalize a single operand OpIdx of the machine instruction MI as a Def by performing it with additional vector elements and extracting the result elements, and replacing the vreg of the operand in place.
LLVM_ABI void moreElementsVectorSrc (MachineInstr &MI, LLT MoreTy, unsigned OpIdx)
Legalize a single operand OpIdx of the machine instruction MI as a Use by producing a vector with undefined high elements, extracting the original vector type, and replacing the vreg of the operand in place.
LLVM_ABI void bitcastSrc (MachineInstr &MI, LLT CastTy, unsigned OpIdx)
Legalize a single operand OpIdx of the machine instruction MI as a use by inserting a G_BITCAST to CastTy.
LLVM_ABI void bitcastDst (MachineInstr &MI, LLT CastTy, unsigned OpIdx)
Legalize a single operand OpIdx of the machine instruction MI as a def by inserting a G_BITCAST from CastTy.
LLVM_ABI Align getStackTemporaryAlignment (LLT Type, Align MinAlign=Align()) const
Return the alignment to use for a stack temporary object with the given type.
LLVM_ABI MachineInstrBuilder createStackTemporary (TypeSize Bytes, Align Alignment, MachinePointerInfo &PtrInfo)
Create a stack temporary based on the size in bytes and the alignment.
LLVM_ABI MachineInstrBuilder createStackStoreLoad (const DstOp &Res, const SrcOp &Val)
Create a store of Val to a stack temporary and return a load as the same type as Res.
LLVM_ABI LegalizeResult scalarizeVectorBooleanStore (GStore &MI)
Given a store of a boolean vector, scalarize it.
LLVM_ABI Register getVectorElementPointer (Register VecPtr, LLT VecTy, Register Index)
Get a pointer to vector element Index located in memory for a vector of type VecTy starting at a base address of VecPtr.
LLVM_ABI LegalizeResult fewerElementsVectorMultiEltType (GenericMachineInstr &MI, unsigned NumElts, std::initializer_list< unsigned > NonVecOpIndices={})
Handles most opcodes.
LLVM_ABI LegalizeResult fewerElementsVectorPhi (GenericMachineInstr &MI, unsigned NumElts)
LLVM_ABI LegalizeResult moreElementsVectorPhi (MachineInstr &MI, unsigned TypeIdx, LLT MoreTy)
LLVM_ABI LegalizeResult moreElementsVectorShuffle (MachineInstr &MI, unsigned TypeIdx, LLT MoreTy)
LLVM_ABI LegalizeResult fewerElementsVectorUnmergeValues (MachineInstr &MI, unsigned TypeIdx, LLT NarrowTy)
LLVM_ABI LegalizeResult fewerElementsVectorMerge (MachineInstr &MI, unsigned TypeIdx, LLT NarrowTy)
LLVM_ABI LegalizeResult fewerElementsVectorExtractInsertVectorElt (MachineInstr &MI, unsigned TypeIdx, LLT NarrowTy)
LLVM_ABI LegalizeResult equalizeVectorShuffleLengths (MachineInstr &MI)
Equalize source and destination vector sizes of G_SHUFFLE_VECTOR.
LLVM_ABI LegalizeResult reduceLoadStoreWidth (GLoadStore &MI, unsigned TypeIdx, LLT NarrowTy)
LLVM_ABI LegalizeResult narrowScalarShiftByConstant (MachineInstr &MI, const APInt &Amt, LLT HalfTy, LLT ShiftAmtTy)
LLVM_ABI LegalizeResult narrowScalarShiftMultiway (MachineInstr &MI, LLT TargetTy)
Multi-way shift legalization: directly split wide shifts into target-sized parts in a single step, avoiding recursive binary splitting.
LLVM_ABI LegalizeResult narrowScalarShiftByConstantMultiway (MachineInstr &MI, const APInt &Amt, LLT TargetTy, LLT ShiftAmtTy)
Optimized path for constant shift amounts using static indexing.
LLVM_ABI Register buildConstantShiftPart (unsigned Opcode, unsigned PartIdx, unsigned NumParts, ArrayRef< Register > SrcParts, const ShiftParams &Params, LLT TargetTy, LLT ShiftAmtTy)
Generates a single output part for constant shifts using direct indexing.
LLVM_ABI Register buildVariableShiftPart (unsigned Opcode, Register MainOperand, Register ShiftAmt, LLT TargetTy, Register CarryOperand=Register())
Generates a shift part with carry for variable shifts.
LLVM_ABI LegalizeResult fewerElementsVectorReductions (MachineInstr &MI, unsigned TypeIdx, LLT NarrowTy)
LLVM_ABI LegalizeResult fewerElementsVectorSeqReductions (MachineInstr &MI, unsigned TypeIdx, LLT NarrowTy)
LLVM_ABI LegalizeResult fewerElementsBitcast (MachineInstr &MI, unsigned TypeIdx, LLT NarrowTy)
LLVM_ABI LegalizeResult fewerElementsVectorShuffle (MachineInstr &MI, unsigned TypeIdx, LLT NarrowTy)
LLVM_ABI LegalizeResult narrowScalarShift (MachineInstr &MI, unsigned TypeIdx, LLT Ty)
LLVM_ABI LegalizeResult narrowScalarAddSub (MachineInstr &MI, unsigned TypeIdx, LLT NarrowTy)
LLVM_ABI LegalizeResult narrowScalarMul (MachineInstr &MI, LLT Ty)
LLVM_ABI LegalizeResult narrowScalarFPTOI (MachineInstr &MI, unsigned TypeIdx, LLT Ty)
LLVM_ABI LegalizeResult narrowScalarExtract (MachineInstr &MI, unsigned TypeIdx, LLT Ty)
LLVM_ABI LegalizeResult narrowScalarInsert (MachineInstr &MI, unsigned TypeIdx, LLT Ty)
LLVM_ABI LegalizeResult narrowScalarBasic (MachineInstr &MI, unsigned TypeIdx, LLT Ty)
LLVM_ABI LegalizeResult narrowScalarExt (MachineInstr &MI, unsigned TypeIdx, LLT Ty)
LLVM_ABI LegalizeResult narrowScalarSelect (MachineInstr &MI, unsigned TypeIdx, LLT Ty)
LLVM_ABI LegalizeResult narrowScalarCTLZ (MachineInstr &MI, unsigned TypeIdx, LLT Ty)
LLVM_ABI LegalizeResult narrowScalarCTTZ (MachineInstr &MI, unsigned TypeIdx, LLT Ty)
LLVM_ABI LegalizeResult narrowScalarCTPOP (MachineInstr &MI, unsigned TypeIdx, LLT Ty)
LLVM_ABI LegalizeResult narrowScalarFLDEXP (MachineInstr &MI, unsigned TypeIdx, LLT Ty)
LLVM_ABI LegalizeResult bitcastExtractVectorElt (MachineInstr &MI, unsigned TypeIdx, LLT CastTy)
Perform Bitcast legalize action on G_EXTRACT_VECTOR_ELT.
LLVM_ABI LegalizeResult bitcastInsertVectorElt (MachineInstr &MI, unsigned TypeIdx, LLT CastTy)
Perform Bitcast legalize action on G_INSERT_VECTOR_ELT.
LLVM_ABI LegalizeResult bitcastConcatVector (MachineInstr &MI, unsigned TypeIdx, LLT CastTy)
LLVM_ABI LegalizeResult bitcastShuffleVector (MachineInstr &MI, unsigned TypeIdx, LLT CastTy)
LLVM_ABI LegalizeResult bitcastExtractSubvector (MachineInstr &MI, unsigned TypeIdx, LLT CastTy)
This attempts to bitcast G_EXTRACT_SUBVECTOR to CastTy.
LLVM_ABI LegalizeResult bitcastInsertSubvector (MachineInstr &MI, unsigned TypeIdx, LLT CastTy)
This attempts to bitcast G_INSERT_SUBVECTOR to CastTy.
LLVM_ABI LegalizeResult lowerConstant (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerFConstant (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerBitcast (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerLoad (GAnyLoad &MI)
LLVM_ABI LegalizeResult lowerStore (GStore &MI)
LLVM_ABI LegalizeResult lowerBitCount (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerFunnelShiftWithInverse (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerFunnelShiftAsShifts (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerFunnelShift (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerEXT (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerTRUNC (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerRotateWithReverseRotate (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerRotate (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerU64ToF32BitOps (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerU64ToF32WithSITOFP (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerU64ToF64BitFloatOps (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerUITOFP (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerSITOFP (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerFPTOUI (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerFPTOSI (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerFPTOINT_SAT (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerFPTRUNC_F64_TO_F16 (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerFPTRUNC (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerFPOWI (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerISFPCLASS (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerThreewayCompare (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerMinMax (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerFCopySign (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerFMinNumMaxNum (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerFMinimumMaximum (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerFMad (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerIntrinsicRound (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerFFloor (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerMergeValues (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerUnmergeValues (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerExtractInsertVectorElt (MachineInstr &MI)
Lower a vector extract or insert by writing the vector to a stack temporary and reloading the element or vector.
LLVM_ABI LegalizeResult lowerShuffleVector (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerVECTOR_COMPRESS (MachineInstr &MI)
LLVM_ABI Register getDynStackAllocTargetPtr (Register SPReg, Register AllocSize, Align Alignment, LLT PtrTy)
LLVM_ABI LegalizeResult lowerDynStackAlloc (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerStackSave (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerStackRestore (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerExtract (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerInsert (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerSADDO_SSUBO (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerSADDE (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerSSUBE (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerAddSubSatToMinMax (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerAddSubSatToAddoSubo (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerShlSat (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerBswap (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerBitreverse (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerReadWriteRegister (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerSMULH_UMULH (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerSelect (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerDIVREM (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerAbsToAddXor (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerAbsToMaxNeg (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerAbsToCNeg (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerAbsDiffToSelect (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerAbsDiffToMinMax (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerFAbs (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerVectorReduction (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerMemcpyInline (MachineInstr &MI)
LLVM_ABI LegalizeResult lowerMemCpyFamily (MachineInstr &MI, unsigned MaxLen=0)
LLVM_ABI LegalizeResult lowerVAArg (MachineInstr &MI)

Definition at line 49 of file LegalizerHelper.h.

◆ LegalizeResult

◆ LegalizerHelper() [2/2]

◆ bitcast()

Legalize an instruction by replacing the value type.

Definition at line 4427 of file LegalizerHelper.cpp.

References bitcastConcatVector(), bitcastDst(), bitcastExtractSubvector(), bitcastExtractVectorElt(), bitcastInsertSubvector(), bitcastInsertVectorElt(), bitcastShuffleVector(), bitcastSrc(), llvm::MachineMemOperand::clearRanges(), llvm::dbgs(), llvm::MachineMemOperand::getMemoryType(), llvm::LLT::getSizeInBits(), Legalized, LLVM_DEBUG, MI, Observer, llvm::MachineMemOperand::setType(), and UnableToLegalize.

Referenced by legalizeInstrStep().

◆ bitcastConcatVector()

◆ bitcastDst()

◆ bitcastExtractSubvector()

This attempts to bitcast G_EXTRACT_SUBVECTOR to CastTy.

<vscale x 8 x i1> = G_EXTRACT_SUBVECTOR <vscale x 16 x i1>, N

===>

<vscale x 2 x i1> = G_BITCAST <vscale x 16 x i1> <vscale x 1 x i8> = G_EXTRACT_SUBVECTOR <vscale x 2 x i1>, N / 8 <vscale x 8 x i1> = G_BITCAST <vscale x 1 x i8>

Definition at line 4016 of file LegalizerHelper.cpp.

References llvm::cast(), llvm::details::FixedOrScalableQuantity< LeafTy, ValueTy >::divideCoefficientBy(), llvm::LLT::getElementCount(), llvm::LLT::getElementType(), llvm::details::FixedOrScalableQuantity< LeafTy, ValueTy >::getKnownMinValue(), llvm::LLT::getSizeInBits(), llvm::LLT::isVector(), Legalized, MI, MIRBuilder, UnableToLegalize, and llvm::LLT::vector().

Referenced by bitcast().

◆ bitcastExtractVectorElt()

Perform Bitcast legalize action on G_EXTRACT_VECTOR_ELT.

Perform a G_EXTRACT_VECTOR_ELT in a different sized vector element.

If this is casting to a vector with a smaller element size, perform multiple element extracts and merge the results. If this is coercing to a vector with larger elements, index the bitcasted vector and extract the target element with bit operations. This is intended to force the indexing in the native register size for architectures that can dynamically index the register file.

Definition at line 3728 of file LegalizerHelper.cpp.

References getBitcastWiderVectorElementOffset(), llvm::LLT::getElementType(), llvm::ElementCount::getFixed(), llvm::LLT::getNumElements(), llvm::LLT::getSizeInBits(), I, llvm::isPowerOf2_32(), llvm::LLT::isVector(), Legalized, llvm::Log2_32(), MI, MIRBuilder, llvm::LLT::scalarOrVector(), and UnableToLegalize.

Referenced by bitcast().

◆ bitcastInsertSubvector()

This attempts to bitcast G_INSERT_SUBVECTOR to CastTy.

<vscale x 16 x i1> = G_INSERT_SUBVECTOR <vscale x 16 x i1>, <vscale x 8 x i1>, N

===>

<vscale x 2 x i8> = G_BITCAST <vscale x 16 x i1> <vscale x 1 x i8> = G_BITCAST <vscale x 8 x i1> <vscale x 2 x i8> = G_INSERT_SUBVECTOR <vscale x 2 x i8>, <vscale x 1 x i8>, N / 8 <vscale x 16 x i1> = G_BITCAST <vscale x 2 x i8>

Definition at line 4079 of file LegalizerHelper.cpp.

References llvm::cast(), llvm::details::FixedOrScalableQuantity< LeafTy, ValueTy >::divideCoefficientBy(), llvm::LLT::getElementCount(), llvm::LLT::getElementType(), llvm::details::FixedOrScalableQuantity< LeafTy, ValueTy >::getKnownMinValue(), llvm::LLT::getSizeInBits(), llvm::LLT::isVector(), Legalized, MI, MIRBuilder, UnableToLegalize, and llvm::LLT::vector().

Referenced by bitcast().

◆ bitcastInsertVectorElt()

Perform Bitcast legalize action on G_INSERT_VECTOR_ELT.

Perform a G_INSERT_VECTOR_ELT in a different sized vector element.

If this is increasing the element size, perform the indexing in the target element type, and use bit operations to insert at the element position. This is intended for architectures that can dynamically index the register file and want to force indexing in the native register size.

Definition at line 3864 of file LegalizerHelper.cpp.

References buildBitFieldInsert(), getBitcastWiderVectorElementOffset(), llvm::LLT::getElementType(), llvm::LLT::getNumElements(), llvm::LLT::getSizeInBits(), llvm::isPowerOf2_32(), llvm::LLT::isVector(), Legalized, llvm::Log2_32(), MI, MIRBuilder, and UnableToLegalize.

Referenced by bitcast().

◆ bitcastShuffleVector()

◆ bitcastSrc()

◆ buildConstantShiftPart()

Generates a single output part for constant shifts using direct indexing.

Calculates which source parts contribute and how they're combined.

Definition at line 6229 of file LegalizerHelper.cpp.

References assert(), llvm::LegalizerHelper::ShiftParams::BitShift, llvm::getIConstantVRegVal(), llvm::Hi, llvm::LegalizerHelper::ShiftParams::InvBitShift, llvm_unreachable, llvm::Lo, MIRBuilder, llvm::LegalizerHelper::ShiftParams::SignBit, llvm::LegalizerHelper::ShiftParams::WordShift, and llvm::LegalizerHelper::ShiftParams::Zero.

Referenced by narrowScalarShiftByConstantMultiway().

◆ buildVariableShiftPart()

◆ coerceToScalar()

◆ createStackStoreLoad()

◆ createStackTemporary()

◆ equalizeVectorShuffleLengths()

Equalize source and destination vector sizes of G_SHUFFLE_VECTOR.

Definition at line 6905 of file LegalizerHelper.cpp.

References llvm::alignTo(), llvm::SmallVectorTemplateCommon< T, typename >::begin(), llvm::copy(), llvm::LLT::fixed_vector(), llvm::LLT::getElementType(), I, Legalized, MI, MIRBuilder, and moreElementsVectorDst().

Referenced by moreElementsVectorShuffle().

◆ fewerElementsBitcast()

Definition at line 5689 of file LegalizerHelper.cpp.

References assert(), llvm::LLT::fixed_vector(), llvm::LLT::getElementType(), llvm::LLT::getSizeInBits(), getUnmergeResults(), Legalized, MI, MIRBuilder, llvm::SmallVectorTemplateBase< T, bool >::push_back(), and UnableToLegalize.

Referenced by fewerElementsVector().

◆ fewerElementsVector()

Legalize a vector instruction by splitting into multiple components, each acting on the same scalar type as the original but with fewer elements.

Definition at line 5511 of file LegalizerHelper.cpp.

References assert(), llvm::cast(), fewerElementsBitcast(), fewerElementsVectorExtractInsertVectorElt(), fewerElementsVectorMerge(), fewerElementsVectorMultiEltType(), fewerElementsVectorPhi(), fewerElementsVectorReductions(), fewerElementsVectorSeqReductions(), fewerElementsVectorShuffle(), fewerElementsVectorUnmergeValues(), llvm::LLT::getNumElements(), GISEL_VECREDUCE_CASES_NONSEQ, llvm::LLT::isVector(), MI, reduceLoadStoreWidth(), and UnableToLegalize.

Referenced by llvm::AMDGPURegisterBankInfo::applyMappingLoad(), and legalizeInstrStep().

◆ fewerElementsVectorExtractInsertVectorElt()

◆ fewerElementsVectorMerge()

Definition at line 5244 of file LegalizerHelper.cpp.

References assert(), llvm::LLT::getNumElements(), llvm::LLT::getScalarType(), llvm::LLT::getSizeInBits(), llvm::LLT::isVector(), Legalized, MI, MIRBuilder, llvm::Offset, llvm::SmallVectorTemplateBase< T, bool >::push_back(), and UnableToLegalize.

Referenced by fewerElementsVector().

◆ fewerElementsVectorMultiEltType()

Handles most opcodes.

Split MI into same instruction on sub-vectors or scalars with NumElts elements (1 for scalar). Supports uneven splits: there can be leftover sub-vector with fewer then NumElts or a leftover scalar. To avoid this use moreElements first and set MI number of elements to multiple of NumElts. Non-vector operands that should be used on all sub-instructions without split are listed in NonVecOpIndices.

Definition at line 5072 of file LegalizerHelper.cpp.

References llvm::append_range(), assert(), broadcastSrcOp(), llvm::extractVectorParts(), hasSameNumEltsOnAllVectorOperands(), I, llvm::is_contained(), Legalized, makeDstOps(), MI, MIRBuilder, llvm::SmallVectorTemplateBase< T, bool >::push_back(), llvm::size(), and Uses.

Referenced by fewerElementsVector().

◆ fewerElementsVectorPhi()

◆ fewerElementsVectorReductions()

Definition at line 5865 of file LegalizerHelper.cpp.

References assert(), llvm::cast(), llvm::SmallVectorImpl< T >::clear(), llvm::SmallVectorImpl< T >::emplace_back(), llvm::extractParts(), llvm::LLT::getNumElements(), getReg(), llvm::isPowerOf2_32(), llvm::LLT::isScalar(), llvm::LLT::isVector(), Legalized, MI, MIRBuilder, llvm::SmallVectorTemplateBase< T, bool >::push_back(), llvm::SmallVectorTemplateCommon< T, typename >::size(), and UnableToLegalize.

Referenced by fewerElementsVector().

◆ fewerElementsVectorSeqReductions()

◆ fewerElementsVectorShuffle()

Definition at line 5725 of file LegalizerHelper.cpp.

References AbstractManglingParser< Derived, Alloc >::Ops, assert(), llvm::LLT::changeElementCount(), llvm::extractParts(), llvm::LLT::getElementType(), llvm::LLT::getNumElements(), llvm::Hi, High, llvm::isPowerOf2_32(), llvm::LLT::isVector(), Legalized, llvm::Lo, MI, MIRBuilder, llvm::SmallVectorTemplateBase< T, bool >::push_back(), llvm::LLT::scalar(), and UnableToLegalize.

Referenced by fewerElementsVector().

◆ fewerElementsVectorUnmergeValues()

◆ getDynStackAllocTargetPtr()

◆ getLegalizerInfo()

◆ getStackTemporaryAlignment()

Align LegalizerHelper::getStackTemporaryAlignment ( LLT Type,
Align MinAlign = Align() ) const

◆ getTargetLowering()

◆ getValueTracking()

◆ getVectorElementPointer()

Get a pointer to vector element Index located in memory for a vector of type VecTy starting at a base address of VecPtr.

If Index is out of bounds the returned pointer is unspecified, but will be within the vector bounds.

Definition at line 4955 of file LegalizerHelper.cpp.

References assert(), llvm::LLT::changeElementSize(), clampVectorIndex(), DL, llvm::LLT::getElementType(), llvm::LLT::getSizeInBits(), MIRBuilder, and llvm::Mul.

Referenced by lowerExtractInsertVectorElt(), lowerVECTOR_COMPRESS(), and llvm::CombinerHelper::matchCombineExtractedVectorLoad().

◆ legalizeInstrStep()

Replace MI by a sequence of legal instructions that can implement the same operation.

Note that this means MI may be deleted, so any iterator steps should be performed before calling this function. Helper should be initialized to the MachineFunction containing MI.

Considered as an opaque blob, the legal code will use and define the same registers as MI.

Definition at line 119 of file LegalizerHelper.cpp.

References AlreadyLegal, llvm::LegalizeActions::Bitcast, bitcast(), llvm::LegalizeActions::Custom, llvm::dbgs(), llvm::LegalizeActions::FewerElements, fewerElementsVector(), llvm::isa(), llvm::IRSimilarity::Legal, Legalized, llvm::LegalizeActions::Libcall, libcall, LLVM_DEBUG, llvm::Lower, lower(), MI, MIRBuilder, llvm::LegalizeActions::MoreElements, moreElementsVector(), llvm::LegalizeActions::NarrowScalar, narrowScalar(), UnableToLegalize, llvm::LegalizeActions::WidenScalar, and widenScalar().

Referenced by llvm::Legalizer::legalizeMachineFunction().

◆ libcall()

Legalize an instruction by emiting a runtime library call instead.

Definition at line 1309 of file LegalizerHelper.cpp.

References conversionLibcall(), createAtomicLibcall(), llvm::createLibcall(), llvm::createMemLibcall(), llvm::dbgs(), llvm::IntegerType::get(), getFloatTypeForLLT(), llvm::Type::getIntNTy(), getRTLibDesc(), llvm::LLT::getSizeInBits(), Legalized, llvm::LegalizeActions::Libcall, LLVM_DEBUG, MI, MIRBuilder, simpleLibcall(), Size, and UnableToLegalize.

◆ lower()

Legalize an instruction by splitting it into simpler parts, hopefully understood by the target.

Definition at line 4515 of file LegalizerHelper.cpp.

References assert(), llvm::cast(), llvm::LLT::getScalarSizeInBits(), llvm::APInt::getSignMask(), GISEL_VECREDUCE_CASES_NONSEQ, llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULT, Legalized, lowerAbsDiffToMinMax(), lowerAbsDiffToSelect(), lowerAbsToAddXor(), lowerAddSubSatToAddoSubo(), lowerAddSubSatToMinMax(), lowerBitcast(), lowerBitCount(), lowerBitreverse(), lowerBswap(), lowerDIVREM(), lowerDynStackAlloc(), lowerEXT(), lowerExtract(), lowerExtractInsertVectorElt(), lowerFAbs(), lowerFConstant(), lowerFCopySign(), lowerFFloor(), lowerFMad(), lowerFMinimumMaximum(), lowerFMinNumMaxNum(), lowerFPOWI(), lowerFPTOINT_SAT(), lowerFPTOSI(), lowerFPTOUI(), lowerFPTRUNC(), lowerFunnelShift(), lowerInsert(), lowerIntrinsicRound(), lowerISFPCLASS(), lowerLoad(), lowerMemCpyFamily(), lowerMergeValues(), lowerMinMax(), lowerReadWriteRegister(), lowerRotate(), lowerSADDE(), lowerSADDO_SSUBO(), lowerSelect(), lowerShlSat(), lowerShuffleVector(), lowerSITOFP(), lowerSMULH_UMULH(), lowerSSUBE(), lowerStackRestore(), lowerStackSave(), lowerStore(), lowerThreewayCompare(), lowerTRUNC(), lowerUITOFP(), lowerUnmergeValues(), lowerVAArg(), lowerVECTOR_COMPRESS(), lowerVectorReduction(), MI, MIRBuilder, Observer, TII, and UnableToLegalize.

Referenced by llvm::RISCVLegalizerInfo::legalizeCustom(), and legalizeInstrStep().

◆ lowerAbsDiffToMinMax()

◆ lowerAbsDiffToSelect()

◆ lowerAbsToAddXor()

◆ lowerAbsToCNeg()

◆ lowerAbsToMaxNeg()

◆ lowerAddSubSatToAddoSubo()

◆ lowerAddSubSatToMinMax()

◆ lowerBitcast()

◆ lowerBitCount()

Definition at line 7602 of file LegalizerHelper.cpp.

References assert(), B(), llvm::LegalizeActions::Custom, llvm::APInt::getSplat(), llvm::CmpInst::ICMP_EQ, llvm::IRSimilarity::Legal, Legalized, llvm::LegalizeActions::Libcall, MI, MIRBuilder, Observer, Opc, llvm::PowerOf2Ceil(), Size, TII, UnableToLegalize, and llvm::LegalizeActions::WidenScalar.

Referenced by lower().

◆ lowerBitreverse()

◆ lowerBswap()

◆ lowerConstant()

◆ lowerDIVREM()

◆ lowerDynStackAlloc()

◆ lowerEXT()

Definition at line 7909 of file LegalizerHelper.cpp.

References llvm::LLT::changeElementCount(), llvm::LLT::changeElementSize(), llvm::details::FixedOrScalableQuantity< LeafTy, ValueTy >::divideCoefficientBy(), llvm::LLT::getElementCount(), llvm::LLT::getScalarSizeInBits(), llvm::LLT::getSizeInBits(), llvm::isPowerOf2_32(), Legalized, MI, MIRBuilder, and UnableToLegalize.

Referenced by lower().

◆ lowerExtract()

◆ lowerExtractInsertVectorElt()

Lower a vector extract or insert by writing the vector to a stack temporary and reloading the element or vector.

dst = G_EXTRACT_VECTOR_ELT vec, idx => stack_temp = G_FRAME_INDEX G_STORE vec, stack_temp idx = clamp(idx, vec.getNumElements()) element_ptr = G_PTR_ADD stack_temp, idx dst = G_LOAD element_ptr

Definition at line 9038 of file LegalizerHelper.cpp.

References llvm::commonAlignment(), createStackTemporary(), llvm::dbgs(), llvm::extractParts(), llvm::LLT::getElementType(), llvm::TypeSize::getFixed(), llvm::LLT::getNumElements(), llvm::LLT::getSizeInBytes(), getStackTemporaryAlignment(), getVectorElementPointer(), llvm::MachinePointerInfo::getWithOffset(), llvm::LLT::isByteSized(), Legalized, LLVM_DEBUG, llvm::MIPatternMatch::m_ICst(), MI, llvm::MIPatternMatch::mi_match(), MIRBuilder, llvm::Offset, and UnableToLegalize.

Referenced by fewerElementsVectorExtractInsertVectorElt(), and lower().

◆ lowerFAbs()

◆ lowerFConstant()

◆ lowerFCopySign()

◆ lowerFFloor()

◆ lowerFMad()

◆ lowerFMinimumMaximum()

Definition at line 8817 of file LegalizerHelper.cpp.

References llvm::LLT::changeElementSize(), llvm::CmpInst::FCMP_OEQ, llvm::CmpInst::FCMP_OGT, llvm::CmpInst::FCMP_OLT, llvm::CmpInst::FCMP_ORD, llvm::fcNegZero, llvm::fcPosZero, llvm::fcZero, llvm::MachineInstr::FmNoNans, llvm::MachineInstr::FmNsz, llvm::getFltSemanticForLLT(), llvm::APFloat::getNaN(), getReg(), llvm::isKnownNeverNaN(), llvm::KnownFPClass::isKnownNeverZero(), llvm::LLT::isScalar(), Legalized, MI, MIRBuilder, and Opc.

Referenced by lower().

◆ lowerFMinNumMaxNum()

◆ lowerFPOWI()

◆ lowerFPTOINT_SAT()

Definition at line 8413 of file LegalizerHelper.cpp.

References llvm::APFloat::convertFromAPInt(), llvm::CmpInst::FCMP_OGT, llvm::CmpInst::FCMP_OLT, llvm::CmpInst::FCMP_ULT, llvm::CmpInst::FCMP_UNO, llvm::MachineInstr::FmNoNans, llvm::getFltSemanticForLLT(), llvm::APInt::getMaxValue(), llvm::APInt::getMinValue(), llvm::APInt::getSignedMaxValue(), llvm::APInt::getSignedMinValue(), Legalized, MI, MIRBuilder, llvm::APFloatBase::opInexact, and llvm::APFloatBase::rmTowardZero.

Referenced by lower().

◆ lowerFPTOSI()

Definition at line 8348 of file LegalizerHelper.cpp.

References llvm::Exponent, llvm::APInt::getSignMask(), llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLT, Legalized, MI, MIRBuilder, S1, S32, S64, llvm::LLT::scalar(), and UnableToLegalize.

Referenced by lower().

◆ lowerFPTOUI()

Definition at line 8308 of file LegalizerHelper.cpp.

References llvm::APFloat::convertFromAPInt(), llvm::CmpInst::FCMP_ULT, llvm::APInt::getSignMask(), llvm::APInt::getZero(), llvm::APFloatBase::IEEEdouble(), llvm::APFloatBase::IEEEsingle(), Legalized, MI, MIRBuilder, llvm::APFloatBase::rmNearestTiesToEven, S1, S32, S64, llvm::LLT::scalar(), and UnableToLegalize.

Referenced by lower().

◆ lowerFPTRUNC()

◆ lowerFPTRUNC_F64_TO_F16()

Definition at line 8514 of file LegalizerHelper.cpp.

References assert(), B(), D(), llvm::MachineInstr::FmAfn, I, llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLT, Legalized, MI, MIRBuilder, N, S1, S32, llvm::LLT::scalar(), and UnableToLegalize.

Referenced by lowerFPTRUNC().

◆ lowerFunnelShift()

◆ lowerFunnelShiftAsShifts()

◆ lowerFunnelShiftWithInverse()

◆ lowerInsert()

Definition at line 9360 of file LegalizerHelper.cpp.

References llvm::dbgs(), DL, llvm::LLT::getAddressSpace(), llvm::APInt::getBitsSetWithWrap(), llvm::LLT::getElementType(), llvm::LLT::getNumElements(), llvm::LLT::getSizeInBits(), llvm::LLT::isPointer(), llvm::LLT::isScalar(), llvm::LLT::isVector(), Legalized, LLVM_DEBUG, MI, MIRBuilder, llvm::Offset, llvm::SmallVectorTemplateBase< T, bool >::push_back(), llvm::LLT::scalar(), and UnableToLegalize.

Referenced by lower().

◆ lowerIntrinsicRound()

◆ lowerISFPCLASS()

Definition at line 9876 of file LegalizerHelper.cpp.

References llvm::APFloat::bitcastToAPInt(), llvm::fcAllFlags, llvm::fcFinite, llvm::fcInf, llvm::fcNan, llvm::fcNegFinite, llvm::fcNegNormal, llvm::fcNegSubnormal, llvm::fcNone, llvm::fcNormal, llvm::fcPosFinite, llvm::fcPosInf, llvm::fcPosNormal, llvm::fcPosSubnormal, llvm::fcPosZero, llvm::fcQNan, llvm::fcSubnormal, llvm::fcZero, llvm::APInt::getActiveBits(), llvm::APInt::getAllOnes(), llvm::getFltSemanticForLLT(), llvm::getImm(), llvm::APFloat::getInf(), llvm::APFloat::getLargest(), llvm::APInt::getOneBitSet(), llvm::APInt::getSignedMaxValue(), llvm::APInt::getSignMask(), llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_UGE, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULT, Legalized, MI, MIRBuilder, llvm::LLT::scalar(), llvm::APInt::shl(), and llvm::LLT::vector().

Referenced by lower().

◆ lowerLoad()

Definition at line 4136 of file LegalizerHelper.cpp.

References assert(), llvm::bit_floor(), llvm::MachineInstr::eraseFromParent(), llvm::LLT::fixed_vector(), llvm::GMemOperation::getAlign(), llvm::Function::getContext(), llvm::GAnyLoad::getDstReg(), llvm::LLT::getElementType(), llvm::MachineFunction::getFunction(), llvm::MachineFunction::getMachineMemOperand(), llvm::MachineMemOperand::getMemoryType(), llvm::GMemOperation::getMMO(), llvm::LLT::getNumElements(), llvm::MachineInstr::getOpcode(), llvm::MachineMemOperand::getPointerInfo(), llvm::GLoadStore::getPointerReg(), llvm::GenericMachineInstr::getReg(), llvm::LLT::getScalarSizeInBits(), llvm::LLT::getSizeInBits(), llvm::LLT::getSizeInBytes(), llvm::isa(), llvm::LLT::isPointer(), llvm::isPowerOf2_32(), llvm::isPowerOf2_64(), llvm::LLT::isVector(), Legalized, MIRBuilder, llvm::NextPowerOf2(), llvm::PowerOf2Ceil(), reduceLoadStoreWidth(), llvm::LLT::scalar(), UnableToLegalize, and llvm::Align::value().

Referenced by lower().

◆ lowerMemCpyFamily()

◆ lowerMemcpyInline()

◆ lowerMergeValues()

Definition at line 8960 of file LegalizerHelper.cpp.

References AbstractManglingParser< Derived, Alloc >::NumOps, llvm::dbgs(), I, Legalized, LLVM_DEBUG, MI, MIRBuilder, llvm::Offset, llvm::LLT::scalar(), and UnableToLegalize.

Referenced by lower().

◆ lowerMinMax()

◆ lowerReadWriteRegister()

◆ lowerRotate()

◆ lowerRotateWithReverseRotate()

◆ lowerSADDE()

◆ lowerSADDO_SSUBO()

◆ lowerSelect()

◆ lowerShlSat()

Definition at line 9673 of file LegalizerHelper.cpp.

References assert(), llvm::LLT::changeElementSize(), llvm::APInt::getMaxValue(), llvm::LLT::getScalarSizeInBits(), llvm::APInt::getSignedMaxValue(), llvm::APInt::getSignedMinValue(), llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_SLT, Legalized, MI, and MIRBuilder.

Referenced by lower().

◆ lowerShuffleVector()

Definition at line 9110 of file LegalizerHelper.cpp.

References assert(), llvm::LLT::getScalarType(), Legalized, MI, MIRBuilder, llvm::SmallVectorTemplateBase< T, bool >::push_back(), llvm::LLT::scalar(), and llvm::DenseMapBase< DerivedT, KeyT, ValueT, KeyInfoT, BucketT >::try_emplace().

Referenced by lower().

◆ lowerSITOFP()

Definition at line 8262 of file LegalizerHelper.cpp.

References llvm::CmpInst::ICMP_NE, Legalized, loweri64tof16ITOFP(), MI, MIRBuilder, S1, S32, S64, llvm::LLT::scalar(), UnableToLegalize, and llvm::Xor.

Referenced by lower().

◆ lowerSMULH_UMULH()

◆ lowerSSUBE()

◆ lowerStackRestore()

◆ lowerStackSave()

◆ lowerStore()

Definition at line 4288 of file LegalizerHelper.cpp.

References llvm::bit_floor(), llvm::MachineInstr::eraseFromParent(), llvm::Function::getContext(), llvm::MachineFunction::getFunction(), llvm::MachineFunction::getMachineMemOperand(), llvm::MachineMemOperand::getMemoryType(), llvm::MachineMemOperand::getPointerInfo(), llvm::GLoadStore::getPointerReg(), llvm::LLT::getSizeInBits(), llvm::LLT::getSizeInBytes(), llvm::GStore::getValueReg(), llvm::isPowerOf2_32(), llvm::LLT::isVector(), Legalized, llvm::MachineInstr::memoperands_begin(), MIRBuilder, llvm::PowerOf2Ceil(), reduceLoadStoreWidth(), llvm::LLT::scalar(), scalarizeVectorBooleanStore(), and UnableToLegalize.

Referenced by lower().

◆ lowerThreewayCompare()

Definition at line 8679 of file LegalizerHelper.cpp.

References llvm::cast(), llvm::LLT::changeElementSize(), llvm::getApproximateEVTForLLT(), llvm::CmpInst::ICMP_SGT, llvm::CmpInst::ICMP_SLT, llvm::CmpInst::ICMP_UGT, llvm::CmpInst::ICMP_ULT, llvm::LLT::isVector(), Legalized, MI, MIRBuilder, std::swap(), llvm::TargetLoweringBase::UndefinedBooleanContent, and llvm::TargetLoweringBase::ZeroOrNegativeOneBooleanContent.

Referenced by lower().

◆ lowerTRUNC()

Definition at line 7951 of file LegalizerHelper.cpp.

References assert(), llvm::LLT::changeElementCount(), llvm::LLT::changeElementSize(), llvm::extractParts(), llvm::LLT::getNumElements(), llvm::LLT::getScalarSizeInBits(), llvm::isPowerOf2_32(), llvm::LLT::isVector(), Legalized, Merge, MI, MIRBuilder, and UnableToLegalize.

Referenced by lower().

◆ lowerU64ToF32BitOps()

Definition at line 8089 of file LegalizerHelper.cpp.

References assert(), llvm::CallingConv::C, llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_NE, llvm::CmpInst::ICMP_UGT, Legalized, MI, MIRBuilder, S1, S32, S64, llvm::LLT::scalar(), llvm::Sub, and T.

◆ lowerU64ToF32WithSITOFP()

◆ lowerU64ToF64BitFloatOps()

◆ lowerUITOFP()

◆ lowerUnmergeValues()

◆ lowerVAArg()

Definition at line 10251 of file LegalizerHelper.cpp.

References A(), DL, llvm::Function::getContext(), llvm::MachineFunction::getFunction(), llvm::MachineFunction::getMachineMemOperand(), llvm::LLT::getSizeInBits(), llvm::getTypeForLLT(), Legalized, llvm::Log2(), MI, MIRBuilder, llvm::MachineMemOperand::MOLoad, llvm::MachineMemOperand::MOStore, and llvm::LLT::scalar().

Referenced by lower().

◆ lowerVECTOR_COMPRESS()

Definition at line 9151 of file LegalizerHelper.cpp.

References createStackTemporary(), llvm::LLT::getElementType(), llvm::TypeSize::getFixed(), llvm::LLT::getNumElements(), llvm::MachineInstrBuilder::getReg(), llvm::LLT::getSizeInBits(), getStackTemporaryAlignment(), llvm::MachinePointerInfo::getUnknownStack(), getVectorElementPointer(), I, llvm::CmpInst::ICMP_UGT, llvm::isConstantOrConstantSplatVector(), Legalized, MI, MIRBuilder, llvm::report_fatal_error(), and llvm::LLT::scalar().

Referenced by lower().

◆ lowerVectorReduction()

◆ moreElementsVector()

Legalize a vector instruction by increasing the number of vector elements involved and ignoring the added elements later.

Definition at line 6638 of file LegalizerHelper.cpp.

References llvm::LLT::changeElementCount(), llvm::LLT::changeElementType(), llvm::LLT::fixed_vector(), llvm::ElementCount::get(), llvm::LLT::getElementCount(), llvm::LLT::getElementType(), llvm::LLT::getNumElements(), llvm::LLT::getScalarType(), llvm::LLT::isScalable(), Legalized, MI, MIRBuilder, moreElementsVectorDst(), moreElementsVectorPhi(), moreElementsVectorShuffle(), moreElementsVectorSrc(), Observer, Opc, llvm::SmallVectorTemplateBase< T, bool >::push_back(), llvm::MachineOperand::setReg(), llvm::SmallVectorTemplateCommon< T, typename >::size(), and UnableToLegalize.

Referenced by legalizeInstrStep().

◆ moreElementsVectorDst()

◆ moreElementsVectorPhi()

◆ moreElementsVectorShuffle()

◆ moreElementsVectorSrc()

◆ narrowScalar()

Legalize an instruction by reducing the width of the underlying scalar type.

Definition at line 1541 of file LegalizerHelper.cpp.

References llvm::MachineInstrBuilder::add(), llvm::MachineInstrBuilder::addUse(), llvm::append_range(), assert(), llvm::SmallVectorTemplateCommon< T, typename >::back(), llvm::CallingConv::C, llvm::cast(), llvm::dbgs(), llvm::SmallVectorTemplateCommon< T, typename >::empty(), llvm::extractParts(), llvm::LLT::getElementCount(), llvm::MachineBasicBlock::getFirstTerminatorForward(), llvm::LLT::getScalarSizeInBits(), llvm::LLT::getSizeInBits(), llvm::MachineMemOperand::getSizeInBits(), llvm::ICmpInst::getUnsignedPredicate(), llvm::LocationSize::getValue(), I, llvm::CmpInst::ICMP_EQ, llvm::isa(), llvm::ICmpInst::isEquality(), llvm::LLT::isVector(), Legalized, LLVM_DEBUG, llvm::APInt::lshr(), MBB, MI, MIRBuilder, narrowScalarAddSub(), narrowScalarBasic(), narrowScalarCTLZ(), narrowScalarCTPOP(), narrowScalarCTTZ(), narrowScalarDst(), narrowScalarExt(), narrowScalarExtract(), narrowScalarFLDEXP(), narrowScalarFPTOI(), narrowScalarInsert(), narrowScalarMul(), narrowScalarSelect(), narrowScalarShift(), narrowScalarSrc(), Observer, llvm::Offset, OpIdx, llvm::SmallVectorTemplateBase< T, bool >::push_back(), reduceLoadStoreWidth(), llvm::LLT::scalar(), llvm::MachineOperand::setReg(), llvm::SmallVectorTemplateCommon< T, typename >::size(), llvm::APInt::trunc(), UnableToLegalize, llvm::LLT::vector(), llvm::Xor, and llvm::zip().

Referenced by llvm::AMDGPURegisterBankInfo::applyMappingImpl(), llvm::MipsRegisterBankInfo::applyMappingImpl(), llvm::AMDGPURegisterBankInfo::applyMappingLoad(), and legalizeInstrStep().

◆ narrowScalarAddSub()

Definition at line 7080 of file LegalizerHelper.cpp.

References llvm::SmallVectorImpl< T >::append(), llvm::ArrayRef(), llvm::extractParts(), Legalized, llvm_unreachable, MI, MIRBuilder, llvm::SmallVectorTemplateBase< T, bool >::push_back(), llvm::SmallVectorImpl< T >::reserve(), llvm::LLT::scalar(), llvm::SmallVectorTemplateCommon< T, typename >::size(), and UnableToLegalize.

Referenced by narrowScalar().

◆ narrowScalarBasic()

Definition at line 7380 of file LegalizerHelper.cpp.

References assert(), llvm::extractParts(), I, Legalized, llvm_unreachable, MI, MIRBuilder, llvm::SmallVectorTemplateBase< T, bool >::push_back(), llvm::SmallVectorTemplateCommon< T, typename >::size(), and UnableToLegalize.

Referenced by narrowScalar().

◆ narrowScalarCTLZ()

◆ narrowScalarCTPOP()

◆ narrowScalarCTTZ()

◆ narrowScalarDst()

◆ narrowScalarExt()

◆ narrowScalarExtract()

Definition at line 7231 of file LegalizerHelper.cpp.

References llvm::extractParts(), llvm::LLT::getSizeInBits(), Legalized, MI, MIRBuilder, llvm::SmallVectorTemplateBase< T, bool >::push_back(), llvm::LLT::scalar(), llvm::SmallVectorTemplateCommon< T, typename >::size(), and UnableToLegalize.

Referenced by narrowScalar().

◆ narrowScalarFLDEXP()

◆ narrowScalarFPTOI()

◆ narrowScalarInsert()

Definition at line 7298 of file LegalizerHelper.cpp.

References llvm::SmallVectorImpl< T >::append(), llvm::extractParts(), llvm::LLT::getSizeInBits(), I, Legalized, MI, MIRBuilder, llvm::SmallVectorTemplateBase< T, bool >::push_back(), llvm::LLT::scalar(), llvm::SmallVectorTemplateCommon< T, typename >::size(), and UnableToLegalize.

Referenced by narrowScalar().

◆ narrowScalarMul()

◆ narrowScalarSelect()

Definition at line 7442 of file LegalizerHelper.cpp.

References llvm::extractParts(), I, llvm::LLT::isVector(), Legalized, llvm_unreachable, MI, MIRBuilder, llvm::SmallVectorTemplateBase< T, bool >::push_back(), Select, llvm::SmallVectorTemplateCommon< T, typename >::size(), and UnableToLegalize.

Referenced by narrowScalar().

◆ narrowScalarShift()

Definition at line 6100 of file LegalizerHelper.cpp.

References llvm::getIConstantVRegValWithLookThrough(), llvm::LLT::getScalarSizeInBits(), llvm::LLT::getSizeInBits(), llvm::Hi, llvm::CmpInst::ICMP_EQ, llvm::CmpInst::ICMP_ULT, llvm::LLT::isScalar(), llvm::LLT::isValid(), llvm::LLT::isVector(), Legalized, llvm_unreachable, llvm::Lo, MI, MIRBuilder, narrowScalarShiftByConstant(), narrowScalarShiftMultiway(), narrowScalarSrc(), Observer, llvm::LLT::scalar(), and UnableToLegalize.

Referenced by narrowScalar().

◆ narrowScalarShiftByConstant()

◆ narrowScalarShiftByConstantMultiway()

Optimized path for constant shift amounts using static indexing.

Directly calculates which source parts contribute to each output part without generating runtime select chains.

Definition at line 6369 of file LegalizerHelper.cpp.

References assert(), llvm::LegalizerHelper::ShiftParams::BitShift, buildConstantShiftPart(), llvm::extractParts(), llvm::LLT::getScalarSizeInBits(), llvm::APInt::getZExtValue(), I, llvm::LegalizerHelper::ShiftParams::InvBitShift, llvm::APInt::isZero(), Legalized, MI, MIRBuilder, llvm::LegalizerHelper::ShiftParams::SignBit, llvm::SmallVectorTemplateCommon< T, typename >::size(), llvm::LegalizerHelper::ShiftParams::WordShift, and llvm::LegalizerHelper::ShiftParams::Zero.

Referenced by narrowScalarShiftMultiway().

◆ narrowScalarShiftMultiway()

Multi-way shift legalization: directly split wide shifts into target-sized parts in a single step, avoiding recursive binary splitting.

Definition at line 6429 of file LegalizerHelper.cpp.

References assert(), buildVariableShiftPart(), llvm::extractParts(), llvm::getIConstantVRegValWithLookThrough(), llvm::LLT::getScalarSizeInBits(), I, llvm::CmpInst::ICMP_EQ, llvm::isPowerOf2_32(), Legalized, llvm_unreachable, llvm::Log2_32(), MI, MIRBuilder, narrowScalarShiftByConstantMultiway(), and llvm::LLT::scalar().

Referenced by narrowScalarShift().

◆ narrowScalarSrc()

◆ reduceLoadStoreWidth()

Definition at line 5410 of file LegalizerHelper.cpp.

References llvm::dbgs(), llvm::MachineInstr::eraseFromParent(), llvm::extractParts(), llvm::MachineFunction::getMachineMemOperand(), llvm::GMemOperation::getMemSize(), llvm::GMemOperation::getMMO(), getNarrowTypeBreakDown(), llvm::GLoadStore::getPointerReg(), llvm::GenericMachineInstr::getReg(), llvm::LLT::getSizeInBits(), llvm::LocationSize::getValue(), llvm::isa(), llvm::GMemOperation::isAtomic(), isBigEndian(), llvm::LLT::isByteSized(), llvm::LLT::isValid(), Legalized, LLVM_DEBUG, MIRBuilder, llvm::Offset, llvm::LLT::scalar(), llvm::SmallVectorTemplateCommon< T, typename >::size(), and UnableToLegalize.

Referenced by llvm::AMDGPURegisterBankInfo::applyMappingLoad(), fewerElementsVector(), lowerLoad(), lowerStore(), and narrowScalar().

◆ scalarizeVectorBooleanStore()

LegalizerHelper::LegalizeResult LegalizerHelper::scalarizeVectorBooleanStore ( GStore & MI )

Given a store of a boolean vector, scalarize it.

Definition at line 4383 of file LegalizerHelper.cpp.

References assert(), llvm::MachineInstr::eraseFromParent(), llvm::MachineFunction::getDataLayout(), llvm::LLT::getElementType(), llvm::MachineFunction::getMachineMemOperand(), llvm::MachineMemOperand::getMemoryType(), llvm::LLT::getNumElements(), llvm::MachineMemOperand::getPointerInfo(), llvm::GLoadStore::getPointerReg(), llvm::LLT::getSizeInBits(), llvm::GStore::getValueReg(), I, llvm::DataLayout::isBigEndian(), llvm::LLT::isByteSized(), Legalized, llvm::MachineInstr::memoperands_begin(), MIRBuilder, llvm::LLT::scalar(), and UnableToLegalize.

Referenced by lowerStore().

◆ widenScalar()

Legalize an instruction by performing the operation on a wider scalar type (for example a 16-bit addition can be safely performed at 32-bits precision, ignoring the unused bits).

Definition at line 2731 of file LegalizerHelper.cpp.

References assert(), llvm::APFloat::bitcastToAPInt(), llvm::cast(), llvm::LLT::changeElementType(), llvm::APInt::getAllOnes(), llvm::getApproximateEVTForLLT(), llvm::GInsertSubvector::getBigVec(), llvm::MachineOperand::getCImm(), llvm::LLT::getElementCount(), llvm::LLT::getElementType(), llvm::MachineBasicBlock::getFirstTerminatorForward(), llvm::MachineOperand::getFPImm(), llvm::GInsertSubvector::getIndexImm(), llvm::MachineFunction::getMachineMemOperand(), llvm::APInt::getOneBitSet(), llvm::MachineMemOperand::getPointerInfo(), llvm::GenericMachineInstr::getReg(), llvm::LLT::getScalarSizeInBits(), llvm::LLT::getScalarType(), llvm::APInt::getSignedMaxValue(), llvm::APInt::getSignedMinValue(), llvm::LLT::getSizeInBits(), llvm::GInsertSubvector::getSubVec(), llvm::ConstantInt::getValue(), llvm::ConstantFP::getValueAPF(), I, llvm::CmpInst::ICMP_NE, llvm::CmpInst::isSigned(), llvm::LLT::isVector(), Legalized, MBB, MI, MIRBuilder, Observer, llvm::MachineOperand::setCImm(), llvm::APInt::sext(), UnableToLegalize, llvm::LLT::vector(), widenScalarDst(), widenScalarSrc(), and llvm::APInt::zext().

Referenced by llvm::AMDGPURegisterBankInfo::applyMappingImpl(), and legalizeInstrStep().

◆ widenScalarDst()

◆ widenScalarSrc()

◆ MIRBuilder

Expose MIRBuilder so clients can set their own RecordInsertInstruction functions.

Definition at line 53 of file LegalizerHelper.h.

Referenced by bitcastDst(), bitcastExtractSubvector(), bitcastExtractVectorElt(), bitcastInsertSubvector(), bitcastInsertVectorElt(), bitcastShuffleVector(), bitcastSrc(), buildConstantShiftPart(), llvm::AMDGPULegalizerInfo::buildMultiply(), buildVariableShiftPart(), coerceToScalar(), convertPtrToInt(), createStackStoreLoad(), createStackTemporary(), equalizeVectorShuffleLengths(), fewerElementsBitcast(), fewerElementsVectorExtractInsertVectorElt(), fewerElementsVectorMerge(), fewerElementsVectorMultiEltType(), fewerElementsVectorPhi(), fewerElementsVectorReductions(), fewerElementsVectorSeqReductions(), fewerElementsVectorShuffle(), fewerElementsVectorUnmergeValues(), getDynStackAllocTargetPtr(), getVectorElementPointer(), llvm::AMDGPULegalizerInfo::legalizeBufferLoad(), llvm::AMDGPULegalizerInfo::legalizeBufferStore(), llvm::AArch64LegalizerInfo::legalizeCustom(), llvm::AMDGPULegalizerInfo::legalizeCustom(), llvm::ARMLegalizerInfo::legalizeCustom(), llvm::MipsLegalizerInfo::legalizeCustom(), llvm::RISCVLegalizerInfo::legalizeCustom(), llvm::SPIRVLegalizerInfo::legalizeCustom(), llvm::X86LegalizerInfo::legalizeCustom(), legalizeExtractVectorElt(), legalizeInstrStep(), llvm::AArch64LegalizerInfo::legalizeIntrinsic(), llvm::AMDGPULegalizerInfo::legalizeIntrinsic(), llvm::MipsLegalizerInfo::legalizeIntrinsic(), llvm::RISCVLegalizerInfo::legalizeIntrinsic(), llvm::SPIRVLegalizerInfo::legalizeIntrinsic(), llvm::AMDGPULegalizerInfo::legalizeLaneOp(), llvm::AMDGPULegalizerInfo::legalizeLoad(), llvm::Legalizer::legalizeMachineFunction(), llvm::AMDGPULegalizerInfo::legalizeMinNumMaxNum(), llvm::AMDGPULegalizerInfo::legalizeMul(), LegalizerHelper(), LegalizerHelper(), llvm::AMDGPULegalizerInfo::legalizeSBufferLoad(), llvm::AMDGPULegalizerInfo::legalizeSBufferPrefetch(), llvm::AMDGPULegalizerInfo::legalizeStore(), libcall(), lower(), lowerAbsDiffToMinMax(), lowerAbsDiffToSelect(), lowerAbsToAddXor(), lowerAbsToCNeg(), lowerAbsToMaxNeg(), lowerAddSubSatToAddoSubo(), lowerAddSubSatToMinMax(), lowerBitcast(), lowerBitCount(), lowerBitreverse(), lowerBswap(), lowerConstant(), lowerDIVREM(), lowerDynStackAlloc(), lowerEXT(), lowerExtract(), lowerExtractInsertVectorElt(), lowerFAbs(), lowerFConstant(), lowerFCopySign(), lowerFFloor(), lowerFMad(), lowerFMinimumMaximum(), lowerFMinNumMaxNum(), lowerFPOWI(), lowerFPTOINT_SAT(), lowerFPTOSI(), lowerFPTOUI(), lowerFPTRUNC_F64_TO_F16(), lowerFunnelShiftAsShifts(), lowerFunnelShiftWithInverse(), lowerInsert(), lowerIntrinsicRound(), lowerISFPCLASS(), lowerLoad(), lowerMergeValues(), lowerMinMax(), lowerReadWriteRegister(), lowerRotate(), lowerRotateWithReverseRotate(), lowerSADDE(), lowerSADDO_SSUBO(), lowerSelect(), lowerShlSat(), lowerShuffleVector(), lowerSITOFP(), lowerSMULH_UMULH(), lowerSSUBE(), lowerStackRestore(), lowerStackSave(), lowerStore(), lowerThreewayCompare(), lowerTRUNC(), lowerU64ToF32BitOps(), lowerU64ToF32WithSITOFP(), lowerU64ToF64BitFloatOps(), lowerUITOFP(), lowerUnmergeValues(), lowerVAArg(), lowerVECTOR_COMPRESS(), lowerVectorReduction(), moreElementsVector(), moreElementsVectorDst(), moreElementsVectorPhi(), moreElementsVectorShuffle(), moreElementsVectorSrc(), narrowScalar(), narrowScalarAddSub(), narrowScalarBasic(), narrowScalarCTLZ(), narrowScalarCTPOP(), narrowScalarCTTZ(), narrowScalarDst(), narrowScalarExtract(), narrowScalarFLDEXP(), narrowScalarInsert(), narrowScalarMul(), narrowScalarSelect(), narrowScalarShift(), narrowScalarShiftByConstant(), narrowScalarShiftByConstantMultiway(), narrowScalarShiftMultiway(), narrowScalarSrc(), reduceLoadStoreWidth(), scalarizeVectorBooleanStore(), widenScalar(), widenScalarDst(), and widenScalarSrc().

◆ Observer

To keep track of changes made by the LegalizerHelper.

Definition at line 56 of file LegalizerHelper.h.

Referenced by bitcast(), llvm::AMDGPULegalizerInfo::legalizeBufferLoad(), llvm::AArch64LegalizerInfo::legalizeCustom(), llvm::RISCVLegalizerInfo::legalizeCustom(), llvm::AArch64LegalizerInfo::legalizeIntrinsic(), llvm::AMDGPULegalizerInfo::legalizeIntrinsic(), llvm::RISCVLegalizerInfo::legalizeIntrinsic(), llvm::AMDGPULegalizerInfo::legalizeLoad(), LegalizerHelper(), LegalizerHelper(), llvm::AMDGPULegalizerInfo::legalizeSBufferLoad(), llvm::AMDGPULegalizerInfo::legalizeSBufferPrefetch(), llvm::AMDGPULegalizerInfo::legalizeStore(), lower(), lowerBitCount(), lowerVectorReduction(), moreElementsVector(), moreElementsVectorPhi(), narrowScalar(), narrowScalarFLDEXP(), narrowScalarFPTOI(), narrowScalarShift(), and widenScalar().

The documentation for this class was generated from the following files: