LLVM: llvm::InterleavedAccessInfo Class Reference (original) (raw)

Drive the analysis of interleaved memory accesses in the loop. More...

#include "[llvm/Analysis/VectorUtils.h](VectorUtils%5F8h%5Fsource.html)"

Public Member Functions
InterleavedAccessInfo (PredicatedScalarEvolution &PSE, Loop *L, DominatorTree *DT, LoopInfo *LI, const LoopAccessInfo *LAI)
~InterleavedAccessInfo ()
LLVM_ABI void analyzeInterleaving (bool EnableMaskedInterleavedGroup)
Analyze the interleaved accesses and collect them in interleave groups.
bool invalidateGroups ()
Invalidate groups, e.g., in case all blocks in loop will be predicated contrary to original assumption.
bool isInterleaved (Instruction *Instr) const
Check if Instr belongs to any interleave group.
InterleaveGroup< Instruction > * getInterleaveGroup (const Instruction *Instr) const
Get the interleave group that Instr belongs to.
iterator_range< SmallPtrSetIterator< llvm::InterleaveGroup< Instruction > * > > getInterleaveGroups ()
bool requiresScalarEpilogue () const
Returns true if an interleaved group that may access memory out-of-bounds requires a scalar epilogue iteration for correctness.
LLVM_ABI void invalidateGroupsRequiringScalarEpilogue ()
Invalidate groups that require a scalar epilogue (due to gaps).
bool hasGroups () const
Returns true if we have any interleave groups.

Drive the analysis of interleaved memory accesses in the loop.

Use this class to analyze interleaved accesses only when we can vectorize a loop. Otherwise it's meaningless to do analysis as the vectorization on interleaved accesses is unsafe.

The analysis collects interleave groups and records the relationships between the member and the group in a map.

Definition at line 669 of file VectorUtils.h.

◆ ~InterleavedAccessInfo()

llvm::InterleavedAccessInfo::~InterleavedAccessInfo ( ) inline

◆ analyzeInterleaving()

void InterleavedAccessInfo::analyzeInterleaving ( bool EnableMaskedInterleavedGroup )

Analyze the interleaved accesses and collect them in interleave groups.

Substitute symbolic strides using Strides. Consider also predicated loads/stores in the analysis if EnableMaskedInterleavedGroup is true.

Definition at line 1436 of file VectorUtils.cpp.

References A(), assert(), B(), llvm::SetVector< T, Vector, Set, N >::contains(), llvm::SmallPtrSetImpl< PtrType >::contains(), llvm::dbgs(), llvm::dyn_cast(), llvm::MapVector< KeyT, ValueT, MapType, VectorType >::empty(), llvm::MapVector< KeyT, ValueT, MapType, VectorType >::find(), llvm::SCEVConstant::getAPInt(), llvm::InterleaveGroup< InstTy >::getFactor(), llvm::InterleaveGroup< InstTy >::getIndex(), getInterleaveGroup(), llvm::getLoadStoreAddressSpace(), llvm::getLoadStorePointerOperand(), llvm::getLoadStoreType(), llvm::InterleaveGroup< InstTy >::getMember(), llvm::getPtrStride(), llvm::APInt::getSExtValue(), llvm::SetVector< T, Vector, Set, N >::insert(), llvm::SmallPtrSetImpl< PtrType >::insert(), llvm::InterleaveGroup< InstTy >::insertMember(), llvm::InterleaveGroup< InstTy >::isFull(), isInterleaved(), llvm::InterleaveGroup< InstTy >::isReverse(), LLVM_DEBUG, llvm::MapVector< KeyT, ValueT, MapType, VectorType >::rbegin(), llvm::SetVector< T, Vector, Set, N >::remove(), llvm::MapVector< KeyT, ValueT, MapType, VectorType >::rend(), and llvm::InterleaveGroup< InstTy >::setInsertPos().

Referenced by llvm::LoopVectorizePass::processLoop().

◆ getInterleaveGroup()

◆ getInterleaveGroups()

◆ hasGroups()

bool llvm::InterleavedAccessInfo::hasGroups ( ) const inline

◆ invalidateGroups()

bool llvm::InterleavedAccessInfo::invalidateGroups ( ) inline

Invalidate groups, e.g., in case all blocks in loop will be predicated contrary to original assumption.

Although we currently prevent group formation for predicated accesses, we may be able to relax this limitation in the future once we handle more complicated blocks. Returns true if any groups were invalidated.

Definition at line 689 of file VectorUtils.h.

References assert().

Referenced by ~InterleavedAccessInfo().

◆ invalidateGroupsRequiringScalarEpilogue()

void InterleavedAccessInfo::invalidateGroupsRequiringScalarEpilogue ( )

◆ isInterleaved()

bool llvm::InterleavedAccessInfo::isInterleaved ( Instruction * Instr) const inline

◆ requiresScalarEpilogue()

bool llvm::InterleavedAccessInfo::requiresScalarEpilogue ( ) const inline

The documentation for this class was generated from the following files: