SDPBackend — PyTorch 2.7 documentation (original) (raw)

class torch.nn.attention.SDPBackend¶

An enum-like class that contains the different backends for scaled dot product attention. This backend class is designed to be used with the sdpa_kernel context manager.

The following Enums are available:

• ERROR: An error occurred when trying to determine the backend.
• MATH: The math backend for scaled dot product attention.
• FLASH_ATTENTION: The flash attention backend for scaled dot product attention.
• EFFICIENT_ATTENTION: The efficient attention backend for scaled dot product attention.
• CUDNN_ATTENTION: The cuDNN backend for scaled dot product attention.

See torch.nn.attention.sdpa_kernel() for more details.

Warning

This class is in beta and subject to change.

property name¶