FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness (original) (raw)

Details

• DOI: https://doi.org/10.52202/068431-1189
• Author(s): Tri Dao, Stefano Ermon, Dan Fu, Christopher Ré, Atri Rudra
• Pages: 16344-16359 (16 pages)
• Format: PDF Paper Download
• Conference: Advances in Neural Information Processing Systems 35
• Date/Location: Held 28 November - 9 December 2022, New Orleans, Louisiana, USA.
• Series: Advances in Neural Information Processing Systems 35
• Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)

Description

Members/Attendees

Tab 4

• Details

• Description

• Members/Attendees

• Tab 4

• DOI: https://doi.org/10.52202/068431-1189

• Author(s): Tri Dao, Stefano Ermon, Dan Fu, Christopher Ré, Atri Rudra

• Pages: 16344-16359 (16 pages)

• Format: PDF Paper Download

• Conference: Advances in Neural Information Processing Systems 35

• Date/Location: Held 28 November - 9 December 2022, New Orleans, Louisiana, USA.

• Series: Advances in Neural Information Processing Systems 35

• Publisher: Neural Information Processing Systems Foundation, Inc. (NeurIPS)