NKI Tutorials — AWS Neuron Documentation (original) (raw)

• Repository

• Suggest edit

• Open issue

• .rst

This document is relevant for: Inf2, Trn1, Trn2

NKI Tutorials#

The full source code of the following tutorials can be also viewed on thenki-samples repository on GitHub.

• SPMD Tensor addition
• SPMD Tensor addition with multiple Neuron Cores
• Transpose2D
• AveragePool2D
• Matrix multiplication
• RMSNorm
• Fused Self Attention
• LayerNorm
• Fused Mamba

This document is relevant for: Inf2, Trn1, Trn2