nki.language.tile_size — AWS Neuron Documentation (original) (raw)
This document is relevant for: Inf2, Trn1, Trn2
nki.language.tile_size#
class nki.language.tile_size[source]#
Tile size constants.
Attributes
| bn_stats_fmax | Maximum free dimension of BN_STATS |
|---|---|
| gemm_moving_fmax | Maximum free dimension of the moving operand of General Matrix Multiplication on Tensor Engine. |
| gemm_stationary_fmax | Maximum free dimension of the stationary operand of General Matrix Multiplication on Tensor Engine. |
| pmax | Maximum partition dimension of a tile. |
| psum_fmax | Maximum free dimension of a tile on PSUM buffer. |
| psum_min_align | The minimum byte alignment requirement for PSUM free dimension address. |
| sbuf_min_align | The minimum byte alignment requirement for SBUF free dimension address. |
This document is relevant for: Inf2, Trn1, Trn2