Previous Releases Artifacts (Neuron 2.x) — AWS Neuron Documentation (original) (raw)
Previous Releases Artifacts (Neuron 2.x)#
Table of contents
- Neuron 2.22.0 (04/03/2025)
- Neuron 2.21.0 (10/25/2024)
- Neuron 2.20.2 (11/20/2024)
- Neuron 2.20.1 (10/25/2024)
- Neuron 2.20.0 (09/16/2024)
- Neuron 2.19.1 (07/19/2024)
- Neuron 2.19.0 (07/03/2024)
- Neuron 2.18.2 (04/25/2024)
- Neuron 2.18.1 (04/10/2024)
- Neuron 2.18.0 (04/01/2024)
- Neuron 2.17.0 (02/13/2024)
- Neuron 2.16.1 (01/18/2024)
- Neuron 2.16.0 (12/21/2023)
- Neuron 2.15.2 (11/17/2023)
- Neuron 2.15.1 (11/09/2023)
- Neuron 2.15.0 (10/26/2023)
- Neuron 2.14.1 (09/26/2023)
- Neuron 2.14.0 (09/15/2023)
- Neuron 2.13.2 (09/01/2023)
- Neuron 2.13.1 (08/29/2023)
- Neuron 2.13.0 (08/28/2023)
- Neuron 2.12.2 (08/20/2023)
- Neuron 2.12.1 (08/09/2023)
- Neuron 2.12.0 (07/19/2023)
- Neuron 2.11.0 (06/14/2023)
- Neuron 2.10.0 (05/01/2023)
- Neuron 2.9.1 (04/19/2023)
- Neuron 2.9.0 (03/28/2023)
- Neuron 2.8.0 (02/24/2023)
- Neuron 2.7.0 (02/08/2023)
- Neuron 2.6.0 (12/12/2022)
- Neuron 2.5.0 (11/23/2022)
- Neuron 2.4.0 (10/27/2022)
- Neuron 2.3.0 (10/10/2022)
Neuron 2.22.0 (04/03/2025)#
Trn1 packages#
List of packages in Neuron 2.22.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.24.59.0
Driver aws-neuronx-dkms-2.20.28.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.14.12.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.14.6.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.24.23.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.24.23.0
OCI aws-neuronx-oci-hook-2.7.5.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.24.53.0
System Tools aws-neuronx-tools-2.22.61.0
Jax jax_neuronx-0.1.3
Framework libneuronxla-2.2.1630.0
Framework libneuronxla-0.5.3396
Compiler neuronx-cc-2.17.194.0
Compiler neuronx-cc-stubs-2.17.194.0
Neuron Distributed neuronx_distributed-0.11.0
Neuron Distributed Training neuronx_distributed_training-1.2.0
TensorBoard tensorboard-plugin-neuronx-2.6.117.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.2.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-2.5.1.2.6.0
PyTorch torch_xla-2.1.6
Transformers Neuron transformers-neuronx-0.13.470
Trn2 packages#
List of packages in Neuron 2.22.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.24.59.0
Driver aws-neuronx-dkms-2.20.28.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.14.12.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.14.6.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.24.23.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.24.23.0
OCI aws-neuronx-oci-hook-2.7.5.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.24.53.0
System Tools aws-neuronx-tools-2.22.61.0
Compiler neuronx-cc-2.17.194.0
Compiler neuronx-cc-stubs-2.17.194.0
Neuron Distributed neuronx_distributed-0.11.0
Neuron Distributed Inference neuronx_distributed_inference-0.2.0
PyTorch torch-neuronx-2.5.1.2.6.0
PyTorch torch_xla-2.1.6
Inf2 packages#
List of packages in Neuron 2.22.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.24.59.0
Driver aws-neuronx-dkms-2.20.28.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.14.12.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.14.6.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.24.23.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.24.23.0
OCI aws-neuronx-oci-hook-2.7.5.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.24.53.0
System Tools aws-neuronx-tools-2.22.61.0
Jax jax_neuronx-0.1.3
Framework libneuronxla-2.2.1630.0
Framework libneuronxla-0.5.3396
Compiler neuronx-cc-2.17.194.0
Compiler neuronx-cc-stubs-2.17.194.0
Neuron Distributed neuronx_distributed-0.11.0
Neuron Distributed Inference neuronx_distributed_inference-0.2.0
TensorBoard tensorboard-plugin-neuronx-2.6.117.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.2.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-2.5.1.2.6.0
PyTorch torch_xla-2.1.6
Transformers Neuron transformers-neuronx-0.13.470
Inf1 packages#
List of packages in Neuron 2.22.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.24.59.0
Driver aws-neuronx-dkms-2.20.28.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.24.23.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.24.23.0
OCI aws-neuronx-oci-hook-2.7.5.0
Runtime Library aws-neuronx-runtime-lib-2.24.53.0
System Tools aws-neuronx-tools-2.22.61.0
Compiler dmlc_nnvm-1.19.6.0
Compiler dmlc_topi-1.19.6.0
Compiler dmlc_tvm-1.19.6.0
Compiler inferentia_hwm-1.17.6.0
MXNet mx_neuron-1.8.0.2.4.147.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.24.0.0
Perf Tools neuronperf-1.8.93.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.2.0
TensorFlow tensorflow-neuron-2.10.1.2.12.2.0
TensorFlow tensorflow-neuron-2.8.4.2.12.2.0
TensorFlow tensorflow-neuron-2.9.3.2.12.2.0
PyTorch torch-neuron-1.13.1.2.11.13.0
Supported Python Versions for Inf1 packages#
List of packages in Neuron 2.22.0:
Package Supported Python Versions
dmlc_nnvm-1.19.6.0 3.9, 3.10
dmlc_topi-1.19.6.0 3.9, 3.10
dmlc_tvm-1.19.6.0 3.9, 3.10
inferentia_hwm-1.17.6.0 3.9, 3.10
mx_neuron-1.8.0.2.4.147.0 3.9, 3.10
mxnet_neuron-1.5.1.1.10.0.0 3.9, 3.10
neuron-cc-1.24.0.0 3.9, 3.10
neuronperf-1.8.93.0 3.9, 3.10
tensorflow-neuron-2.10.1.2.12.2.0 3.9, 3.10
tensorflow-neuron-2.8.4.2.12.2.0 3.9, 3.10
tensorflow-neuron-2.9.3.2.12.2.0 3.9, 3.10
torch-neuron-1.13.1.2.11.13.0 3.9, 3.10
Supported Python Versions for Inf2/Trn1/Trn2 packages#
List of packages in Neuron 2.22.0:
Package Supported Python Versions
aws-neuronx-runtime-discovery-2.9 3.9, 3.10, 3.11
jax_neuronx-0.1.3 3.9
libneuronxla-2.2.1630.0 3.9, 3.10, 3.11
libneuronxla-0.5.3396 3.9, 3.10
neuronx-cc-2.17.194.0 3.9, 3.10, 3.11
neuronx-cc-stubs-2.17.194.0 3.9, 3.10
neuronx_distributed-0.11.0 3.9, 3.10, 3.11
neuronx_distributed_inference-0.2.0 3.9, 3.10, 3.11
tensorflow-neuronx-2.10.1.2.1.0 3.9, 3.10
tensorflow-neuronx-2.8.4.2.1.0 3.9, 3.10
tensorflow-neuronx-2.9.3.2.1.0 3.9, 3.10
torch-neuronx-2.5.1.2.6.0 3.9, 3.10, 3.11
torch_xla-2.1.6 3.9, 3.10, 3.11
transformers-neuronx-0.13.470 3.9, 3.10, 3.11
Supported Numpy Versions#
Neuron supports versions >= 1.21.6 and <= 1.22.2
Supported HuggingFace Transformers Versions#
| Package | Supported HuggingFace Transformers Versions |
|---|---|
| torch-neuronx | < 4.35 and >=4.37.2 |
| transformers-neuronx | >= 4.36.0 |
| neuronx-distributed - Llama model class | 4.31 |
| neuronx-distributed - GPT NeoX model class | 4.26 |
| neuronx-distributed - Bert model class | 4.26 |
| nemo-megatron | 4.31.0 |
Supported Probuf Versions#
| Package | Supported Probuf versions |
|---|---|
| neuronx-cc | > 3 |
| torch-neuronx | >= 3.20 |
| torch-neuron | < 3.20 |
| transformers-neuronx | >= 3.20 |
| neuronx-distributed | >= 3.20 |
| tensorflow-neuronx | < 3.20 |
| tensorflow-neuron | < 3.20 |
Neuron 2.21.0 (10/25/2024)#
Trn1 packages#
List of packages in Neuron 2.21.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.23.133.0
Driver aws-neuronx-dkms-2.19.64.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.13.16.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.13.2.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.23.30.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.23.30.0
OCI aws-neuronx-oci-hook-2.6.36.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.23.110.0
System Tools aws-neuronx-tools-2.20.204.0
Jax jax_neuronx-0.1.2
Framework libneuronxla-2.1.681.0
Framework libneuronxla-0.5.3388
Compiler neuronx-cc-2.16.345.0
Compiler neuronx-cc-stubs-2.16.345.0
Neuron Distributed neuronx_distributed-0.10.0
Neuron Distributed Training neuronx_distributed_training-1.1.0
TensorBoard tensorboard-plugin-neuronx-2.6.52.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.2.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.17.0
PyTorch torch-neuronx-2.1.2.2.4.0
PyTorch torch-neuronx-2.5.1.2.4.0
PyTorch torch_xla-1.13.1+torchneurong
PyTorch torch_xla-2.1.6
Transformers Neuron transformers-neuronx-0.13.322
Trn2 packages#
List of packages in Neuron 2.21.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.23.133.0
Driver aws-neuronx-dkms-2.19.64.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.13.16.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.13.2.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.23.30.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.23.30.0
OCI aws-neuronx-oci-hook-2.6.36.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.23.110.0
System Tools aws-neuronx-tools-2.20.204.0
Compiler neuronx-cc-2.16.345.0
Compiler neuronx-cc-stubs-2.16.345.0
Neuron Distributed neuronx_distributed-0.10.0
Neuron Distributed Inference neuronx_distributed_inference-0.1.0
PyTorch torch-neuronx-2.1.2.2.4.0
PyTorch torch-neuronx-2.5.1.2.4.0
PyTorch torch_xla-2.1.6
Inf2 packages#
List of packages in Neuron 2.21.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.23.133.0
Driver aws-neuronx-dkms-2.19.64.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.13.16.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.13.2.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.23.30.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.23.30.0
OCI aws-neuronx-oci-hook-2.6.36.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.23.110.0
System Tools aws-neuronx-tools-2.20.204.0
Jax jax_neuronx-0.1.2
Framework libneuronxla-2.1.681.0
Framework libneuronxla-0.5.3388
Compiler neuronx-cc-2.16.345.0
Compiler neuronx-cc-stubs-2.16.345.0
Neuron Distributed neuronx_distributed-0.10.0
Neuron Distributed Inference neuronx_distributed_inference-0.1.0
TensorBoard tensorboard-plugin-neuronx-2.6.52.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.2.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.17.0
PyTorch torch-neuronx-2.1.2.2.4.0
PyTorch torch-neuronx-2.5.1.2.4.0
PyTorch torch_xla-1.13.1+torchneurong
PyTorch torch_xla-2.1.6
Transformers Neuron transformers-neuronx-0.13.322
Inf1 packages#
List of packages in Neuron 2.21.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.12.35.0
Driver aws-neuronx-dkms-2.19.64.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.23.30.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.23.30.0
OCI aws-neuronx-oci-hook-2.6.36.0
Runtime Library aws-neuronx-runtime-lib-2.12.23.0
System Tools aws-neuronx-tools-2.20.204.0
Compiler dmlc_nnvm-1.19.6.0
Compiler dmlc_topi-1.19.6.0
Compiler dmlc_tvm-1.19.6.0
Compiler inferentia_hwm-1.17.6.0
MXNet mx_neuron-1.8.0.2.4.147.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.24.0.0
Perf Tools neuronperf-1.8.93.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.2.0
TensorFlow tensorflow-neuron-2.10.1.2.12.2.0
TensorFlow tensorflow-neuron-2.8.4.2.12.2.0
TensorFlow tensorflow-neuron-2.9.3.2.12.2.0
PyTorch torch-neuron-1.10.2.2.11.13.0
PyTorch torch-neuron-1.11.0.2.11.13.0
PyTorch torch-neuron-1.12.1.2.11.13.0
PyTorch torch-neuron-1.13.1.2.11.13.0
Supported Python Versions for Inf1 packages#
List of packages in Neuron 2.21.0:
Package Supported Python Versions
dmlc_nnvm-1.19.6.0 3.8, 3.9, 3.10
dmlc_topi-1.19.6.0 3.8, 3.9, 3.10
dmlc_tvm-1.19.6.0 3.8, 3.9, 3.10
inferentia_hwm-1.17.6.0 3.8, 3.9, 3.10
mx_neuron-1.8.0.2.4.147.0 3.8, 3.9, 3.10
mxnet_neuron-1.5.1.1.10.0.0 3.8, 3.9, 3.10
neuron-cc-1.24.0.0 3.8, 3.9, 3.10
neuronperf-1.8.93.0 3.8, 3.9, 3.10
tensorflow-neuron-2.10.1.2.12.2.0 3.8, 3.9, 3.10
tensorflow-neuron-2.8.4.2.12.2.0 3.8, 3.9, 3.10
tensorflow-neuron-2.9.3.2.12.2.0 3.8, 3.9, 3.10
torch-neuron-1.10.2.2.11.13.0 3.8, 3.9, 3.10
torch-neuron-1.11.0.2.11.13.0 3.8, 3.9, 3.10
torch-neuron-1.12.1.2.11.13.0 3.8, 3.9, 3.10
torch-neuron-1.13.1.2.11.13.0 3.8, 3.9, 3.10
Supported Python Versions for Inf2/Trn1/Trn2 packages#
List of packages in Neuron 2.21.0:
Package Supported Python Versions
aws-neuronx-runtime-discovery-2.9 3.8, 3.9, 3.10, 3.11
jax_neuronx-0.1.2 3.9
libneuronxla-2.1.681.0 3.8, 3.9, 3.10, 3.11
libneuronxla-0.5.3388 3.8, 3.9, 3.10
neuronx-cc-2.16.345.0 3.8, 3.9, 3.10, 3.11
neuronx-cc-stubs-2.16.345.0 3.8, 3.9, 3.10
neuronx_distributed-0.10.0 3.8, 3.9, 3.10, 3.11
neuronx_distributed_inference-0.1.0 3.8, 3.9, 3.10, 3.11
tensorflow-neuronx-2.10.1.2.1.0 3.8, 3.9, 3.10
tensorflow-neuronx-2.8.4.2.1.0 3.8, 3.9, 3.10
tensorflow-neuronx-2.9.3.2.1.0 3.8, 3.9, 3.10
torch-neuronx-1.13.1.1.17.0 3.8, 3.9, 3.10, 3.11
torch-neuronx-2.1.2.2.4.0 3.8, 3.9, 3.10, 3.11
torch-neuronx-2.5.1.2.4.0 3.8, 3.9, 3.10, 3.11
torch_xla-1.13.1+torchneurong 3.8, 3.9, 3.10, 3.11
torch_xla-2.1.6 3.8, 3.9, 3.10, 3.11
transformers-neuronx-0.13.322 3.8, 3.9, 3.10, 3.11
Supported Numpy Versions#
Neuron supports versions >= 1.21.6 and <= 1.22.2
Supported HuggingFace Transformers Versions#
| Package | Supported HuggingFace Transformers Versions |
|---|---|
| torch-neuronx | < 4.35 and >=4.37.2 |
| transformers-neuronx | >= 4.36.0 |
| neuronx-distributed - Llama model class | 4.31 |
| neuronx-distributed - GPT NeoX model class | 4.26 |
| neuronx-distributed - Bert model class | 4.26 |
| nemo-megatron | 4.31.0 |
Supported Probuf Versions#
| Package | Supported Probuf versions |
|---|---|
| neuronx-cc | > 3 |
| torch-neuronx | >= 3.20 |
| torch-neuron | < 3.20 |
| transformers-neuronx | >= 3.20 |
| neuronx-distributed | >= 3.20 |
| tensorflow-neuronx | < 3.20 |
| tensorflow-neuron | < 3.20 |
Neuron 2.20.2 (11/20/2024)#
Trn1 packages#
List of packages in Neuron 2.20.2:
Component Package
Collective Communication Library aws-neuronx-collectives-2.22.33.0
Driver aws-neuronx-dkms-2.18.20.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.12.2.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.12.1.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.22.20.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.22.20.0
OCI aws-neuronx-oci-hook-2.5.8.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.22.19.0
System Tools aws-neuronx-tools-2.19.0.0
Jax jax_neuronx-0.1.1
Framework libneuronxla-2.0.5347.0
Framework libneuronxla-0.5.3278
Compiler neuronx-cc-2.15.143.0
Compiler neuronx-cc-stubs-2.15.143.0
Neuron Distributed neuronx_distributed-0.9.0
Neuron Distributed Training neuronx_distributed_training-1.0.1
TensorBoard tensorboard-plugin-neuronx-2.6.63.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.2.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.16.0
PyTorch torch-neuronx-2.1.2.2.3.2
PyTorch torch_xla-1.13.1+torchneurong
PyTorch torch_xla-2.1.5
Transformers Neuron transformers-neuronx-0.12.313
Inf2 packages#
List of packages in Neuron 2.20.2:
Component Package
Collective Communication Library aws-neuronx-collectives-2.22.33.0
Driver aws-neuronx-dkms-2.18.20.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.12.2.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.12.1.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.22.20.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.22.20.0
OCI aws-neuronx-oci-hook-2.5.8.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.22.19.0
System Tools aws-neuronx-tools-2.19.0.0
Jax jax_neuronx-0.1.1
Framework libneuronxla-2.0.5347.0
Framework libneuronxla-0.5.3278
Compiler neuronx-cc-2.15.143.0
Compiler neuronx-cc-stubs-2.15.143.0
Neuron Distributed neuronx_distributed-0.9.0
TensorBoard tensorboard-plugin-neuronx-2.6.63.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.2.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.16.0
PyTorch torch-neuronx-2.1.2.2.3.2
PyTorch torch_xla-1.13.1+torchneurong
PyTorch torch_xla-2.1.5
Transformers Neuron transformers-neuronx-0.12.313
Inf1 packages#
List of packages in Neuron 2.20.2:
Component Package
Collective Communication Library aws-neuronx-collectives-2.12.35.0
Driver aws-neuronx-dkms-2.18.20.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.22.20.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.22.20.0
OCI aws-neuronx-oci-hook-2.5.8.0
Runtime Library aws-neuronx-runtime-lib-2.12.23.0
System Tools aws-neuronx-tools-2.19.0.0
Compiler dmlc_nnvm-1.19.6.0
Compiler dmlc_topi-1.19.6.0
Compiler dmlc_tvm-1.19.6.0
Compiler inferentia_hwm-1.17.6.0
MXNet mx_neuron-1.8.0.2.4.147.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.24.0.0
Perf Tools neuronperf-1.8.93.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.2.0
TensorFlow tensorflow-neuron-2.10.1.2.12.2.0
TensorFlow tensorflow-neuron-2.8.4.2.12.2.0
TensorFlow tensorflow-neuron-2.9.3.2.12.2.0
PyTorch torch-neuron-1.10.2.2.11.13.0
PyTorch torch-neuron-1.11.0.2.11.13.0
PyTorch torch-neuron-1.12.1.2.11.13.0
PyTorch torch-neuron-1.13.1.2.11.13.0
PyTorch torch-neuron-1.9.1.2.11.13.0
Supported Python Versions for Inf1 packages#
List of packages in Neuron 2.20.2:
Package Supported Python Versions
dmlc_nnvm-1.19.6.0 3.8, 3.9, 3.10
dmlc_topi-1.19.6.0 3.8, 3.9, 3.10
dmlc_tvm-1.19.6.0 3.8, 3.9, 3.10
inferentia_hwm-1.17.6.0 3.8, 3.9, 3.10
mx_neuron-1.8.0.2.4.147.0 3.8, 3.9, 3.10
mxnet_neuron-1.5.1.1.10.0.0 3.8, 3.9, 3.10
neuron-cc-1.24.0.0 3.8, 3.9, 3.10
neuronperf-1.8.93.0 3.8, 3.9, 3.10
tensorflow-neuron-2.10.1.2.12.2.0 3.8, 3.9, 3.10
tensorflow-neuron-2.8.4.2.12.2.0 3.8, 3.9, 3.10
tensorflow-neuron-2.9.3.2.12.2.0 3.8, 3.9, 3.10
torch-neuron-1.10.2.2.11.13.0 3.8, 3.9, 3.10
torch-neuron-1.11.0.2.11.13.0 3.8, 3.9, 3.10
torch-neuron-1.12.1.2.11.13.0 3.8, 3.9, 3.10
torch-neuron-1.13.1.2.11.13.0 3.8, 3.9, 3.10
torch-neuron-1.9.1.2.11.13.0 3.8, 3.9, 3.10
Supported Python Versions for Inf2/Trn1 packages#
List of packages in Neuron 2.20.2:
Package Supported Python Versions
aws-neuronx-runtime-discovery-2.9 3.8, 3.9, 3.10, 3.11
jax_neuronx-0.1.1 3.9
libneuronxla-2.0.5347.0 3.8, 3.9, 3.10, 3.11
libneuronxla-0.5.3278 3.8, 3.9, 3.10
neuronx-cc-2.15.143.0 3.8, 3.9, 3.10, 3.11
neuronx-cc-stubs-2.15.143.0 3.8, 3.9, 3.10
neuronx_distributed-0.9.0 3.8, 3.9, 3.10, 3.11
tensorflow-neuronx-2.10.1.2.1.0 3.8, 3.9, 3.10
tensorflow-neuronx-2.8.4.2.1.0 3.8, 3.9, 3.10
tensorflow-neuronx-2.9.3.2.1.0 3.8, 3.9, 3.10
torch-neuronx-1.13.1.1.16.0 3.8, 3.9, 3.10, 3.11
torch-neuronx-2.1.2.2.3.2 3.8, 3.9, 3.10, 3.11
torch_xla-1.13.1+torchneurong 3.8, 3.9, 3.10, 3.11
torch_xla-2.1.5 3.8, 3.9, 3.10, 3.11
transformers-neuronx-0.12.313 3.8, 3.9, 3.10, 3.11
Supported Numpy Versions#
Neuron supports versions >= 1.21.6 and <= 1.22.2
Supported HuggingFace Transformers Versions#
| Package | Supported HuggingFace Transformers Versions |
|---|---|
| torch-neuronx | < 4.35 and >=4.37.2 |
| transformers-neuronx | >= 4.36.0 |
| neuronx-distributed - Llama model class | 4.31 |
| neuronx-distributed - GPT NeoX model class | 4.26 |
| neuronx-distributed - Bert model class | 4.26 |
| nemo-megatron | 4.31.0 |
Supported Probuf Versions#
| Package | Supported Probuf versions |
|---|---|
| neuronx-cc | > 3 |
| torch-neuronx | >= 3.20 |
| torch-neuron | < 3.20 |
| transformers-neuronx | >= 3.20 |
| neuronx-distributed | >= 3.20 |
| tensorflow-neuronx | < 3.20 |
| tensorflow-neuron | < 3.20 |
Supported Linux Kernel Versions#
Neuron Driver (aws-neuronx-dkms) supports Linux kernel versions >= 5.10
Neuron 2.20.1 (10/25/2024)#
Trn1 packages#
List of packages in Neuron 2.20.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.22.26.0
Driver aws-neuronx-dkms-2.18.12.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.12.2.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.12.1.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.22.4.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.22.4.0
OCI aws-neuronx-oci-hook-2.5.3.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.22.14.0
System Tools aws-neuronx-tools-2.19.0.0
Jax jax_neuronx-0.1.1
Framework libneuronxla-2.0.4986.0
Framework libneuronxla-0.5.2978
Compiler neuronx-cc-2.15.141.0
Compiler neuronx-cc-stubs-2.15.141.0
Neuron Distributed neuronx_distributed-0.9.0
Neuron Distributed Training neuronx_distributed_training-1.0.0
TensorBoard tensorboard-plugin-neuronx-2.6.63.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.2.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.16.0
PyTorch torch-neuronx-2.1.2.2.3.1
PyTorch torch_xla-1.13.1+torchneurong
PyTorch torch_xla-2.1.4
Transformers Neuron transformers-neuronx-0.12.313
Inf2 packages#
List of packages in Neuron 2.20.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.22.26.0
Driver aws-neuronx-dkms-2.18.12.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.12.2.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.12.1.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.22.4.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.22.4.0
OCI aws-neuronx-oci-hook-2.5.3.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.22.14.0
System Tools aws-neuronx-tools-2.19.0.0
Jax jax_neuronx-0.1.1
Framework libneuronxla-2.0.4986.0
Framework libneuronxla-0.5.2978
Compiler neuronx-cc-2.15.141.0
Compiler neuronx-cc-stubs-2.15.141.0
Neuron Distributed neuronx_distributed-0.9.0
TensorBoard tensorboard-plugin-neuronx-2.6.63.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.2.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.16.0
PyTorch torch-neuronx-2.1.2.2.3.1
PyTorch torch_xla-1.13.1+torchneurong
PyTorch torch_xla-2.1.4
Transformers Neuron transformers-neuronx-0.12.313
Inf1 packages#
List of packages in Neuron 2.20.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.12.35.0
Driver aws-neuronx-dkms-2.18.12.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.22.4.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.22.4.0
OCI aws-neuronx-oci-hook-2.5.3.0
Runtime Library aws-neuronx-runtime-lib-2.12.23.0
System Tools aws-neuronx-tools-2.19.0.0
Compiler dmlc_nnvm-1.19.6.0
Compiler dmlc_topi-1.19.6.0
Compiler dmlc_tvm-1.19.6.0
Compiler inferentia_hwm-1.17.6.0
MXNet mx_neuron-1.8.0.2.4.147.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.24.0.0
Perf Tools neuronperf-1.8.93.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.2.0
TensorFlow tensorflow-neuron-2.10.1.2.12.2.0
TensorFlow tensorflow-neuron-2.8.4.2.12.2.0
TensorFlow tensorflow-neuron-2.9.3.2.12.2.0
PyTorch torch-neuron-1.10.2.2.11.7.0
PyTorch torch-neuron-1.11.0.2.11.7.0
PyTorch torch-neuron-1.12.1.2.11.7.0
PyTorch torch-neuron-1.13.1.2.11.7.0
PyTorch torch-neuron-1.9.1.2.11.7.0
Neuron 2.20.0 (09/16/2024)#
Trn1 packages#
List of packages in Neuron 2.20.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.22.26.0
Driver aws-neuronx-dkms-2.18.12.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.12.2.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.12.1.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.22.4.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.22.4.0
OCI aws-neuronx-oci-hook-2.5.3.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.22.14.0
System Tools aws-neuronx-tools-2.19.0.0
Jax jax_neuronx-0.1.1
Framework libneuronxla-2.0.4115.0
Framework libneuronxla-0.5.2978
Compiler neuronx-cc-2.15.128.0
Compiler neuronx-cc-stubs-2.15.128.0
Neuron Distributed neuronx_distributed-0.9.0
Neuron Distributed Training neuronx_distributed_training-1.0.0
TensorBoard tensorboard-plugin-neuronx-2.6.63.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.0.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.0.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.0.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.16.0
PyTorch torch-neuronx-2.1.2.2.3.0
PyTorch torch_xla-1.13.1+torchneuronf
PyTorch torch_xla-2.1.4
Transformers Neuron transformers-neuronx-0.12.313
Inf2 packages#
List of packages in Neuron 2.20.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.22.26.0
Driver aws-neuronx-dkms-2.18.12.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.12.2.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.12.1.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.22.4.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.22.4.0
OCI aws-neuronx-oci-hook-2.5.3.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.22.14.0
System Tools aws-neuronx-tools-2.19.0.0
Jax jax_neuronx-0.1.1
Framework libneuronxla-2.0.4115.0
Framework libneuronxla-0.5.2978
Compiler neuronx-cc-2.15.128.0
Compiler neuronx-cc-stubs-2.15.128.0
Neuron Distributed neuronx_distributed-0.9.0
TensorBoard tensorboard-plugin-neuronx-2.6.63.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.0.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.0.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.0.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.16.0
PyTorch torch-neuronx-2.1.2.2.3.0
PyTorch torch_xla-1.13.1+torchneuronf
PyTorch torch_xla-2.1.4
Transformers Neuron transformers-neuronx-0.12.313
Inf1 packages#
List of packages in Neuron 2.20.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.12.35.0
Driver aws-neuronx-dkms-2.18.12.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.22.4.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.22.4.0
OCI aws-neuronx-oci-hook-2.5.3.0
Runtime Library aws-neuronx-runtime-lib-2.12.23.0
System Tools aws-neuronx-tools-2.19.0.0
Compiler dmlc_nnvm-1.19.6.0
Compiler dmlc_topi-1.19.6.0
Compiler dmlc_tvm-1.19.6.0
Compiler inferentia_hwm-1.17.6.0
MXNet mx_neuron-1.8.0.2.4.147.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.24.0.0
Perf Tools neuronperf-1.8.93.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.0.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.0.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.0.0
TensorFlow tensorflow-neuron-2.10.1.2.12.0.0
TensorFlow tensorflow-neuron-2.8.4.2.12.0.0
TensorFlow tensorflow-neuron-2.9.3.2.12.0.0
PyTorch torch-neuron-1.10.2.2.11.7.0
PyTorch torch-neuron-1.11.0.2.11.7.0
PyTorch torch-neuron-1.12.1.2.11.7.0
PyTorch torch-neuron-1.13.1.2.11.7.0
PyTorch torch-neuron-1.9.1.2.11.7.0
Neuron 2.19.1 (07/19/2024)#
Trn1 packages#
List of packages in Neuron 2.19.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.21.46.0
Driver aws-neuronx-dkms-2.17.17.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.11.4.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.11.3.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.21.14.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.21.14.0
OCI aws-neuronx-oci-hook-2.4.4.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.21.41.0
System Tools aws-neuronx-tools-2.18.3.0
Framework libneuronxla-2.0.2335
Framework libneuronxla-0.5.1795
Compiler neuronx-cc-2.14.227.0
Neuron Distributed neuronx_distributed-0.8.0
TensorBoard tensorboard-plugin-neuronx-2.6.63.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.11.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.11.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.11.4.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.15.0
PyTorch torch-neuronx-2.1.2.2.2.0
PyTorch torch_xla-1.13.1+torchneuronf
PyTorch torch_xla-2.1.3
Transformers Neuron transformers-neuronx-0.11.351
Inf2 packages#
List of packages in Neuron 2.19.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.21.46.0
Driver aws-neuronx-dkms-2.17.17.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.11.4.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.11.3.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.21.14.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.21.14.0
OCI aws-neuronx-oci-hook-2.4.4.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.21.41.0
System Tools aws-neuronx-tools-2.18.3.0
Framework libneuronxla-2.0.2335
Framework libneuronxla-0.5.1795
Compiler neuronx-cc-2.14.227.0
Neuron Distributed neuronx_distributed-0.8.0
TensorBoard tensorboard-plugin-neuronx-2.6.63.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.11.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.11.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.11.4.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.15.0
PyTorch torch-neuronx-2.1.2.2.2.0
PyTorch torch_xla-1.13.1+torchneuronf
PyTorch torch_xla-2.1.3
Transformers Neuron transformers-neuronx-0.11.351
Inf1 packages#
List of packages in Neuron 2.19.1:
Component Package
Driver aws-neuronx-dkms-2.17.17.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.21.14.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.21.14.0
OCI aws-neuronx-oci-hook-2.4.4.0
System Tools aws-neuronx-tools-2.18.3.0
Compiler dmlc_nnvm-1.19.1.0
Compiler dmlc_topi-1.19.1.0
Compiler dmlc_tvm-1.19.1.0
Compiler inferentia_hwm-1.17.1.0
MXNet mx_neuron-1.8.0.2.4.147.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.23.5.0
Perf Tools neuronperf-1.8.93.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.11.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.11.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.11.4.0
TensorFlow tensorflow-neuron-2.10.1.2.11.4.0
TensorFlow tensorflow-neuron-2.7.4.2.11.4.0
TensorFlow tensorflow-neuron-2.8.4.2.11.4.0
TensorFlow tensorflow-neuron-2.9.3.2.11.4.0
PyTorch torch-neuron-1.10.2.2.10.12.0
PyTorch torch-neuron-1.11.0.2.10.12.0
PyTorch torch-neuron-1.12.1.2.10.12.0
PyTorch torch-neuron-1.13.1.2.10.12.0
PyTorch torch-neuron-1.9.1.2.10.12.0
Neuron 2.19.0 (07/03/2024)#
Trn1 packages#
List of packages in Neuron 2.19.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.21.46.0
Driver aws-neuronx-dkms-2.17.17.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.11.4.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.11.3.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.21.14.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.21.14.0
OCI aws-neuronx-oci-hook-2.4.4.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.21.41.0
System Tools aws-neuronx-tools-2.18.3.0
Framework libneuronxla-2.0.2335
Framework libneuronxla-0.5.1795
Compiler neuronx-cc-2.14.213.0
Neuron Distributed neuronx_distributed-0.8.0
TensorBoard tensorboard-plugin-neuronx-2.6.63.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.11.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.11.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.11.4.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.15.0
PyTorch torch-neuronx-2.1.2.2.2.0
PyTorch torch_xla-1.13.1+torchneuronf
PyTorch torch_xla-2.1.3
Transformers Neuron transformers-neuronx-0.11.351
Inf2 packages#
List of packages in Neuron 2.19.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.21.46.0
Driver aws-neuronx-dkms-2.17.17.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.11.4.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.11.3.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.21.14.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.21.14.0
OCI aws-neuronx-oci-hook-2.4.4.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.21.41.0
System Tools aws-neuronx-tools-2.18.3.0
Framework libneuronxla-2.0.2335
Framework libneuronxla-0.5.1795
Compiler neuronx-cc-2.14.213.0
Neuron Distributed neuronx_distributed-0.8.0
TensorBoard tensorboard-plugin-neuronx-2.6.63.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.11.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.11.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.11.4.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.15.0
PyTorch torch-neuronx-2.1.2.2.2.0
PyTorch torch_xla-1.13.1+torchneuronf
PyTorch torch_xla-2.1.3
Transformers Neuron transformers-neuronx-0.11.351
Inf1 packages#
List of packages in Neuron 2.19.0:
Component Package
Driver aws-neuronx-dkms-2.17.17.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.21.14.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.21.14.0
OCI aws-neuronx-oci-hook-2.4.4.0
System Tools aws-neuronx-tools-2.18.3.0
Compiler dmlc_nnvm-1.19.1.0
Compiler dmlc_topi-1.19.1.0
Compiler dmlc_tvm-1.19.1.0
Compiler inferentia_hwm-1.17.1.0
MXNet mx_neuron-1.8.0.2.4.147.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.23.5.0
Perf Tools neuronperf-1.8.93.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.11.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.11.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.11.4.0
TensorFlow tensorflow-neuron-2.10.1.2.11.4.0
TensorFlow tensorflow-neuron-2.7.4.2.11.4.0
TensorFlow tensorflow-neuron-2.8.4.2.11.4.0
TensorFlow tensorflow-neuron-2.9.3.2.11.4.0
PyTorch torch-neuron-1.10.2.2.10.12.0
PyTorch torch-neuron-1.11.0.2.10.12.0
PyTorch torch-neuron-1.12.1.2.10.12.0
PyTorch torch-neuron-1.13.1.2.10.12.0
PyTorch torch-neuron-1.9.1.2.10.12.0
Neuron 2.18.2 (04/25/2024)#
Trn1 packages#
List of packages in Neuron 2.18.2:
Component Package
Collective Communication Library aws-neuronx-collectives-2.20.22.0
Driver aws-neuronx-dkms-2.16.7.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.9.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.9.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.20.13.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.20.13.0
OCI aws-neuronx-oci-hook-2.3.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.20.22.0
System Tools aws-neuronx-tools-2.17.1.0
Framework libneuronxla-2.0.965
Framework libneuronxla-0.5.971
Compiler neuronx-cc-2.13.72.0
Neuron Distributed neuronx_distributed-0.7.0
TensorBoard tensorboard-plugin-neuronx-2.6.7.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.19.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.14.0
PyTorch torch-neuronx-2.1.2.2.1.0
PyTorch torch_xla-1.13.1+torchneurone
PyTorch torch_xla-2.1.2
Transformers Neuron transformers-neuronx-0.10.0.360
Inf2 packages#
List of packages in Neuron 2.18.2:
Component Package
Collective Communication Library aws-neuronx-collectives-2.20.22.0
Driver aws-neuronx-dkms-2.16.7.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.9.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.9.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.20.13.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.20.13.0
OCI aws-neuronx-oci-hook-2.3.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.20.22.0
System Tools aws-neuronx-tools-2.17.1.0
Framework libneuronxla-2.0.965
Framework libneuronxla-0.5.971
Compiler neuronx-cc-2.13.72.0
Neuron Distributed neuronx_distributed-0.7.0
TensorBoard tensorboard-plugin-neuronx-2.6.7.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.19.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.14.0
PyTorch torch-neuronx-2.1.2.2.1.0
PyTorch torch_xla-1.13.1+torchneurone
PyTorch torch_xla-2.1.2
Transformers Neuron transformers-neuronx-0.10.0.360
Inf1 packages#
List of packages in Neuron 2.18.2:
Component Package
Driver aws-neuronx-dkms-2.16.7.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.20.13.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.20.13.0
OCI aws-neuronx-oci-hook-2.3.0.0
System Tools aws-neuronx-tools-2.17.1.0
Compiler dmlc_nnvm-1.19.0.0
Compiler dmlc_topi-1.19.0.0
Compiler dmlc_tvm-1.19.0.0
Compiler inferentia_hwm-1.17.0.0
MXNet mx_neuron-1.8.0.2.4.50.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.22.0.0
Perf Tools neuronperf-1.8.55.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.19.0
TensorFlow tensorflow-neuron-2.10.1.2.10.19.0
TensorFlow tensorflow-neuron-2.7.4.2.10.19.0
TensorFlow tensorflow-neuron-2.8.4.2.10.19.0
TensorFlow tensorflow-neuron-2.9.3.2.10.19.0
PyTorch torch-neuron-1.10.2.2.9.74.0
PyTorch torch-neuron-1.11.0.2.9.74.0
PyTorch torch-neuron-1.12.1.2.9.74.0
PyTorch torch-neuron-1.13.1.2.9.74.0
PyTorch torch-neuron-1.9.1.2.9.74.0
Neuron 2.18.1 (04/10/2024)#
Trn1 packages#
List of packages in Neuron 2.18.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.20.22.0
Driver aws-neuronx-dkms-2.16.7.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.9.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.9.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.20.13.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.20.13.0
OCI aws-neuronx-oci-hook-2.3.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.20.22.0
System Tools aws-neuronx-tools-2.17.1.0
Framework libneuronxla-2.0.965
Framework libneuronxla-0.5.971
Compiler neuronx-cc-2.13.68.0
Neuron Distributed neuronx_distributed-0.7.0
TensorBoard tensorboard-plugin-neuronx-2.6.7.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.19.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.14.0
PyTorch torch-neuronx-2.1.2.2.1.0
PyTorch torch_xla-1.13.1+torchneurone
PyTorch torch_xla-2.1.2
Transformers Neuron transformers-neuronx-0.10.0.360
Inf2 packages#
List of packages in Neuron 2.18.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.20.22.0
Driver aws-neuronx-dkms-2.16.7.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.9.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.9.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.20.13.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.20.13.0
OCI aws-neuronx-oci-hook-2.3.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.20.22.0
System Tools aws-neuronx-tools-2.17.1.0
Framework libneuronxla-2.0.965
Framework libneuronxla-0.5.971
Compiler neuronx-cc-2.13.68.0
Neuron Distributed neuronx_distributed-0.7.0
TensorBoard tensorboard-plugin-neuronx-2.6.7.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.19.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.14.0
PyTorch torch-neuronx-2.1.2.2.1.0
PyTorch torch_xla-1.13.1+torchneurone
PyTorch torch_xla-2.1.2
Transformers Neuron transformers-neuronx-0.10.0.360
Inf1 packages#
List of packages in Neuron 2.18.1:
Component Package
Driver aws-neuronx-dkms-2.16.7.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.20.13.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.20.13.0
OCI aws-neuronx-oci-hook-2.3.0.0
System Tools aws-neuronx-tools-2.17.1.0
Compiler dmlc_nnvm-1.19.0.0
Compiler dmlc_topi-1.19.0.0
Compiler dmlc_tvm-1.19.0.0
Compiler inferentia_hwm-1.17.0.0
MXNet mx_neuron-1.8.0.2.4.50.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.22.0.0
Perf Tools neuronperf-1.8.55.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.19.0
TensorFlow tensorflow-neuron-2.10.1.2.10.19.0
TensorFlow tensorflow-neuron-2.7.4.2.10.19.0
TensorFlow tensorflow-neuron-2.8.4.2.10.19.0
TensorFlow tensorflow-neuron-2.9.3.2.10.19.0
PyTorch torch-neuron-1.10.2.2.9.74.0
PyTorch torch-neuron-1.11.0.2.9.74.0
PyTorch torch-neuron-1.12.1.2.9.74.0
PyTorch torch-neuron-1.13.1.2.9.74.0
PyTorch torch-neuron-1.9.1.2.9.74.0
Neuron 2.18.0 (04/01/2024)#
Trn1 packages#
List of packages in Neuron 2.18.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.20.22.0
Driver aws-neuronx-dkms-2.16.7.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.9.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.9.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.20.13.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.20.13.0
OCI aws-neuronx-oci-hook-2.3.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.20.22.0
System Tools aws-neuronx-tools-2.17.1.0
Framework libneuronxla-2.0.965
Framework libneuronxla-0.5.971
Compiler neuronx-cc-2.13.66.0
Neuron Distributed neuronx_distributed-0.7.0
TensorBoard tensorboard-plugin-neuronx-2.6.7.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.19.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.14.0
PyTorch torch-neuronx-2.1.2.2.1.0
PyTorch torch_xla-1.13.1+torchneurone
PyTorch torch_xla-2.1.2
Transformers Neuron transformers-neuronx-0.10.0.21
Inf2 packages#
List of packages in Neuron 2.18.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.20.22.0
Driver aws-neuronx-dkms-2.16.7.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.9.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.9.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.20.13.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.20.13.0
OCI aws-neuronx-oci-hook-2.3.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.20.22.0
System Tools aws-neuronx-tools-2.17.1.0
Framework libneuronxla-2.0.965
Framework libneuronxla-0.5.971
Compiler neuronx-cc-2.13.66.0
Neuron Distributed neuronx_distributed-0.7.0
TensorBoard tensorboard-plugin-neuronx-2.6.7.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.19.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.14.0
PyTorch torch-neuronx-2.1.2.2.1.0
PyTorch torch_xla-1.13.1+torchneurone
PyTorch torch_xla-2.1.2
Transformers Neuron transformers-neuronx-0.10.0.21
Inf1 packages#
List of packages in Neuron 2.18.0:
Component Package
Driver aws-neuronx-dkms-2.16.7.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.20.13.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.20.13.0
OCI aws-neuronx-oci-hook-2.3.0.0
System Tools aws-neuronx-tools-2.17.1.0
Compiler dmlc_nnvm-1.19.0.0
Compiler dmlc_topi-1.19.0.0
Compiler dmlc_tvm-1.19.0.0
Compiler inferentia_hwm-1.17.0.0
MXNet mx_neuron-1.8.0.2.4.50.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.22.0.0
Perf Tools neuronperf-1.8.55.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.19.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.19.0
TensorFlow tensorflow-neuron-2.10.1.2.10.19.0
TensorFlow tensorflow-neuron-2.7.4.2.10.19.0
TensorFlow tensorflow-neuron-2.8.4.2.10.19.0
TensorFlow tensorflow-neuron-2.9.3.2.10.19.0
PyTorch torch-neuron-1.10.2.2.9.74.0
PyTorch torch-neuron-1.11.0.2.9.74.0
PyTorch torch-neuron-1.12.1.2.9.74.0
PyTorch torch-neuron-1.13.1.2.9.74.0
PyTorch torch-neuron-1.9.1.2.9.74.0
Neuron 2.17.0 (02/13/2024)#
Trn1 packages#
List of packages in Neuron 2.17.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.20.11.0
Driver aws-neuronx-dkms-2.15.9.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.9.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.9.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.19.16.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.19.16.0
OCI aws-neuronx-oci-hook-2.2.45.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.20.11.0
System Tools aws-neuronx-tools-2.17.0.0
Framework libneuronxla-2.0.755
Framework libneuronxla-0.5.809
Compiler neuronx-cc-2.12.68.0
Neuron Distributed neuronx_distributed-0.6.0
Compiler neuronx_hwm-2.12.0.0
TensorBoard tensorboard-plugin-neuronx-2.6.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.8.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.13.1
PyTorch torch-neuronx-2.0.0.2.0.1b0
PyTorch torch-neuronx-2.1.1.2.0.1b0
PyTorch torch_xla-1.13.1+torchneurond
PyTorch torch_xla-2.1.1
Transformers Neuron transformers-neuronx-0.9.474
Inf2 packages#
List of packages in Neuron 2.17.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.20.11.0
Driver aws-neuronx-dkms-2.15.9.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.9.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.9.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.19.16.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.19.16.0
OCI aws-neuronx-oci-hook-2.2.45.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.20.11.0
System Tools aws-neuronx-tools-2.17.0.0
Framework libneuronxla-2.0.755
Framework libneuronxla-0.5.809
Compiler neuronx-cc-2.12.68.0
Neuron Distributed neuronx_distributed-0.6.0
Compiler neuronx_hwm-2.12.0.0
TensorBoard tensorboard-plugin-neuronx-2.6.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.8.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.13.1
PyTorch torch-neuronx-2.0.0.2.0.1b0
PyTorch torch-neuronx-2.1.1.2.0.1b0
PyTorch torch_xla-1.13.1+torchneurond
PyTorch torch_xla-2.1.1
Transformers Neuron transformers-neuronx-0.9.474
Inf1 packages#
List of packages in Neuron 2.17.0:
Component Package
Driver aws-neuronx-dkms-2.15.9.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.19.16.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.19.16.0
OCI aws-neuronx-oci-hook-2.2.45.0
System Tools aws-neuronx-tools-2.17.0.0
Compiler dmlc_nnvm-1.18.2.0
Compiler dmlc_topi-1.18.2.0
Compiler dmlc_tvm-1.18.2.0
Compiler inferentia_hwm-1.16.2.0
MXNet mx_neuron-1.8.0.2.4.40.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.21.0.0
Perf Tools neuronperf-1.8.15.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.8.0
TensorFlow tensorflow-neuron-2.10.1.2.10.8.0
TensorFlow tensorflow-neuron-2.7.4.2.10.8.0
TensorFlow tensorflow-neuron-2.8.4.2.10.8.0
TensorFlow tensorflow-neuron-2.9.3.2.10.8.0
PyTorch torch-neuron-1.10.2.2.9.17.0
PyTorch torch-neuron-1.11.0.2.9.17.0
PyTorch torch-neuron-1.12.1.2.9.17.0
PyTorch torch-neuron-1.13.1.2.9.17.0
PyTorch torch-neuron-1.9.1.2.9.17.0
Neuron 2.16.1 (01/18/2024)#
Trn1 packages#
List of packages in Neuron 2.16.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.19.7.0
Driver aws-neuronx-dkms-2.15.9.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.9.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.9.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.19.16.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.19.16.0
OCI aws-neuronx-oci-hook-2.2.45.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.19.5.0
System Tools aws-neuronx-tools-2.16.1.0
Framework libneuronxla-2.0.498
Framework libneuronxla-0.5.669
Compiler neuronx-cc-2.12.68.0
Neuron Distributed neuronx_distributed-0.6.0
Compiler neuronx_hwm-2.12.0.0
TensorBoard tensorboard-plugin-neuronx-2.6.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.8.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.13.0
PyTorch torch-neuronx-2.0.0.2.0.1b0
PyTorch torch-neuronx-2.1.1.2.0.0b0
PyTorch torch_xla-1.13.1+torchneurond
PyTorch torch_xla-2.1.1
Transformers Neuron transformers-neuronx-0.9.474
Inf2 packages#
List of packages in Neuron 2.16.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.19.7.0
Driver aws-neuronx-dkms-2.15.9.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.9.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.9.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.19.16.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.19.16.0
OCI aws-neuronx-oci-hook-2.2.45.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.19.5.0
System Tools aws-neuronx-tools-2.16.1.0
Framework libneuronxla-2.0.498
Framework libneuronxla-0.5.669
Compiler neuronx-cc-2.12.68.0
Neuron Distributed neuronx_distributed-0.6.0
Compiler neuronx_hwm-2.12.0.0
TensorBoard tensorboard-plugin-neuronx-2.6.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.8.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.13.0
PyTorch torch-neuronx-2.0.0.2.0.1b0
PyTorch torch-neuronx-2.1.1.2.0.0b0
PyTorch torch_xla-1.13.1+torchneurond
PyTorch torch_xla-2.1.1
Transformers Neuron transformers-neuronx-0.9.474
Inf1 packages#
List of packages in Neuron 2.16.1:
Component Package
Driver aws-neuronx-dkms-2.15.9.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.19.16.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.19.16.0
OCI aws-neuronx-oci-hook-2.2.45.0
System Tools aws-neuronx-tools-2.16.1.0
Compiler dmlc_nnvm-1.18.2.0
Compiler dmlc_topi-1.18.2.0
Compiler dmlc_tvm-1.18.2.0
Compiler inferentia_hwm-1.16.2.0
MXNet mx_neuron-1.8.0.2.4.40.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.21.0.0
Perf Tools neuronperf-1.8.15.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.8.0
TensorFlow tensorflow-neuron-2.10.1.2.10.8.0
TensorFlow tensorflow-neuron-2.7.4.2.10.8.0
TensorFlow tensorflow-neuron-2.8.4.2.10.8.0
TensorFlow tensorflow-neuron-2.9.3.2.10.8.0
PyTorch torch-neuron-1.10.2.2.9.17.0
PyTorch torch-neuron-1.11.0.2.9.17.0
PyTorch torch-neuron-1.12.1.2.9.17.0
PyTorch torch-neuron-1.13.1.2.9.17.0
PyTorch torch-neuron-1.9.1.2.9.17.0
Neuron 2.16.0 (12/21/2023)#
Trn1 packages#
List of packages in Neuron 2.16.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.19.7.0
Driver aws-neuronx-dkms-2.15.9.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.9.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.9.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.19.16.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.19.16.0
OCI aws-neuronx-oci-hook-2.2.45.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.19.5.0
System Tools aws-neuronx-tools-2.16.1.0
Framework libneuronxla-2.0.498
Framework libneuronxla-0.5.669
Compiler neuronx-cc-2.12.54.0
Neuron Distributed neuronx_distributed-0.6.0
Compiler neuronx_hwm-2.12.0.0
TensorBoard tensorboard-plugin-neuronx-2.6.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.8.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.13.0
PyTorch torch-neuronx-2.0.0.2.0.1b0
PyTorch torch-neuronx-2.1.1.2.0.0b0
PyTorch torch_xla-1.13.1+torchneurond
PyTorch torch_xla-2.1.1
Transformers Neuron transformers-neuronx-0.9.474
Inf2 packages#
List of packages in Neuron 2.16.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.19.7.0
Driver aws-neuronx-dkms-2.15.9.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.9.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.9.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.19.16.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.19.16.0
OCI aws-neuronx-oci-hook-2.2.45.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.19.5.0
System Tools aws-neuronx-tools-2.16.1.0
Framework libneuronxla-2.0.498
Framework libneuronxla-0.5.669
Compiler neuronx-cc-2.12.54.0
Neuron Distributed neuronx_distributed-0.6.0
Compiler neuronx_hwm-2.12.0.0
TensorBoard tensorboard-plugin-neuronx-2.6.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.8.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.13.0
PyTorch torch-neuronx-2.0.0.2.0.1b0
PyTorch torch-neuronx-2.1.1.2.0.0b0
PyTorch torch_xla-1.13.1+torchneurond
PyTorch torch_xla-2.1.1
Transformers Neuron transformers-neuronx-0.9.474
Inf1 packages#
List of packages in Neuron 2.16.0:
Component Package
Driver aws-neuronx-dkms-2.15.9.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.19.16.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.19.16.0
OCI aws-neuronx-oci-hook-2.2.45.0
System Tools aws-neuronx-tools-2.16.1.0
Compiler dmlc_nnvm-1.18.2.0
Compiler dmlc_topi-1.18.2.0
Compiler dmlc_tvm-1.18.2.0
Compiler inferentia_hwm-1.16.2.0
MXNet mx_neuron-1.8.0.2.4.40.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.21.0.0
Perf Tools neuronperf-1.8.15.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.8.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.8.0
TensorFlow tensorflow-neuron-2.10.1.2.10.8.0
TensorFlow tensorflow-neuron-2.7.4.2.10.8.0
TensorFlow tensorflow-neuron-2.8.4.2.10.8.0
TensorFlow tensorflow-neuron-2.9.3.2.10.8.0
PyTorch torch-neuron-1.10.2.2.9.17.0
PyTorch torch-neuron-1.11.0.2.9.17.0
PyTorch torch-neuron-1.12.1.2.9.17.0
PyTorch torch-neuron-1.13.1.2.9.17.0
PyTorch torch-neuron-1.9.1.2.9.17.0
Neuron 2.15.2 (11/17/2023)#
Trn1 packages#
List of packages in Neuron 2.15.2:
Component Package
Collective Communication Library aws-neuronx-collectives-2.18.19.0
Driver aws-neuronx-dkms-2.14.5.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.8.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.8.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.18.3.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.18.3.0
OCI aws-neuronx-oci-hook-2.2.27.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.18.15.0
System Tools aws-neuronx-tools-2.15.4.0
Framework libneuronxla-1.0.680
Framework libneuronxla-0.5.570
Compiler neuronx-cc-2.11.0.35
Neuron Distributed neuronx_distributed-0.5.0
Compiler neuronx_hwm-2.11.0.2
TensorBoard tensorboard-plugin-neuronx-2.5.43.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.2.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.12.1
PyTorch torch-neuronx-2.0.0.2.0.1b0
PyTorch torch_xla-1.13.1+torchneuronc
PyTorch torch_xla-2.0.0+torchneuron0
Transformers Neuron transformers-neuronx-0.8.268
Inf2 packages#
List of packages in Neuron 2.15.2:
Component Package
Collective Communication Library aws-neuronx-collectives-2.18.19.0
Driver aws-neuronx-dkms-2.14.5.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.8.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.8.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.18.3.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.18.3.0
OCI aws-neuronx-oci-hook-2.2.27.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.18.15.0
System Tools aws-neuronx-tools-2.15.4.0
Framework libneuronxla-1.0.680
Framework libneuronxla-0.5.570
Compiler neuronx-cc-2.11.0.35
Neuron Distributed neuronx_distributed-0.5.0
Compiler neuronx_hwm-2.11.0.2
TensorBoard tensorboard-plugin-neuronx-2.5.43.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.2.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.12.1
PyTorch torch-neuronx-2.0.0.2.0.1b0
PyTorch torch_xla-1.13.1+torchneuronc
PyTorch torch_xla-2.0.0+torchneuron0
Transformers Neuron transformers-neuronx-0.8.268
Inf1 packages#
List of packages in Neuron 2.15.2:
Component Package
Driver aws-neuronx-dkms-2.14.5.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.18.3.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.18.3.0
OCI aws-neuronx-oci-hook-2.2.27.0
System Tools aws-neuronx-tools-2.15.4.0
Compiler dmlc_nnvm-1.18.1.0
Compiler dmlc_topi-1.18.1.0
Compiler dmlc_tvm-1.18.1.0
Compiler inferentia_hwm-1.16.1.0
MXNet mx_neuron-1.8.0.2.4.25.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.20.3.0
Perf Tools neuronperf-1.8.9.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.2.0
TensorFlow tensorflow-neuron-2.10.1.2.10.2.0
TensorFlow tensorflow-neuron-2.7.4.2.10.2.0
TensorFlow tensorflow-neuron-2.8.4.2.10.2.0
TensorFlow tensorflow-neuron-2.9.3.2.10.2.0
PyTorch torch-neuron-1.10.2.2.9.6.0
PyTorch torch-neuron-1.11.0.2.9.6.0
PyTorch torch-neuron-1.12.1.2.9.6.0
PyTorch torch-neuron-1.13.1.2.9.6.0
PyTorch torch-neuron-1.9.1.2.9.6.0
Runtime Library libnrt.so (Version 2.18.15)
Neuron 2.15.1 (11/09/2023)#
Trn1 packages#
List of packages in Neuron 2.15.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.18.19.0
Driver aws-neuronx-dkms-2.14.5.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.8.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.8.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.18.3.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.18.3.0
OCI aws-neuronx-oci-hook-2.2.27.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.18.15.0
System Tools aws-neuronx-tools-2.15.4.0
Framework libneuronxla-1.0.680
Framework libneuronxla-0.5.570
Compiler neuronx-cc-2.11.0.34
Neuron Distributed neuronx_distributed-0.5.0
Compiler neuronx_hwm-2.11.0.2
TensorBoard tensorboard-plugin-neuronx-2.5.43.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.2.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.12.1
PyTorch torch-neuronx-2.0.0.2.0.1b0
PyTorch torch_xla-1.13.1+torchneuronc
PyTorch torch_xla-2.0.0+torchneuron0
Transformers Neuron transformers-neuronx-0.8.268
Inf2 packages#
List of packages in Neuron 2.15.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.18.19.0
Driver aws-neuronx-dkms-2.14.5.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.8.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.8.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.18.3.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.18.3.0
OCI aws-neuronx-oci-hook-2.2.27.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.18.15.0
System Tools aws-neuronx-tools-2.15.4.0
Framework libneuronxla-1.0.680
Framework libneuronxla-0.5.570
Compiler neuronx-cc-2.11.0.34
Neuron Distributed neuronx_distributed-0.5.0
Compiler neuronx_hwm-2.11.0.2
TensorBoard tensorboard-plugin-neuronx-2.5.43.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.2.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.12.1
PyTorch torch-neuronx-2.0.0.2.0.1b0
PyTorch torch_xla-1.13.1+torchneuronc
PyTorch torch_xla-2.0.0+torchneuron0
Transformers Neuron transformers-neuronx-0.8.268
Inf1 packages#
List of packages in Neuron 2.15.1:
Component Package
Driver aws-neuronx-dkms-2.14.5.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.18.3.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.18.3.0
OCI aws-neuronx-oci-hook-2.2.27.0
System Tools aws-neuronx-tools-2.15.4.0
Compiler dmlc_nnvm-1.18.1.0
Compiler dmlc_topi-1.18.1.0
Compiler dmlc_tvm-1.18.1.0
Compiler inferentia_hwm-1.16.1.0
MXNet mx_neuron-1.8.0.2.4.25.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.20.3.0
Perf Tools neuronperf-1.8.9.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.2.0
TensorFlow tensorflow-neuron-2.10.1.2.10.2.0
TensorFlow tensorflow-neuron-2.7.4.2.10.2.0
TensorFlow tensorflow-neuron-2.8.4.2.10.2.0
TensorFlow tensorflow-neuron-2.9.3.2.10.2.0
PyTorch torch-neuron-1.10.2.2.9.6.0
PyTorch torch-neuron-1.11.0.2.9.6.0
PyTorch torch-neuron-1.12.1.2.9.6.0
PyTorch torch-neuron-1.13.1.2.9.6.0
PyTorch torch-neuron-1.9.1.2.9.6.0
Runtime Library libnrt.so (Version 2.18.15)
Neuron 2.15.0 (10/26/2023)#
Trn1 packages#
List of packages in Neuron 2.15.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.18.18.0
Driver aws-neuronx-dkms-2.14.5.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.8.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.8.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.18.3.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.18.3.0
OCI aws-neuronx-oci-hook-2.2.27.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.18.14.0
System Tools aws-neuronx-tools-2.15.4.0
Framework libneuronxla-1.0.663
Framework libneuronxla-0.5.538
Compiler neuronx-cc-2.11.0.34
Neuron Distributed neuronx_distributed-0.5.0
Compiler neuronx_hwm-2.11.0.2
TensorBoard tensorboard-plugin-neuronx-2.5.43.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.2.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.12.0
PyTorch torch-neuronx-2.0.0.2.0.0b0
PyTorch torch_xla-1.13.1+torchneuronc
PyTorch torch_xla-2.0.0+torchneuron0
Transformers Neuron transformers-neuronx-0.8.268
Inf2 packages#
List of packages in Neuron 2.15.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.18.18.0
Driver aws-neuronx-dkms-2.14.5.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.8.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.8.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.18.3.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.18.3.0
OCI aws-neuronx-oci-hook-2.2.27.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.18.14.0
System Tools aws-neuronx-tools-2.15.4.0
Framework libneuronxla-1.0.663
Framework libneuronxla-0.5.538
Compiler neuronx-cc-2.11.0.34
Neuron Distributed neuronx_distributed-0.5.0
Compiler neuronx_hwm-2.11.0.2
TensorBoard tensorboard-plugin-neuronx-2.5.43.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.2.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
PyTorch torch-neuronx-1.13.1.1.12.0
PyTorch torch-neuronx-2.0.0.2.0.0b0
PyTorch torch_xla-1.13.1+torchneuronc
PyTorch torch_xla-2.0.0+torchneuron0
Transformers Neuron transformers-neuronx-0.8.268
Inf1 packages#
List of packages in Neuron 2.15.0:
Component Package
Driver aws-neuronx-dkms-2.14.5.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.18.3.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.18.3.0
OCI aws-neuronx-oci-hook-2.2.27.0
System Tools aws-neuronx-tools-2.15.4.0
Compiler dmlc_nnvm-1.18.1.0
Compiler dmlc_topi-1.18.1.0
Compiler dmlc_tvm-1.18.1.0
Compiler inferentia_hwm-1.16.1.0
MXNet mx_neuron-1.8.0.2.4.25.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.20.3.0
Perf Tools neuronperf-1.8.9.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.2.0
TensorFlow tensorflow-neuron-2.10.1.2.10.2.0
TensorFlow tensorflow-neuron-2.7.4.2.10.2.0
TensorFlow tensorflow-neuron-2.8.4.2.10.2.0
TensorFlow tensorflow-neuron-2.9.3.2.10.2.0
PyTorch torch-neuron-1.10.2.2.9.6.0
PyTorch torch-neuron-1.11.0.2.9.6.0
PyTorch torch-neuron-1.12.1.2.9.6.0
PyTorch torch-neuron-1.13.1.2.9.6.0
PyTorch torch-neuron-1.9.1.2.9.6.0
Runtime Library libnrt.so (Version 2.18.14)
Neuron 2.14.1 (09/26/2023)#
Trn1 packages#
List of packages in Neuron 2.14.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.17.9.0
Driver aws-neuronx-dkms-2.13.4.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.7.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.7.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.17.7.0
System Tools aws-neuronx-tools-2.14.6.0
Framework libneuronxla-0.5.476
Compiler neuronx_hwm-2.10.0.5
PyTorch torch_xla-1.13.1+torchneuronb
Compiler neuronx-cc-2.10.0.35
Kubernetes Plugin aws-neuronx-k8-plugin-2.17.3.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.17.3.0
OCI aws-neuronx-oci-hook-2.2.22.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.1.0
TensorBoard tensorboard-plugin-neuronx-2.5.39.0
PyTorch torch-neuronx-1.13.1.1.11.0
Transformers Neuron transformers-neuronx-0.7.84
Neuron Distributed neuronx_distributed-0.4.0
Inf2 packages#
List of packages in Neuron 2.14.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.17.9.0
Driver aws-neuronx-dkms-2.13.4.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.7.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.7.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.17.7.0
System Tools aws-neuronx-tools-2.14.6.0
Framework libneuronxla-0.5.476
Compiler neuronx_hwm-2.10.0.5
PyTorch torch_xla-1.13.1+torchneuronb
Compiler neuronx-cc-2.10.0.35
Kubernetes Plugin aws-neuronx-k8-plugin-2.17.3.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.17.3.0
OCI aws-neuronx-oci-hook-2.2.22.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.1.0
TensorBoard tensorboard-plugin-neuronx-2.5.39.0
PyTorch torch-neuronx-1.13.1.1.11.0
Transformers Neuron transformers-neuronx-0.7.84
Neuron Distributed neuronx_distributed-0.4.0
Inf1 packages#
List of packages in Neuron 2.14.1:
Component Package
Driver aws-neuronx-dkms-2.13.4.0
System Tools aws-neuronx-tools-2.14.6.0
Compiler neuron-cc-1.19.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.17.3.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.17.3.0
OCI aws-neuronx-oci-hook-2.2.22.0
TensorFlow tensorflow-neuron-2.10.1.2.10.1.0
TensorFlow tensorflow-neuron-2.7.4.2.10.1.0
TensorFlow tensorflow-neuron-2.8.4.2.10.1.0
TensorFlow tensorflow-neuron-2.9.3.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.1.0
PyTorch torch-neuron-1.10.2.2.9.1.0
PyTorch torch-neuron-1.11.0.2.9.1.0
PyTorch torch-neuron-1.12.1.2.9.1.0
PyTorch torch-neuron-1.13.1.2.9.1.0
PyTorch torch-neuron-1.9.1.2.9.1.0
MXNet mxnet_neuron-1.5.1.1.10.39.0
MXNet mx_neuron-1.8.0.2.4.10.0
Perf Tools neuronperf-1.8.7.0
Runtime Library libnrt.so (Version 2.12.23.0)
Compiler dmlc_nnvm-1.17.2.0
Compiler dmlc_topi-1.17.2.0
Compiler dmlc_tvm-1.17.2.0
Compiler inferentia_hwm-1.15.2.0
Neuron 2.14.0 (09/15/2023)#
Trn1 packages#
List of packages in Neuron 2.14.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.17.9.0
Driver aws-neuronx-dkms-2.13.4.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.7.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.7.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.17.7.0
System Tools aws-neuronx-tools-2.14.6.0
Framework libneuronxla-0.5.476
Compiler neuronx_hwm-2.10.0.5
PyTorch torch_xla-1.13.1+torchneuronb
Compiler neuronx-cc-2.10.0.34
Kubernetes Plugin aws-neuronx-k8-plugin-2.17.3.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.17.3.0
OCI aws-neuronx-oci-hook-2.2.22.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.1.0
TensorBoard tensorboard-plugin-neuronx-2.5.39.0
PyTorch torch-neuronx-1.13.1.1.11.0
Transformers Neuron transformers-neuronx-0.7.84
Neuron Distributed neuronx_distributed-0.4.0
Inf2 packages#
List of packages in Neuron 2.14.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.17.9.0
Driver aws-neuronx-dkms-2.13.4.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.7.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.7.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.17.7.0
System Tools aws-neuronx-tools-2.14.6.0
Framework libneuronxla-0.5.476
Compiler neuronx_hwm-2.10.0.5
PyTorch torch_xla-1.13.1+torchneuronb
Compiler neuronx-cc-2.10.0.34
Kubernetes Plugin aws-neuronx-k8-plugin-2.17.3.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.17.3.0
OCI aws-neuronx-oci-hook-2.2.22.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.1.0
TensorBoard tensorboard-plugin-neuronx-2.5.39.0
PyTorch torch-neuronx-1.13.1.1.11.0
Transformers Neuron transformers-neuronx-0.7.84
Neuron Distributed neuronx_distributed-0.4.0
Inf1 packages#
List of packages in Neuron 2.14.0:
Component Package
Driver aws-neuronx-dkms-2.13.4.0
System Tools aws-neuronx-tools-2.14.6.0
Compiler neuron-cc-1.19.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.17.3.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.17.3.0
OCI aws-neuronx-oci-hook-2.2.22.0
TensorFlow tensorflow-neuron-2.10.1.2.10.1.0
TensorFlow tensorflow-neuron-2.7.4.2.10.1.0
TensorFlow tensorflow-neuron-2.8.4.2.10.1.0
TensorFlow tensorflow-neuron-2.9.3.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.1.0
PyTorch torch-neuron-1.10.2.2.9.1.0
PyTorch torch-neuron-1.11.0.2.9.1.0
PyTorch torch-neuron-1.12.1.2.9.1.0
PyTorch torch-neuron-1.13.1.2.9.1.0
PyTorch torch-neuron-1.9.1.2.9.1.0
MXNet mxnet_neuron-1.5.1.1.10.39.0
MXNet mx_neuron-1.8.0.2.4.10.0
Perf Tools neuronperf-1.8.7.0
Runtime Library libnrt.so (Version 2.12.23.0)
Compiler dmlc_nnvm-1.17.2.0
Compiler dmlc_topi-1.17.2.0
Compiler dmlc_tvm-1.17.2.0
Compiler inferentia_hwm-1.15.2.0
Neuron 2.13.2 (09/01/2023)#
Trn1 packages#
List of packages in Neuron 2.13.2:
Component Package
Collective Communication Library aws-neuronx-collectives-2.16.16.0
Driver aws-neuronx-dkms-2.12.18.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.6.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.6.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.16.14.0
System Tools aws-neuronx-tools-2.13.4.0
Framework libneuronxla-0.5.440
Compiler neuronx_hwm-2.9.0.2
PyTorch torch_xla-1.13.1+torchneurona
Compiler neuronx-cc-2.9.0.40
Kubernetes Plugin aws-neuronx-k8-plugin-2.16.18.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.16.18.0
OCI aws-neuronx-oci-hook-2.2.25.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.1.0
TensorBoard tensorboard-plugin-neuronx-2.5.39.0
PyTorch torch-neuronx-1.13.1.1.10.1
Transformers Neuron transformers-neuronx-0.6.106
Neuron Distributed neuronx_distributed-0.3.0
Inf2 packages#
List of packages in Neuron 2.13.2:
Component Package
Collective Communication Library aws-neuronx-collectives-2.16.16.0
Driver aws-neuronx-dkms-2.12.18.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.6.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.6.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.16.14.0
System Tools aws-neuronx-tools-2.13.4.0
Framework libneuronxla-0.5.440
Compiler neuronx_hwm-2.9.0.2
PyTorch torch_xla-1.13.1+torchneurona
Compiler neuronx-cc-2.9.0.40
Kubernetes Plugin aws-neuronx-k8-plugin-2.16.18.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.16.18.0
OCI aws-neuronx-oci-hook-2.2.25.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.1.0
TensorBoard tensorboard-plugin-neuronx-2.5.39.0
PyTorch torch-neuronx-1.13.1.1.10.1
Transformers Neuron transformers-neuronx-0.6.106
Neuron Distributed neuronx_distributed-0.3.0
Inf1 packages#
List of packages in Neuron 2.13.2:
Component Package
Driver aws-neuronx-dkms-2.12.18.0
System Tools aws-neuronx-tools-2.13.4.0
Compiler neuron-cc-1.18.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.16.18.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.16.18.0
OCI aws-neuronx-oci-hook-2.2.25.0
TensorFlow tensorflow-neuron-2.10.1.2.10.1.0
TensorFlow tensorflow-neuron-2.7.4.2.10.1.0
TensorFlow tensorflow-neuron-2.8.4.2.10.1.0
TensorFlow tensorflow-neuron-2.9.3.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.1.0
PyTorch torch-neuron-1.10.2.2.9.1.0
PyTorch torch-neuron-1.11.0.2.9.1.0
PyTorch torch-neuron-1.12.1.2.9.1.0
PyTorch torch-neuron-1.13.1.2.9.1.0
PyTorch torch-neuron-1.9.1.2.9.1.0
MXNet mxnet_neuron-1.5.1.1.10.39.0
MXNet mx_neuron-1.8.0.2.4.10.0
Perf Tools neuronperf-1.8.7.0
Runtime Library libnrt.so (Version 2.12.23.0)
Compiler dmlc_nnvm-1.16.1.0
Compiler dmlc_topi-1.16.1.0
Compiler dmlc_tvm-1.16.1.0
Compiler inferentia_hwm-1.15.0.0
Neuron 2.13.1 (08/29/2023)#
Trn1 packages#
List of packages in Neuron 2.13.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.16.8.0
Driver aws-neuronx-dkms-2.12.11.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.6.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.6.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.16.8.0
System Tools aws-neuronx-tools-2.13.4.0
Framework libneuronxla-0.5.425
Compiler neuronx_hwm-2.9.0.2
PyTorch torch_xla-1.13.1+torchneurona
Compiler neuronx-cc-2.9.0.40
Kubernetes Plugin aws-neuronx-k8-plugin-2.16.9.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.16.9.0
OCI aws-neuronx-oci-hook-2.2.21.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.1.0
TensorBoard tensorboard-plugin-neuronx-2.5.39.0
PyTorch torch-neuronx-1.13.1.1.10.0
Transformers Neuron transformers-neuronx-0.6.106
Neuron Distributed neuronx_distributed-0.3.0
Inf2 packages#
List of packages in Neuron 2.13.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.16.8.0
Driver aws-neuronx-dkms-2.12.11.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.6.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.6.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.16.8.0
System Tools aws-neuronx-tools-2.13.4.0
Framework libneuronxla-0.5.425
Compiler neuronx_hwm-2.9.0.2
PyTorch torch_xla-1.13.1+torchneurona
Compiler neuronx-cc-2.9.0.40
Kubernetes Plugin aws-neuronx-k8-plugin-2.16.9.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.16.9.0
OCI aws-neuronx-oci-hook-2.2.21.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.1.0
TensorBoard tensorboard-plugin-neuronx-2.5.39.0
PyTorch torch-neuronx-1.13.1.1.10.0
Transformers Neuron transformers-neuronx-0.6.106
Neuron Distributed neuronx_distributed-0.3.0
Inf1 packages#
List of packages in Neuron 2.13.1:
Component Package
Driver aws-neuronx-dkms-2.12.11.0
System Tools aws-neuronx-tools-2.13.4.0
Compiler neuron-cc-1.18.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.16.9.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.16.9.0
OCI aws-neuronx-oci-hook-2.2.21.0
TensorFlow tensorflow-neuron-2.10.1.2.10.1.0
TensorFlow tensorflow-neuron-2.7.4.2.10.1.0
TensorFlow tensorflow-neuron-2.8.4.2.10.1.0
TensorFlow tensorflow-neuron-2.9.3.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.1.0
PyTorch torch-neuron-1.10.2.2.9.1.0
PyTorch torch-neuron-1.11.0.2.9.1.0
PyTorch torch-neuron-1.12.1.2.9.1.0
PyTorch torch-neuron-1.13.1.2.9.1.0
PyTorch torch-neuron-1.9.1.2.9.1.0
MXNet mxnet_neuron-1.5.1.1.10.39.0
MXNet mx_neuron-1.8.0.2.4.10.0
Perf Tools neuronperf-1.8.7.0
Runtime Library libnrt.so (Version 2.12.23.0)
Compiler dmlc_nnvm-1.16.1.0
Compiler dmlc_topi-1.16.1.0
Compiler dmlc_tvm-1.16.1.0
Compiler inferentia_hwm-1.15.0.0
Neuron 2.13.0 (08/28/2023)#
Trn1 packages#
List of packages in Neuron 2.13.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.16.8.0
Driver aws-neuronx-dkms-2.12.11.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.6.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.6.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.16.8.0
System Tools aws-neuronx-tools-2.13.4.0
Framework libneuronxla-0.5.425
Compiler neuronx_hwm-2.9.0.1
PyTorch torch_xla-1.13.1+torchneurona
Compiler neuronx-cc-2.9.0.16
Kubernetes Plugin aws-neuronx-k8-plugin-2.16.9.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.16.9.0
OCI aws-neuronx-oci-hook-2.2.21.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.1.0
TensorBoard tensorboard-plugin-neuronx-2.5.39.0
PyTorch torch-neuronx-1.13.1.1.10.0
Transformers Neuron transformers-neuronx-0.6.106
Neuron Distributed neuronx_distributed-0.3.0
Inf2 packages#
List of packages in Neuron 2.13.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.16.8.0
Driver aws-neuronx-dkms-2.12.11.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.6.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.6.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.16.8.0
System Tools aws-neuronx-tools-2.13.4.0
Framework libneuronxla-0.5.425
Compiler neuronx_hwm-2.9.0.1
PyTorch torch_xla-1.13.1+torchneurona
Compiler neuronx-cc-2.9.0.16
Kubernetes Plugin aws-neuronx-k8-plugin-2.16.9.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.16.9.0
OCI aws-neuronx-oci-hook-2.2.21.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.1.0
TensorBoard tensorboard-plugin-neuronx-2.5.39.0
PyTorch torch-neuronx-1.13.1.1.10.0
Transformers Neuron transformers-neuronx-0.6.106
Neuron Distributed neuronx_distributed-0.3.0
Inf1 packages#
List of packages in Neuron 2.13.0:
Component Package
Driver aws-neuronx-dkms-2.12.11.0
System Tools aws-neuronx-tools-2.13.4.0
Compiler neuron-cc-1.18.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.16.9.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.16.9.0
OCI aws-neuronx-oci-hook-2.2.21.0
TensorFlow tensorflow-neuron-2.10.1.2.10.1.0
TensorFlow tensorflow-neuron-2.7.4.2.10.1.0
TensorFlow tensorflow-neuron-2.8.4.2.10.1.0
TensorFlow tensorflow-neuron-2.9.3.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.10.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.10.1.0
PyTorch torch-neuron-1.10.2.2.9.1.0
PyTorch torch-neuron-1.11.0.2.9.1.0
PyTorch torch-neuron-1.12.1.2.9.1.0
PyTorch torch-neuron-1.13.1.2.9.1.0
PyTorch torch-neuron-1.9.1.2.9.1.0
MXNet mxnet_neuron-1.5.1.1.10.39.0
MXNet mx_neuron-1.8.0.2.4.10.0
Perf Tools neuronperf-1.8.7.0
Runtime Library libnrt.so (Version 2.12.23.0)
Compiler dmlc_nnvm-1.16.1.0
Compiler dmlc_topi-1.16.1.0
Compiler dmlc_tvm-1.16.1.0
Compiler inferentia_hwm-1.15.0.0
Neuron 2.12.2 (08/20/2023)#
Trn1 packages#
List of packages in Neuron 2.12.2:
Component Package
Collective Communication Library aws-neuronx-collectives-2.15.16.0
Driver aws-neuronx-dkms-2.11.9.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.5.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.5.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.15.14.0
System Tools aws-neuronx-tools-2.12.2.0
Framework libneuronxla-0.5.413
Compiler neuronx_hwm-2.8.0.3
PyTorch torch_xla-1.13.1+torchneuron8
Compiler neuronx-cc-2.8.0.25
Kubernetes Plugin aws-neuronx-k8-plugin-2.15.6.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.15.6.0
OCI aws-neuronx-oci-hook-2.2.16.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.9.3.0
TensorBoard tensorboard-plugin-neuronx-2.5.39.0
PyTorch torch-neuronx-1.13.1.1.9.1
Transformers Neuron transformers-neuronx-0.5.58
Neuron Distributed neuronx_distributed-0.2.0
Inf2 packages#
List of packages in Neuron 2.12.2:
Component Package
Collective Communication Library aws-neuronx-collectives-2.15.16.0
Driver aws-neuronx-dkms-2.11.9.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.5.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.5.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.15.14.0
System Tools aws-neuronx-tools-2.12.2.0
Framework libneuronxla-0.5.413
Compiler neuronx_hwm-2.8.0.3
PyTorch torch_xla-1.13.1+torchneuron8
Compiler neuronx-cc-2.8.0.25
Kubernetes Plugin aws-neuronx-k8-plugin-2.15.6.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.15.6.0
OCI aws-neuronx-oci-hook-2.2.16.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.9.3.0
TensorBoard tensorboard-plugin-neuronx-2.5.39.0
PyTorch torch-neuronx-1.13.1.1.9.1
Transformers Neuron transformers-neuronx-0.5.58
Neuron Distributed neuronx_distributed-0.2.0
Inf1 packages#
List of packages in Neuron 2.12.2:
Component Package
Driver aws-neuronx-dkms-2.11.9.0
System Tools aws-neuronx-tools-2.12.2.0
Compiler neuron-cc-1.17.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.15.6.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.15.6.0
OCI aws-neuronx-oci-hook-2.2.16.0
TensorFlow tensorflow-neuron-1.15.5.2.9.3.0
TensorFlow tensorflow-neuron-2.10.1.2.9.3.0
TensorFlow tensorflow-neuron-2.7.4.2.9.3.0
TensorFlow tensorflow-neuron-2.8.4.2.9.3.0
TensorFlow tensorflow-neuron-2.9.3.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.9.3.0
PyTorch torch-neuron-1.10.2.2.8.9.0
PyTorch torch-neuron-1.11.0.2.8.9.0
PyTorch torch-neuron-1.12.1.2.8.9.0
PyTorch torch-neuron-1.13.1.2.8.9.0
PyTorch torch-neuron-1.9.1.2.8.9.0
MXNet mxnet_neuron-1.5.1.1.10.39.0
MXNet mx_neuron-1.8.0.2.4.10.0
Perf Tools neuronperf-1.8.7.0
Runtime Library libnrt.so (Version 2.12.23.0)
Compiler dmlc_nnvm-1.16.1.0
Compiler dmlc_topi-1.16.1.0
Compiler dmlc_tvm-1.16.1.0
Compiler inferentia_hwm-1.14.4.0
Neuron 2.12.1 (08/09/2023)#
Trn1 packages#
List of packages in Neuron 2.12.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.15.16.0
Driver aws-neuronx-dkms-2.11.9.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.5.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.5.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.15.14.0
System Tools aws-neuronx-tools-2.12.2.0
Framework libneuronxla-0.5.413
Compiler neuronx_hwm-2.8.0.3
PyTorch torch_xla-1.13.1+torchneuron8
Compiler neuronx-cc-2.8.0.25
Kubernetes Plugin aws-neuronx-k8-plugin-2.15.6.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.15.6.0
OCI aws-neuronx-oci-hook-2.2.16.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.9.3.0
TensorBoard tensorboard-plugin-neuronx-2.5.39.0
PyTorch torch-neuronx-1.13.1.1.9.0
Transformers Neuron transformers-neuronx-0.5.58
Neuron Distributed neuronx_distributed-0.2.0
Inf2 packages#
List of packages in Neuron 2.12.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.15.16.0
Driver aws-neuronx-dkms-2.11.9.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.5.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.5.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.15.14.0
System Tools aws-neuronx-tools-2.12.2.0
Framework libneuronxla-0.5.413
Compiler neuronx_hwm-2.8.0.3
PyTorch torch_xla-1.13.1+torchneuron8
Compiler neuronx-cc-2.8.0.25
Kubernetes Plugin aws-neuronx-k8-plugin-2.15.6.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.15.6.0
OCI aws-neuronx-oci-hook-2.2.16.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.9.3.0
TensorBoard tensorboard-plugin-neuronx-2.5.39.0
PyTorch torch-neuronx-1.13.1.1.9.0
Transformers Neuron transformers-neuronx-0.5.58
Neuron Distributed neuronx_distributed-0.2.0
Inf1 packages#
List of packages in Neuron 2.12.1:
Component Package
Driver aws-neuronx-dkms-2.11.9.0
System Tools aws-neuronx-tools-2.12.2.0
Compiler neuron-cc-1.17.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.15.6.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.15.6.0
OCI aws-neuronx-oci-hook-2.2.16.0
TensorFlow tensorflow-neuron-1.15.5.2.9.3.0
TensorFlow tensorflow-neuron-2.10.1.2.9.3.0
TensorFlow tensorflow-neuron-2.7.4.2.9.3.0
TensorFlow tensorflow-neuron-2.8.4.2.9.3.0
TensorFlow tensorflow-neuron-2.9.3.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.9.3.0
PyTorch torch-neuron-1.10.2.2.8.9.0
PyTorch torch-neuron-1.11.0.2.8.9.0
PyTorch torch-neuron-1.12.1.2.8.9.0
PyTorch torch-neuron-1.13.1.2.8.9.0
PyTorch torch-neuron-1.9.1.2.8.9.0
MXNet mxnet_neuron-1.5.1.1.10.39.0
MXNet mx_neuron-1.8.0.2.4.10.0
Perf Tools neuronperf-1.8.7.0
Runtime Library libnrt.so (Version 2.12.23.0)
Compiler dmlc_nnvm-1.16.1.0
Compiler dmlc_topi-1.16.1.0
Compiler dmlc_tvm-1.16.1.0
Compiler inferentia_hwm-1.14.4.0
Neuron 2.12.0 (07/19/2023)#
Trn1 packages#
List of packages in Neuron 2.12.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.15.13.0
Driver aws-neuronx-dkms-2.11.9.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.5.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.5.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.15.11.0
System Tools aws-neuronx-tools-2.12.2.0
Framework libneuronxla-0.5.391
Compiler neuronx_hwm-2.8.0.3
PyTorch torch_xla-1.13.1+torchneuron8
Compiler neuronx-cc-2.8.0.25
Kubernetes Plugin aws-neuronx-k8-plugin-2.15.6.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.15.6.0
OCI aws-neuronx-oci-hook-2.2.16.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.9.3.0
TensorBoard tensorboard-plugin-neuronx-2.5.39.0
PyTorch torch-neuronx-1.13.1.1.9.0
Transformers Neuron transformers-neuronx-0.5.58
Neuron Distributed neuronx_distributed-0.2.0
Inf2 packages#
List of packages in Neuron 2.12.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.15.13.0
Driver aws-neuronx-dkms-2.11.9.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.5.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.5.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.15.11.0
System Tools aws-neuronx-tools-2.12.2.0
Framework libneuronxla-0.5.391
Compiler neuronx_hwm-2.8.0.3
PyTorch torch_xla-1.13.1+torchneuron8
Compiler neuronx-cc-2.8.0.25
Kubernetes Plugin aws-neuronx-k8-plugin-2.15.6.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.15.6.0
OCI aws-neuronx-oci-hook-2.2.16.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.9.3.0
TensorBoard tensorboard-plugin-neuronx-2.5.39.0
PyTorch torch-neuronx-1.13.1.1.9.0
Transformers Neuron transformers-neuronx-0.5.58
Neuron Distributed neuronx_distributed-0.2.0
Inf1 packages#
List of packages in Neuron 2.12.0:
Component Package
Driver aws-neuronx-dkms-2.11.9.0
System Tools aws-neuronx-tools-2.12.2.0
Compiler neuron-cc-1.17.0.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.15.6.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.15.6.0
OCI aws-neuronx-oci-hook-2.2.16.0
TensorFlow tensorflow-neuron-1.15.5.2.9.3.0
TensorFlow tensorflow-neuron-2.10.1.2.9.3.0
TensorFlow tensorflow-neuron-2.7.4.2.9.3.0
TensorFlow tensorflow-neuron-2.8.4.2.9.3.0
TensorFlow tensorflow-neuron-2.9.3.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.9.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.9.3.0
PyTorch torch-neuron-1.10.2.2.8.9.0
PyTorch torch-neuron-1.11.0.2.8.9.0
PyTorch torch-neuron-1.12.1.2.8.9.0
PyTorch torch-neuron-1.13.1.2.8.9.0
PyTorch torch-neuron-1.9.1.2.8.9.0
MXNet mxnet_neuron-1.5.1.1.10.39.0
MXNet mx_neuron-1.8.0.2.4.10.0
Perf Tools neuronperf-1.8.7.0
Runtime Library libnrt.so (Version 2.12.23.0)
Compiler dmlc_nnvm-1.16.1.0
Compiler dmlc_topi-1.16.1.0
Compiler dmlc_tvm-1.16.1.0
Compiler inferentia_hwm-1.14.4.0
Neuron 2.11.0 (06/14/2023)#
Trn1 packages#
List of packages in Neuron 2.11.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.14.9.0
Driver aws-neuronx-dkms-2.10.11.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.4.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.4.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.14.8.0
System Tools aws-neuronx-tools-2.11.10.0
Framework libneuronxla-0.5.326
Compiler neuronx_hwm-2.7.0.3
PyTorch torch_xla-1.13.1+torchneuron7
Compiler neuronx-cc-2.7.0.40
Kubernetes Plugin aws-neuronx-k8-plugin-2.14.4.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.14.4.0
OCI aws-neuronx-oci-hook-2.2.9.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.8.9.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.8.9.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.8.9.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.8.9.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.8.9.0
TensorBoard tensorboard-plugin-neuronx-2.5.37.0
PyTorch torch-neuronx-1.13.1.1.8.0
Transformers Neuron transformers-neuronx-0.4.60
nan islpy-2021.1+aws2021.x.169.0
Neuron Distributed neuronx_distributed-0.1.0
Inf2 packages#
List of packages in Neuron 2.11.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.14.9.0
Driver aws-neuronx-dkms-2.10.11.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.4.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.4.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.14.8.0
System Tools aws-neuronx-tools-2.11.10.0
Framework libneuronxla-0.5.326
Compiler neuronx_hwm-2.7.0.3
PyTorch torch_xla-1.13.1+torchneuron7
Compiler neuronx-cc-2.7.0.40
Kubernetes Plugin aws-neuronx-k8-plugin-2.14.4.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.14.4.0
OCI aws-neuronx-oci-hook-2.2.9.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.8.9.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.8.9.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.8.9.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.8.9.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.8.9.0
TensorBoard tensorboard-plugin-neuronx-2.5.37.0
PyTorch torch-neuronx-1.13.1.1.8.0
Transformers Neuron transformers-neuronx-0.4.60
nan islpy-2021.1+aws2021.x.169.0
Neuron Distributed neuronx_distributed-0.1.0
Inf1 packages#
List of packages in Neuron 2.11.0:
Component Package
Driver aws-neuronx-dkms-2.10.11.0
System Tools aws-neuronx-tools-2.11.10.0
Compiler neuron-cc-1.16.2.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.14.4.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.14.4.0
OCI aws-neuronx-oci-hook-2.2.9.0
TensorFlow tensorflow-neuron-1.15.5.2.8.9.0
TensorFlow tensorflow-neuron-2.10.1.2.8.9.0
TensorFlow tensorflow-neuron-2.7.4.2.8.9.0
TensorFlow tensorflow-neuron-2.8.4.2.8.9.0
TensorFlow tensorflow-neuron-2.9.3.2.8.9.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.8.9.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.8.9.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.8.9.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.8.9.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.8.9.0
PyTorch torch-neuron-1.10.2.2.7.10.0
PyTorch torch-neuron-1.11.0.2.7.10.0
PyTorch torch-neuron-1.12.1.2.7.10.0
PyTorch torch-neuron-1.13.1.2.7.10.0
PyTorch torch-neuron-1.9.1.2.7.10.0
MXNet mxnet_neuron-1.5.1.1.10.39.0
MXNet mx_neuron-1.8.0.2.4.9.0
Perf Tools neuronperf-1.8.6.0
Runtime Library libnrt.so (Version 2.12.23.0)
Compiler dmlc_nnvm-1.16.0.0
Compiler dmlc_topi-1.16.0.0
Compiler dmlc_tvm-1.16.0.0
Compiler inferentia_hwm-1.14.2.0
nan islpy-2021.1+aws2021.x.169.0
Neuron 2.10.0 (05/01/2023)#
Trn1 packages#
List of packages in Neuron 2.10.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.13.7.0
Driver aws-neuronx-dkms-2.9.4.0
nan aws-neuronx-gpsimd-customop-0.3.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.3.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.13.6.0
System Tools aws-neuronx-tools-2.10.1.0
Framework libneuronxla-0.5.207
Compiler neuronx_hwm-2.6.0.0
PyTorch torch_xla-1.13.1
Compiler neuronx-cc-2.6.0.19
Kubernetes Plugin aws-neuronx-k8-plugin-2.13.4.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.13.4.0
OCI aws-neuronx-oci-hook-2.2.0.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.8.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.8.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.8.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.8.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.8.1.0
TensorBoard tensorboard-plugin-neuronx-2.5.26.0
PyTorch torch-neuronx-1.13.1.1.7.0
Transformers Neuron transformers-neuronx-0.3.32
nan islpy-2021.1
Inf2 packages#
List of packages in Neuron 2.10.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.13.7.0
Driver aws-neuronx-dkms-2.9.4.0
nan aws-neuronx-gpsimd-customop-0.3.1.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.3.0.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.13.6.0
System Tools aws-neuronx-tools-2.10.1.0
Framework libneuronxla-0.5.207
Compiler neuronx_hwm-2.6.0.0
PyTorch torch_xla-1.13.1
Compiler neuronx-cc-2.6.0.19
Kubernetes Plugin aws-neuronx-k8-plugin-2.13.4.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.13.4.0
OCI aws-neuronx-oci-hook-2.2.0.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
TensorFlow tensorflow-neuronx-2.7.4.2.1.0
TensorFlow tensorflow-neuronx-2.8.4.2.1.0
TensorFlow tensorflow-neuronx-2.9.3.2.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.8.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.8.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.8.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.8.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.8.1.0
TensorBoard tensorboard-plugin-neuronx-2.5.26.0
PyTorch torch-neuronx-1.13.1.1.7.0
Transformers Neuron transformers-neuronx-0.3.32
nan islpy-2021.1
Inf1 packages#
List of packages in Neuron 2.10.0:
Component Package
Driver aws-neuronx-dkms-2.9.4.0
System Tools aws-neuronx-tools-2.10.1.0
Compiler neuron-cc-1.15.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.13.4.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.13.4.0
OCI aws-neuronx-oci-hook-2.2.0.0
TensorFlow tensorflow-neuron-1.15.5.2.8.1.0
TensorFlow tensorflow-neuron-2.10.1.2.8.1.0
TensorFlow tensorflow-neuron-2.7.4.2.8.1.0
TensorFlow tensorflow-neuron-2.8.4.2.8.1.0
TensorFlow tensorflow-neuron-2.9.3.2.8.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.8.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.8.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.8.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.8.1.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.8.1.0
PyTorch torch-neuron-1.10.2.2.7.1.0
PyTorch torch-neuron-1.11.0.2.7.1.0
PyTorch torch-neuron-1.12.1.2.7.1.0
PyTorch torch-neuron-1.13.1.2.7.1.0
PyTorch torch-neuron-1.9.1.2.7.1.0
MXNet mxnet_neuron-1.5.1.1.10.39.0
MXNet mx_neuron-1.8.0.2.4.1.0
Perf Tools neuronperf-1.8.0.0
Runtime Library libnrt.so (Version 2.12.23.0)
Compiler dmlc_nnvm-1.15.0.0
Compiler dmlc_topi-1.15.0.0
Compiler dmlc_tvm-1.15.0.0
Compiler inferentia_hwm-1.14.1
nan islpy-2021.1
Neuron 2.9.1 (04/19/2023)#
Trn1 packages#
List of packages in Neuron 2.9.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.12.35.0
Driver aws-neuronx-dkms-2.8.4.0
nan aws-neuronx-gpsimd-customop-0.2.3.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.2.1.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.12.23.0
System Tools aws-neuronx-tools-2.9.5.0
Framework libneuronxla-0.5.205
Compiler neuronx_hwm-2.5.0.0
PyTorch torch_xla-1.13.0
Compiler neuronx-cc-2.5.0.28
Kubernetes Plugin aws-neuronx-k8-plugin-2.12.5.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.12.5.0
OCI Hooks aws-neuronx-oci-hooks-2.1.97.0
TensorFlow tensorflow-neuronx-2.10.1.2.0.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.7.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.7.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.7.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.7.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.7.4.0
TensorBoard tensorboard-plugin-neuronx-2.5.25.0
PyTorch torch-neuronx-1.13.0.1.6.1
Inf2 packages#
List of packages in Neuron 2.9.1:
Component Package
Collective Communication Library aws-neuronx-collectives-2.12.35.0
Driver aws-neuronx-dkms-2.8.4.0
nan aws-neuronx-gpsimd-customop-0.2.3.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.2.1.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.12.23.0
System Tools aws-neuronx-tools-2.9.5.0
Framework libneuronxla-0.5.205
Compiler neuronx_hwm-2.5.0.0
PyTorch torch_xla-1.13.0
Compiler neuronx-cc-2.5.0.28
Kubernetes Plugin aws-neuronx-k8-plugin-2.12.5.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.12.5.0
OCI Hooks aws-neuronx-oci-hooks-2.1.97.0
TensorFlow tensorflow-neuronx-2.10.1.2.0.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.7.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.7.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.7.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.7.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.7.4.0
TensorBoard tensorboard-plugin-neuronx-2.5.25.0
PyTorch torch-neuronx-1.13.0.1.6.1
Inf1 packages#
List of packages in Neuron 2.9.1:
Component Package
Driver aws-neuronx-dkms-2.8.4.0
System Tools aws-neuronx-tools-2.9.5.0
Compiler neuron-cc-1.14.3.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.12.5.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.12.5.0
OCI Hooks aws-neuronx-oci-hooks-2.1.97.0
TensorFlow tensorflow-neuron-1.15.5.2.7.4.0
TensorFlow tensorflow-neuron-2.10.1.2.7.4.0
TensorFlow tensorflow-neuron-2.7.4.2.7.4.0
TensorFlow tensorflow-neuron-2.8.4.2.7.4.0
TensorFlow tensorflow-neuron-2.9.3.2.7.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.7.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.7.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.7.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.7.4.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.7.4.0
PyTorch torch-neuron-1.10.2.2.6.6.0
PyTorch torch-neuron-1.11.0.2.6.6.0
PyTorch torch-neuron-1.12.1.2.6.6.0
PyTorch torch-neuron-1.13.1.2.6.6.0
PyTorch torch-neuron-1.9.1.2.6.6.0
MXNet mxnet_neuron-1.5.1.1.10.37.0
MXNet mx_neuron-1.8.0.2.2.127.0
Perf Tools neuronperf-1.7.1.0
Runtime Library libnrt.so (Version 2.12.16.0)
Neuron 2.9.0 (03/28/2023)#
Trn1 packages#
List of packages in Neuron 2.9.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.12.27.0
Driver aws-neuronx-dkms-2.8.4.0
nan aws-neuronx-gpsimd-customop-0.2.3.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.2.1.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.12.16.0
System Tools aws-neuronx-tools-2.9.5.0
Framework libneuronxla-0.5.173
Compiler neuronx_hwm-2.5.0.0
PyTorch torch_xla-1.13.0
Compiler neuronx-cc-2.5.0.28
Kubernetes Plugin aws-neuronx-k8-plugin-2.12.5.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.12.5.0
OCI Hooks aws-neuronx-oci-hooks-2.1.97.0
TensorFlow tensorflow-neuronx-2.10.1.2.0.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.7.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.7.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.7.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.7.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.7.3.0
TensorBoard tensorboard-plugin-neuronx-2.5.25.0
PyTorch torch-neuronx-1.13.0.1.6.0
Inf2 packages#
List of packages in Neuron 2.9.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.12.27.0
Driver aws-neuronx-dkms-2.8.4.0
nan aws-neuronx-gpsimd-customop-0.2.3.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.2.1.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.12.16.0
System Tools aws-neuronx-tools-2.9.5.0
Framework libneuronxla-0.5.173
Compiler neuronx_hwm-2.5.0.0
PyTorch torch_xla-1.13.0
Compiler neuronx-cc-2.5.0.28
Kubernetes Plugin aws-neuronx-k8-plugin-2.12.5.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.12.5.0
OCI Hooks aws-neuronx-oci-hooks-2.1.97.0
TensorFlow tensorflow-neuronx-2.10.1.2.0.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.7.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.7.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.7.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.7.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.7.3.0
TensorBoard tensorboard-plugin-neuronx-2.5.25.0
PyTorch torch-neuronx-1.13.0.1.6.0
Inf1 packages#
List of packages in Neuron 2.9.0:
Component Package
Driver aws-neuronx-dkms-2.8.4.0
System Tools aws-neuronx-tools-2.9.5.0
Compiler neuron-cc-1.14.3.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.12.5.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.12.5.0
OCI Hooks aws-neuronx-oci-hooks-2.1.97.0
TensorFlow tensorflow-neuron-1.15.5.2.7.3.0
TensorFlow tensorflow-neuron-2.10.1.2.7.3.0
TensorFlow tensorflow-neuron-2.7.4.2.7.3.0
TensorFlow tensorflow-neuron-2.8.4.2.7.3.0
TensorFlow tensorflow-neuron-2.9.3.2.7.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.7.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.7.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.7.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.7.3.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.7.3.0
PyTorch torch-neuron-1.10.2.2.6.5.0
PyTorch torch-neuron-1.11.0.2.6.5.0
PyTorch torch-neuron-1.12.1.2.6.5.0
PyTorch torch-neuron-1.13.1.2.6.5.0
PyTorch torch-neuron-1.9.1.2.6.5.0
MXNet mxnet_neuron-1.5.1.1.10.37.0
MXNet mx_neuron-1.8.0.2.2.127.0
Perf Tools neuronperf-1.7.1.0
Runtime Library libnrt.so (Version 2.12.16.0)
Neuron 2.8.0 (02/24/2023)#
Trn1 packages#
List of packages in Neuron 2.8.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.11.47.0
Driver aws-neuronx-dkms-2.7.33.0
nan aws-neuronx-gpsimd-customop-0.1.23.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.1.7.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.11.43.0
System Tools aws-neuronx-tools-2.8.2.0
Framework libneuronxla-0.5.144
Compiler neuronx_hwm-2.4.0.1
PyTorch torch_xla-1.13.0
Compiler neuronx-cc-2.4.0.21
Kubernetes Plugin aws-neuronx-k8-plugin-2.1.12.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.1.12.0
OCI Hooks aws-neuronx-oci-hooks-2.1.81.0
TensorFlow tensorflow-neuronx-2.10.1.1.0.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.6.5.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.6.5.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.6.5.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.6.5.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.6.5.0
TensorBoard tensorboard-plugin-neuronx-2.5.19.0
PyTorch torch-neuronx-1.13.0.1.5.0
Inf2 packages#
List of packages in Neuron 2.8.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.11.47.0
Driver aws-neuronx-dkms-2.7.33.0
nan aws-neuronx-gpsimd-customop-0.1.23.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.1.7.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.11.43.0
System Tools aws-neuronx-tools-2.8.2.0
Framework libneuronxla-0.5.144
Compiler neuronx_hwm-2.4.0.1
PyTorch torch_xla-1.13.0
Compiler neuronx-cc-2.4.0.21
Kubernetes Plugin aws-neuronx-k8-plugin-2.1.12.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.1.12.0
OCI Hooks aws-neuronx-oci-hooks-2.1.81.0
TensorFlow tensorflow-neuronx-2.10.1.1.0.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.6.5.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.6.5.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.6.5.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.6.5.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.6.5.0
TensorBoard tensorboard-plugin-neuronx-2.5.19.0
PyTorch torch-neuronx-1.13.0.1.5.0
Inf1 packages#
List of packages in Neuron 2.8.0:
Component Package
Driver aws-neuronx-dkms-2.7.33.0
System Tools aws-neuronx-tools-2.8.2.0
Compiler neuron-cc-1.13.5.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.1.12.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.1.12.0
OCI Hooks aws-neuronx-oci-hooks-2.1.81.0
TensorFlow tensorflow-neuron-1.15.5.2.6.5.0
TensorFlow tensorflow-neuron-2.7.4.2.6.5.0
TensorFlow tensorflow-neuron-2.8.4.2.6.5.0
TensorFlow tensorflow-neuron-2.9.3.2.6.5.0
TensorFlow tensorflow-neuron-2.10.1.2.6.5.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.6.5.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.4.2.6.5.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.6.5.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.6.5.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.6.5.0
TensorBoard tensorboard-plugin-neuron-2.4.6.0
PyTorch torch-neuron-1.11.0.2.5.8.0
PyTorch torch-neuron-1.12.1.2.5.8.0
PyTorch torch-neuron-1.10.2.2.5.8.0
PyTorch torch-neuron-1.9.1.2.5.8.0
MXNet mxnet_neuron-1.5.1.1.10.11.0
MXNet mx_neuron-1.8.0.2.2.43.0
Perf Tools neuronperf-1.6.1.0
Runtime Library libnrt.so (Version 2.10.30.0)
Neuron 2.7.0 (02/08/2023)#
Trn1 packages#
List of packages in Neuron 2.7.0:
Component Package
Compiler neuronx-cc-2.4.0.21
Kubernetes Plugin aws-neuronx-k8-plugin-2.1.12.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.1.12.0
OCI Hooks aws-neuronx-oci-hooks-2.1.60.0
TensorFlow tensorflow-neuronx-2.8.2.1.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-1.15.0.2.5.6.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.5.4.2.5.6.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.6.3.2.5.6.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.7.0.2.5.6.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.0.2.5.6.0
TensorBoard tensorboard-plugin-neuronx-2.5.15.0
nan neuronx-gpsimd-customop-0.1.23.0
nan neuronx-gpsimd-tools-0.1.7.0
PyTorch torch-neuronx-1.13.0.1.4.0
nan torch-xla-1.13.0
Driver aws-neuronx-dkms-2.7.15.0
Collective Communication Library aws-neuronx-collectives-2.11.47.0
Runtime Library aws-neuronx-runtime-lib-2.11.43.0
System Tools aws-neuronx-tools-2.7.2.0
Inf1 packages#
List of Neuron packages included in Neuron release version 2.7.0:
driver : aws-neuronx-dkms-2.7.15.0 libnrt : libnrt.so (version 2.10.27.0) k8-plugin : aws-neuronx-k8-plugin-2.1.12.0 k8-scheduler : aws-neuronx-k8-scheduler-2.1.12.0 tools : aws-neuronx-tools-2.7.2.0 compiler : neuron-cc-1.13.5.0 neuronperf : neuronperf-1.6.1.0 pytorch : torch-neuron-1.7.1.2.5.8.0 pytorch : torch-neuron-1.8.1.2.5.8.0 pytorch : torch-neuron-1.9.1.2.5.8.0 pytorch : torch-neuron-1.10.2.2.5.8.0 pytorch : torch-neuron-1.11.0.2.5.8.0 pytorch : torch-neuron-1.12.1.2.5.8.0 tensorflow : tensorflow-neuron-1.15.5.2.5.6.0 tensorflow : tensorflow-neuron-2.5.3.2.5.6.0 tensorflow : tensorflow-neuron-2.6.5.2.5.6.0 tensorflow : tensorflow-neuron-2.7.3.2.5.6.0 tensorflow : tensorflow-neuron-2.8.2.2.5.6.0 tensorflow-model-server : tensorflow-model-server-neuronx-1.15.0.2.5.6.0 tensorflow-model-server : tensorflow-model-server-neuronx-2.5.4.2.5.6.0 tensorflow-model-server : tensorflow-model-server-neuronx-2.6.3.2.5.6.0 tensorflow-model-server : tensorflow-model-server-neuronx-2.7.0.2.5.6.0 tensorflow-model-server : tensorflow-model-server-neuronx-2.8.0.2.5.6.0 tensorboard : tensorboard-plugin-neuron-2.4.6.0 mxnet : mxnet_neuron-1.5.1.1.10.11.0 mxnet : mx_neuron-1.8.0.2.2.43.0
Neuron 2.6.0 (12/12/2022)#
Trn1 packages#
aws-neuronx-dkms-2.6.33.0aws-neuronx-oci-hook-2.1.14.0aws-neuronx-runtime-lib-2.10.30.0aws-neuronx-collectives-2.10.37.0aws-neuronx-tools-2.6.1.0aws-neuronx-k8-plugin-2.1.12.0aws-neuronx-k8-scheduler-2.1.12.0tensorboard_plugin_neuronx-2.5.3.0neuronx-cc-2.3.0.4torch-neuronx-1.12.0.1.4.0tensorflow-model-server-neuronx_1.15.0.2.5.6.0tensorflow-model-server-neuronx_2.5.4.2.5.6.0tensorflow-model-server-neuronx_2.6.3.2.5.6.0tensorflow-model-server-neuronx_2.7.0.2.5.6.0tensorflow-model-server-neuronx_2.8.0.2.5.6.0
Inf1 packages#
List of Neuron packages included in Neuron release version 2.6.0:
driver : aws-neuronx-dkms-2.6.33.0 libnrt : libnrt.so (version 2.10.27.0) k8-plugin : aws-neuronx-k8-plugin-2.1.12.0 k8-scheduler : aws-neuronx-k8-scheduler-2.1.12.0 tools : aws-neuronx-tools-2.6.1.0 compiler : neuron-cc-1.13.5.0 neuronperf : neuronperf-1.6.1.0 pytorch : torch-neuron-1.7.1.2.5.8.0 pytorch : torch-neuron-1.8.1.2.5.8.0 pytorch : torch-neuron-1.9.1.2.5.8.0 pytorch : torch-neuron-1.10.2.2.5.8.0 pytorch : torch-neuron-1.11.0.2.5.8.0 pytorch : torch-neuron-1.12.1.2.5.8.0 tensorflow : tensorflow-neuron-1.15.5.2.5.6.0 tensorflow : tensorflow-neuron-2.5.3.2.5.6.0 tensorflow : tensorflow-neuron-2.6.5.2.5.6.0 tensorflow : tensorflow-neuron-2.7.3.2.5.6.0 tensorflow : tensorflow-neuron-2.8.2.2.5.6.0 tensorflow-model-server : tensorflow-model-server-neuronx-1.15.0.2.5.6.0 tensorflow-model-server : tensorflow-model-server-neuronx-2.5.4.2.5.6.0 tensorflow-model-server : tensorflow-model-server-neuronx-2.6.3.2.5.6.0 tensorflow-model-server : tensorflow-model-server-neuronx-2.7.0.2.5.6.0 tensorflow-model-server : tensorflow-model-server-neuronx-2.8.0.2.5.6.0 tensorboard : tensorboard-plugin-neuron-2.4.6.0 mxnet : mxnet_neuron-1.5.1.1.10.11.0 mxnet : mx_neuron-1.8.0.2.2.43.0
Neuron 2.5.0 (11/23/2022)#
Trn1 packages#
aws-neuronx-dkms-2.6.33.0aws-neuronx-oci-hook-2.1.14.0aws-neuronx-runtime-lib-2.10.27.0aws-neuronx-collectives-2.10.34.0aws-neuronx-tools-2.5.19.0aws-neuronx-k8-plugin-2.1.12.0aws-neuronx-k8-scheduler-2.1.12.0neuronx-cc-2.2.0.73torch-neuronx-1.11.0.1.2.0tensorflow-model-server-neuronx_1.15.0.2.5.6.0tensorflow-model-server-neuronx_2.5.4.2.5.6.0tensorflow-model-server-neuronx_2.6.3.2.5.6.0tensorflow-model-server-neuronx_2.7.0.2.5.6.0tensorflow-model-server-neuronx_2.8.0.2.5.6.0
Inf1 packages#
List of Neuron packages included in Neuron release version 2.5.0:
driver : aws-neuronx-dkms-2.6.33.0 libnrt : libnrt.so (version 2.10.27.0) k8-plugin : aws-neuronx-k8-plugin-2.1.12.0 k8-scheduler : aws-neuronx-k8-scheduler-2.1.12.0 tools : aws-neuronx-tools-2.5.19.0 compiler : neuron-cc-1.13.5.0 neuronperf : neuronperf-1.6.1.0 pytorch : torch-neuron-1.7.1.2.5.8.0 pytorch : torch-neuron-1.8.1.2.5.8.0 pytorch : torch-neuron-1.9.1.2.5.8.0 pytorch : torch-neuron-1.10.2.2.5.8.0 pytorch : torch-neuron-1.11.0.2.5.8.0 pytorch : torch-neuron-1.12.1.2.5.8.0 tensorflow : tensorflow-neuron-1.15.5.2.5.6.0 tensorflow : tensorflow-neuron-2.5.3.2.5.6.0 tensorflow : tensorflow-neuron-2.6.5.2.5.6.0 tensorflow : tensorflow-neuron-2.7.3.2.5.6.0 tensorflow : tensorflow-neuron-2.8.2.2.5.6.0 tensorflow-model-server : tensorflow-model-server-neuronx-1.15.0.2.5.6.0 tensorflow-model-server : tensorflow-model-server-neuronx-2.5.4.2.5.6.0 tensorflow-model-server : tensorflow-model-server-neuronx-2.6.3.2.5.6.0 tensorflow-model-server : tensorflow-model-server-neuronx-2.7.0.2.5.6.0 tensorflow-model-server : tensorflow-model-server-neuronx-2.8.0.2.5.6.0 tensorboard : tensorboard-plugin-neuron-2.4.6.0 mxnet : mxnet_neuron-1.5.1.1.10.11.0 mxnet : mx_neuron-1.8.0.2.2.43.0
Neuron 2.4.0 (10/27/2022)#
Trn1 packages#
aws-neuronx-dkms-2.6.5.0aws-neuronx-oci-hook-2.1.1.0aws-neuronx-runtime-lib-2.10.15.0aws-neuronx-collectives-2.10.17.0aws-neuronx-tools-2.5.16.0aws-neuronx-k8-plugin-2.1.2.0aws-neuronx-k8-scheduler-2.1.2.0neuronx-cc-2.2.0.73torch-neuronx-1.11.0.1.2.0
Inf1 packages#
List of Neuron packages included in Neuron release version 2.4.0:
driver : aws-neuronx-dkms-2.6.5.0 libnrt : libnrt.so (version 2.2.51.0) k8-plugin : aws-neuronx-k8-plugin-2.1.2.0 k8-scheduler : aws-neuronx-k8-scheduler-2.1.2.0 tools : aws-neuron-tools-2.5.16.0 compiler : neuron-cc-1.11.7.0 neuronperf : neuronperf-1.3.0.0 pytorch : torch-neuron-1.7.1.2.3.0.0 pytorch : torch-neuron-1.8.1.2.3.0.0 pytorch : torch-neuron-1.9.1.2.3.0.0 pytorch : torch-neuron-1.10.2.2.3.0.0 pytorch : torch-neuron-1.11.0.2.3.0.0 tensorflow : tensorflow-neuron-1.15.5.2.3.0.0 tensorflow : tensorflow-neuron-2.5.3.2.3.0.0 tensorflow : tensorflow-neuron-2.6.3.2.3.0.0 tensorflow : tensorflow-neuron-2.7.1.2.3.0.0 tensorflow : tensorflow-neuron-2.8.0.2.3.0.0 tensorflow-model-server : tensorflow-model-server-neuron-1.15.0.2.3.0.0 tensorflow-model-server : tensorflow-model-server-neuron-2.5.4.2.3.0.0 tensorflow-model-server : tensorflow-model-server-neuron-2.6.3.2.3.0.0 tensorflow-model-server : tensorflow-model-server-neuron-2.7.0.2.3.0.0 tensorflow-model-server : tensorflow-model-server-neuron-2.8.0.2.3.0.0 tensorboard : tensorboard-plugin-neuron-2.4.0.0 mxnet : mxnet_neuron-1.5.1.1.10.0.0 mxnet : mx_neuron-1.8.0.2.2.2.0
Neuron 2.3.0 (10/10/2022)#
Trn1 packages#
aws-neuronx-dkms-2.5.41.0aws-neuronx-oci-hook-2.0.16.0aws-neuronx-runtime-lib-2.9.64.0aws-neuronx-collectives-2.9.86.0aws-neuronx-tools-2.4.14.0aws-neuronx-k8-plugin-2.0.1.0aws-neuronx-k8-scheduler-2.0.1.0neuronx-cc-2.1.0.76torch-neuronx-1.11.0.1.1.1
Inf1 packages#
List of Neuron packages included in Neuron release version 2.3.0:
driver : aws-neuronx-dkms-2.5.41.0 libnrt : libnrt.so (version 2.2.51.0) k8-plugin : aws-neuronx-k8-plugin-2.0.1.0 k8-scheduler : aws-neuronx-k8-scheduler-2.0.1.0 tools : aws-neuron-tools-2.1.4.0 compiler : neuron-cc-1.11.7.0 neuronperf : neuronperf-1.3.0.0 pytorch : torch-neuron-1.7.1.2.3.0.0 pytorch : torch-neuron-1.8.1.2.3.0.0 pytorch : torch-neuron-1.9.1.2.3.0.0 pytorch : torch-neuron-1.10.2.2.3.0.0 pytorch : torch-neuron-1.11.0.2.3.0.0 tensorflow : tensorflow-neuron-1.15.5.2.3.0.0 tensorflow : tensorflow-neuron-2.5.3.2.3.0.0 tensorflow : tensorflow-neuron-2.6.3.2.3.0.0 tensorflow : tensorflow-neuron-2.7.1.2.3.0.0 tensorflow : tensorflow-neuron-2.8.0.2.3.0.0 tensorflow-model-server : tensorflow-model-server-neuron-1.15.0.2.3.0.0 tensorflow-model-server : tensorflow-model-server-neuron-2.5.4.2.3.0.0 tensorflow-model-server : tensorflow-model-server-neuron-2.6.3.2.3.0.0 tensorflow-model-server : tensorflow-model-server-neuron-2.7.0.2.3.0.0 tensorflow-model-server : tensorflow-model-server-neuron-2.8.0.2.3.0.0 tensorboard : tensorboard-plugin-neuron-2.4.0.0 mxnet : mxnet_neuron-1.5.1.1.10.0.0 mxnet : mx_neuron-1.8.0.2.2.2.0
This document is relevant for: Inf1, Inf2, Trn1, Trn2