PyTorch Neuron (torch-neuronx) Setup — AWS Neuron Documentation (original) (raw)

Contents

• torch-neuronx setup on Ubuntu 22
• torch-neuronx setup on Amazon Linux 2023 (AL2023)
• torch-neuronx setup on Rocky Linux 9

This document is relevant for: Inf2, Trn1, Trn2

PyTorch Neuron (torch-neuronx) Setup#

Note

This Setup guide is relevant for Inf2 & Trn1 / Trn1n / Trn2 instances.

Table of contents

• torch-neuronx setup on Ubuntu 22
• torch-neuronx setup on Amazon Linux 2023 (AL2023)
• torch-neuronx setup on Rocky Linux 9

torch-neuronx setup on Ubuntu 22#

Ubuntu 22 (Neuron Multi-Framework DLAMI)

torch-neuronx setup on Amazon Linux 2023 (AL2023)#

Amazon Linux 2023 (Amazon Linux 2023 AMI)

torch-neuronx setup on Rocky Linux 9#

Rocky Linux 9 (Rocky Linux 9 AMI)

This document is relevant for: Inf2, Trn1, Trn2