Transformers NeuronX (transformers-neuronx) — AWS Neuron Documentation (original) (raw)

If you already have setup your environment to run PyTorch NeuronX, you just need to install Transformers NeuronX library using the following instruction.

pip install transformers-neuronx --extra-index-url=https://pip.repos.neuron.amazonaws.com

If you are starting from scratch, Neuron Multi Framework DLAMI is recommended as it comes pre-installed with Transformers NeuronX virtual environment. You can refer to the instructions to launch a Neuron instance using Multi Framework DLAMI