Training Tutorials — AWS Neuron Documentation (original) (raw)

• Repository

• Suggest edit

• Open issue

• .rst

This document is relevant for: Inf2, Trn1, Trn2, Trn3

Training Tutorials#

• Training with Tensor Parallelism
• Training Llama3.1-8B, Llama3-8B and Llama2-7B with Tensor Parallelism and ZeRO-1 Optimizer
• Fine-tuning Llama2 7B with tensor parallelism and ZeRO-1 optimizer using Neuron PyTorch-Lightning
• Fine-tuning Llama3 8B with tensor parallelism and LoRA using Neuron PyTorch-Lightning

This document is relevant for: Inf2, Trn1, Trn2, Trn3