(original) (raw)

.. _nxd_training_tutorials: Training Tutorials ============================================================ .. toctree:: :maxdepth: 1 🥷 Training using Tensor Parallelism Training Llama 3.1 8B/Llama 3 8B using TP and ZeRO-1 Training Llama 3.1 70B/Llama 3 70B using TP and PP Fine-tuning Llama3 8B with tensor parallelism and LoRA using Neuron PyTorch-Lightning .. include:: /libraries/neuronx-distributed/tutorials/nxd_training_tutorials.txt