NeMo AutoModel Documentation — NeMo-AutoModel (original) (raw)

PyTorch SPMD (Single Program, Multiple Data) training for LLMs and VLMs with day-0 Hugging Face model support.

Introduction to NeMo AutoModel#

Learn about NeMo AutoModel, how it works at a high-level, and the key features.

Find the right guide for your task.

Training throughput on NVIDIA GPUs with optimized kernels for Hugging Face models.

See the full benchmark results for configuration details and more models.

Install NeMo AutoModel and launch your first training job.

Install via PyPI, Docker, or from source. Use nemo-automodel[cli] for lightweight login-node installs.

Parallelism, precision, checkpointing strategies and experiment tracking.