About Fine-Tuning — NVIDIA NeMo Microservices (original) (raw)

Learn how to fine-tune a model by making requests to the NVIDIA NeMo Customizer microservice through the API. Fine-tuned models you have created can be deployed using NVIDIA NIMs.

Fine-Tuning Workflow#

At a high level, the fine-tuning workflow consists of the following steps:

  1. Format a dataset.
  2. Choose a model and compatible dataset.
  3. Optionally create a customization target for the model if it hasn’t already been created.
  4. Create a customization job.
  5. Monitor the job until it completes.
  6. Move on to Evaluate the output model.

Model Catalog#

Explore the model families and sizes supported by the NVIDIA NeMo Customizer microservice.

View the available Llama models in the model catalog.

Llama Models

View the available Llama Nemotron models from NVIDIA, including Nano and Super variants for efficient and advanced instruction tuning.

Llama Nemotron Models

View the available Phi models from Microsoft, designed for strong reasoning capabilities with efficient deployment.

Phi Models

Task Guides#

Perform common fine-tuning tasks.

Tutorials#

Follow these tutorials to learn how to accomplish common fine-tuning tasks.

References#

View the available hyperparameters and their valid options that you can set when creating a customization job.

Hyperparameter Options