Welcome to Model Optimizer (ModelOpt) documentation! — Model Optimizer 0.31.0 (original) (raw)

TensorRT Model Optimizer

Getting Started

• Overview
• Installation
• Quick Start: Quantization
• Quick Start: Quantization (Windows)
• Quick Start: Pruning
• Quick Start: Distillation
• Quick Start: Sparsity

Guides

• Support Matrix
• Quantization
• Pruning
• NAS
• Distillation
• Sparsity
• Saving & Restoring
• Speculative Decoding
• AutoCast (ONNX)

Deployment

• TensorRT-LLM
• DirectML
• Unified HuggingFace Checkpoint

Examples

• All GitHub Examples

Reference

• Changelog
• modelopt API

Support

• Contact us
• FAQs

TensorRT Model Optimizer

• Welcome to Model Optimizer (ModelOpt) documentation!
• View page source

Getting Started

• Overview
• Installation
• Quick Start: Quantization
• Quick Start: Quantization (Windows)
• Quick Start: Pruning
• Quick Start: Distillation
• Quick Start: Sparsity

Guides

• Support Matrix
• Quantization
• Pruning
• NAS
• Distillation
• Sparsity
• Saving & Restoring
• Speculative Decoding
• AutoCast (ONNX)

Deployment

• TensorRT-LLM
• DirectML
• Unified HuggingFace Checkpoint

Examples

• All GitHub Examples

Reference

• Changelog
• modelopt API

Support

• Contact us
• FAQs