API Reference Guide (torch-neuronx) — AWS Neuron Documentation (original) (raw)

• Repository

• Suggest edit

• Open issue

• .rst

This document is relevant for: Inf2, Trn1, Trn2

API Reference Guide (torch-neuronx)#

API Reference Guide (torch-neuronx)

• PyTorch NeuronX Tracing API for Inference
• PyTorch Neuron (torch-neuronx) Weight Replacement API for Inference
• PyTorch NeuronX NeuronCore Placement APIs [Beta]
• PyTorch NeuronX Analyze API for Inference
• PyTorch NeuronX DataParallel API
• PyTorch NeuronX Lazy and Asynchronous Loading API

This document is relevant for: Inf2, Trn1, Trn2