Inference with torch-neuron (Inf1) — AWS Neuron Documentation (original) (raw)

Computer Vision Tutorials

• ResNet-50 tutorial [html] [notebook]
• PyTorch YOLOv4 tutorial [html] [notebook]

Natural Language Processing (NLP) Tutorials

• HuggingFace pretrained BERT tutorial [html] [notebook]
• HuggingFace pretrained BERT tutorial with shared weights [html] [notebook]
• Bring your own HuggingFace pretrained BERT container to Sagemaker Tutorial [html] [notebook]
• LibTorch C++ tutorial [html]
• TorchServe tutorial [html]
• HuggingFace MarianMT tutorial [html] [notebook]

Utilizing Neuron Capabilities Tutorials

• BERT TorchServe tutorial [html]
• NeuronCore Pipeline tutorial [html] [notebook]