Inference on Inf2 & Trn1/Trn1n (tensorflow-neuronx) — AWS Neuron Documentation (original) (raw)

• Repository

• Suggest edit

• Open issue

• .rst

This document is relevant for: Inf2, Trn1

Inference on Inf2 & Trn1/Trn1n (tensorflow-neuronx)#

Setup (tensorflow-neuronx)

Tutorials (tensorflow-neuronx)

• HuggingFace Roberta-Base [html] [notebook]
• Using NEURON_RT_VISIBLE_CORES with TensorFlow Serving

Note

To use Jupyter Notebook see:

• Jupyter Notebook QuickStart
• Running Jupyter Notebook as script

API Reference Guide (tensorflow-neuronx)

• TensorFlow 2.x (tensorflow-neuronx) Tracing API
• TensorFlow 2.x (tensorflow-neuronx) Auto Multicore Replication (Beta)
• TensorFlow 2.x (tensorflow-neuronx) analyze_model API

Misc (tensorflow-neuronx)

• TensorFlow 2.x (tensorflow-neuronx) Release Notes

This document is relevant for: Inf2, Trn1