Inference on Inf1 (tensorflow-neuron) — AWS Neuron Documentation (original) (raw)

This document is relevant for: Inf1

Inference on Inf1 (tensorflow-neuron)#

Setup (tensorflow-neuron)

Tutorials (tensorflow-neuron)

Natural Language Processing (NLP) Tutorials

• Tensorflow 2.x - HuggingFace Pipelines distilBERT with Tensorflow2 Neuron [html] [notebook]

Utilizing Neuron Capabilities Tutorials

• Tensorflow 2.x - Using NEURON_RT_VISIBLE_CORES with TensorFlow Serving [html]

Additional Examples (tensorflow-neuron) API Reference Guide (tensorflow-neuron) Misc (tensorflow-neuron)

This document is relevant for: Inf1