NeuronPerf Troubleshooting — AWS Neuron Documentation (original) (raw)

Contents

• Compilation issues
  • Model fails to compile
• Benchmarking Issues
  • Benchmarking terminates early with errors
• Other Issues or Feature Requests

This document is relevant for: Inf1, Inf2, Trn1, Trn2

NeuronPerf Troubleshooting#

Table of contents

• Compilation issues
  • Model fails to compile
• Benchmarking Issues
  • Benchmarking terminates early with errors
• Other Issues or Feature Requests

Compilation issues#

Model fails to compile#

Please file a bug with as much information as possible.

Benchmarking Issues#

Benchmarking terminates early with errors#

• Scroll up and read the output. Most likely causes are:
  • invalid input shapes or
  • not enough memory to load the requested number of model copies on the device. Try passing n_models=1 to benchmark again to test for memory issues.

Other Issues or Feature Requests#

Please file a bug on Github.

This document is relevant for: Inf1, Inf2, Trn1, Trn2