Profiling and Debugging (original) (raw)

To facilitate model and runtime integration, ExecuTorch provides tools to profile model resource utilization, numerics, and more. This section describes the available troubleshooting tools and steps to resolve issues when integrating ExecuTorch.

General Troubleshooting Steps#

• To troubleshoot failure of runtime API calls, such as loading or running a model, ensure that ExecuTorch framework logging is enabled. See Logging for more information.
• As a preliminary step to troubleshoot slow run times, ensure that performance testing is being done in a release build, and that the model is delegated. See Inference is Slow for more information.
• Check Frequently Asked Questions for common issues and questions encountered during install, model export, and runtime integration.

Developer Tools#

The ExecuTorch developer tools, or devtools, are a collection of tooling for troubleshooting model performance, numerics, and resource utilization. See Introduction to the ExecuTorch Developer Tools for an overview of the available developer tools and usage.

Next Steps#

• Frequently Asked Questions for solutions to commonly encountered questions and issues.
• Introduction to the ExecuTorch Developer Tools for a high-level introduction to available developer tooling.
• Using the ExecuTorch Developer Tools to Profile a Model for information on runtime performance profiling.
• Inspector APIs for reference material on trace inspector APIs.