Support Matrix — NVIDIA TensorRT Documentation (original) (raw)

These support matrices provide an overview of the supported platforms, features, and hardware capabilities of the TensorRT APIs, parsers, and layers.

Features for Platforms and Software#

Note

• Serialized engines are not portable across platforms.
• If a serialized engine was created using the version-compatible flag, it could run with newer versions of TensorRT within the same major version.
• If a serialized engine was created with hardware compatibility mode enabled, it can run on more than one kind of GPU architecture; the specifics depend on the hardware compatibility level used. Otherwise, serialized engines are not portable across devices.

Refer to the minimum compatible driver versions in the NVIDIA CUDA Release Notes for specific NVIDIA Driver versions.

Hardware and Precision#

The following table lists NVIDIA hardware and the precision modes each hardware supports. TensorRT has been compiled to support all NVIDIA hardware with SM 7.5 or higher capability. The table also lists the availability of DLA on this hardware. Refer to the following tables for the specifics.

Compute Capability Per Platform#

The section lists the supported computing capability based on the platform.

Software Versions Per Platform#

Note

The Debian or RPM packages support the Python version listed in the table. Python versions 3.8, 3.9, 3.10, 3.11, 3.12, and 3.13 are supported using Python wheel files from the tar or zip packages.

ONNX Operator Support#

The ONNX operator support list for TensorRT can be found here.

Footnotes