TensorRT (original) (raw)

TensorRT 8.2 and Framework Integrations are out now!

The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…

6

5959

January 10, 2025

Best practices for reporting an issue or bug relating to TensorRT

0

8844

September 21, 2018

You have exhausted the lab time provided with your course enrollment. If you believe this message is in error, please contact support. Please help

2

9

May 8, 2025

Big difference between infer results of onnxruntime and tensorrt

3

82

May 8, 2025

Onnx2trt --fp16 error

2

13

May 8, 2025

Nvshmem3.2.5+doca2.9.1failed to detect nvidia-peermem.ko

0

2

May 8, 2025

Trtexec exports engine with error (out of memory)

0

2

May 8, 2025

Rapid Application Development with Large Language Models (LLMs) code not working, won't connect to llms

1

8

May 6, 2025

Trtexec Segfault at PointWiseFusion

0

9

May 5, 2025

Optimizing Rendering with AI: Reducing GPU Load for Faster Processing

1

28

May 3, 2025

High GPU usage during simple model inference on Tensorrt

1

13

May 2, 2025

TensorRT engine fails to deserialize, despite being built with the same version on the same machine

3

23

May 1, 2025

Tensor RT engine to faster rcnn model

2

11

May 1, 2025

Where to download libnvinfer.so.10 for aarch64-Linux

0

14

May 1, 2025

Quantization of D-FINE in tensorrt 10.8 fails

3

39

April 30, 2025

Slow inference on custom model

2

19

April 30, 2025

Windows systems perfomance issue

1

19

April 30, 2025

TensorRT engine execution return all 0 due to warning[ScatterND with reduction=='none' only guarantees to be correct if indices are not duplicated.]

1

14

April 30, 2025

Failed to convert the SAM2.1 decoder onnx model due to Error Code 4: Internal Error

1

18

April 30, 2025

How to deploy Grad-CAM using TensorRT

1

29

April 30, 2025

Techniques to Imporve TensorRT Model Inference Speed

0

10

April 30, 2025

OpenCV library with CUDA Support on Jetson JetPack Integration

0

9

April 30, 2025

Jetson Orin with Yolo

2

20

April 29, 2025

The TensorRT engine produces different inference results when loaded using Python compared to C++

1

21

April 28, 2025

Seeking Guidance for Developing a Custom Generative AI-Driven Conversational UI for Electronic Devices

3

32

April 24, 2025

Model not working after upgrading from TensorRT 8.6 to TensorRT10.3

4

29

May 8, 2025

Torch-TensorRT weight dependent optimization

2

25

April 23, 2025

Difficulty implementing Nvidia library compatibility

4

32

April 22, 2025

TensorRT10.3 Cuda Runtime Error When Directly Using cuda device inputs for function execute_async_v3

1

31

April 22, 2025

How to Convert CO-DETR Model?

4

322

April 21, 2025