TensorRT

TensorRT copied to clipboard

fails to parse valid onnx model: API Usage Error (node_of_reduce_min_output: at least 1 dimensions are required for input.)

1

## Description For the following valid onnx model,  it cannot be imported by the onnx frontend in TensorRT. The following error message is produced: ```c [05/29/2025-12:16:24] [TRT] [E] ITensor::getDimensions:...

coffezhou

failed to build the serialized network when running a valid onnx model on GPU 3080: dimensions not compatible for Gather with GatherMode = kND

3

## Description For the following onnx model,  it can be imported by the onnx frontend in TensorRT. However, it failes to build the serialized network. The following error message...

coffezhou

Why does img2img diffusion task not have quantization support? how to get it working with quantization?

2

## Description In the diffusion demo support matrix it's mentioned that img2img task doesn't have quantization support, why is that? can someone please provide a bit more clarity? If someone...

varshith15

An inference error occurred after converting ONNX to tensorrt

1

When I was using UNet for image segmentation, after converting the pytorch format model to the tensorrt format, there would be a large error in the reasoning, as follows: ...

wangbiao0

About using multi-process to execute two engine models in one program

1

## Description Problem description: Hi, I can run my detection engine model or super resolution engine model separately in Jetson Orin Nano and it works fine. But when I use...

A-cvprogrammer

Floating point exception of TensorRT 10.5 when converting an ONNX model with trtexec on GPU GeForce RTX 2080 Ti

6

## Description I tried to convert an ONNX model of a U-Net to TensorRT using the `trtexec` command line tool. ## Environment **TensorRT Version**: 10.5 **NVIDIA GPU**: GeForce RTX 2080...

tom-brosch

TensorRT Plugin gets incorrect input data when integrated into full model, but works fine in isolation

1

I am converting a custom PyTorch plugin (CorrSamplerPlugin) into a TensorRT plugin. When testing the plugin independently, the results are correct and consistent with PyTorch. However, after integrating the plugin...

niubiplus2

Failed to build TensorRT from source.

6

## Description Failed to build **TensorRT 21.07** from source. ## Environment **TensorRT Version**: 21.07 **NVIDIA GPU**: GeForce RTX 2080 Ti **NVIDIA Driver Version**: NVIDIA-SMI 460.84 **CUDA Version**: 11.3 **CUDNN Version**:...

jiapei100

Inconsistency between the outputs of dino onnx and dino trt engine

7

Hi team, I'm using `trtexec` to convert dino onnx to trt engine. however I'm seeing different outputs compared to dino onnx. here is what I found: Would appreciate it if...

Desperado721

Explicit INT8 Quantization Fails to Fuse Concat-Conv Block Compared to Implicit Mode

2

## Description I am currently trying to quantize my UNet-based pytorch model to INT8. I end up with a slightly different —and slower— engine graph compared to the one generated...

patrickgrommelt