TensorRT icon indicating copy to clipboard operation
TensorRT copied to clipboard

Builder failure of TensorRT 8.5 when trying to run on DLA of Jetson Orin

Open MesaMitch opened this issue 6 months ago • 3 comments

Layer fails to execute to run on DLA when dynamic shaped ONNX of batch 4 is built, but same static onnx model with implicit batch of the same runs on DLA

TensorRT Version: 8.5.2

NVIDIA GPU: Jetson ORIN

Relevant Files

Model link: link

Command used for Explicit batch onnx: /usr/src/tensorrt/bin/trtexec --onnx=yolov8m_dynamic.onnx --shapes=images:4x3x640x640 --useDLACore=0 --allowGPUFallback

Command used for Implicit batch onnx: /usr/src/tensorrt/bin/trtexec --onnx=yolov8m_static.onnx --useDLACore=0 --allowGPUFallback

Attached trtexec outputs below implicit batch Image

explicit batch

Image

MesaMitch avatar Apr 07 '25 17:04 MesaMitch