TensorRT
TensorRT copied to clipboard
Builder failure of TensorRT 8.5 when trying to run on DLA of Jetson Orin
Layer fails to execute to run on DLA when dynamic shaped ONNX of batch 4 is built, but same static onnx model with implicit batch of the same runs on DLA
TensorRT Version: 8.5.2
NVIDIA GPU: Jetson ORIN
Relevant Files
Model link: link
Command used for Explicit batch onnx: /usr/src/tensorrt/bin/trtexec --onnx=yolov8m_dynamic.onnx --shapes=images:4x3x640x640 --useDLACore=0 --allowGPUFallback
Command used for Implicit batch onnx: /usr/src/tensorrt/bin/trtexec --onnx=yolov8m_static.onnx --useDLACore=0 --allowGPUFallback
Attached trtexec outputs below
implicit batch
explicit batch