Relationship Between TensorRT-YOLO Inference Precision Discrepancy and EfficientNMS Plugin Exported Engine

[timarnoldev]

Running the exact same model (tested with v8, v9 and v10) with this library results in very bad detection results. I converted them from .pt -> .onnx using trtyolo and the custom yolov10 repo respectively.

Some object classes aren't detected that all. Sometimes there are rare detections of random objects with very low confidences. On the other hand running the model using tensorrt in python delivers perfect results.

TensorRT-YOLO

Python Tensorrt Inference

Any ideas what the problem might be?

Export command I used:

trtyolo export -w best.pt -v yolov8 -o output --max_boxes 100 --iou_thres 0.45 --conf_thres 0.15 -b -1