DeepStream-Yolo icon indicating copy to clipboard operation
DeepStream-Yolo copied to clipboard

PTQ is too bad,QAT is future!So ,any idea for QAT support?

Open tms2003 opened this issue 1 year ago • 2 comments

I tested multiple models of deepstream-yolo, and the effect of int8 can be said to be very poor. I also tested qat on the classification model and it worked perfectly. If I generate trt weights using a project like yolov8-qat, can I switch directly to deepstream-yolo?

tms2003 avatar Dec 20 '23 09:12 tms2003

QAT truly brings significant innovation to Model Quantization. Here's an implementation of YOLOv9 with nearly zero precision loss and a substantial reduction in latency.

https://github.com/levipereira/yolov9-qat

levipereira avatar Apr 29 '24 20:04 levipereira

@levipereira just only yolov9.in fact,yolov8 or yolov10 may be better.Is there any open source plan for yolov8 or v10 qat ?

tms2003 avatar Jul 25 '24 03:07 tms2003