TensorRT-For-YOLO-Series
TensorRT-For-YOLO-Series copied to clipboard
Linaom1214
Batch processing?
@Linaom1214 Hello sir. I would like to process a batch of 5 images in my c++ application. As this repository supports only single image processing, is there any way to process a batch of images with this repository? If you have a code script for that already, it would be great if you could share it. Thank you in advance.
@Linaom1214 Hello sir. I would like to process a batch of 5 images in my c++ application. As this repository supports only single image processing, is there any way to process a batch of images with this repository? If you have a code script for that already, it would be great if you could share it. Thank you in advance.
At present, the end2end implementation method of this reop has problems when dealing with multiple batches.
you can try this https://github.com/WongKinYiu/yolov7/blob/main/tools/YOLOv7-Dynamic-Batch-TENSORRT.ipynb
@Linaom1214 what if end2end is not used (compile without NMS)? will bigger batch sizes work?
@Linaom1214 what if end2end is not used (compile without NMS)? will bigger batch sizes work?
not support dynamic batch, big batch is support