Zhang Jun
Zhang Jun
## Description Hi, [BatchedNMSPlugin](https://github.com/NVIDIA/TensorRT/tree/main/plugin/batchedNMSPlugin) plugin makes [ymin, xmin, ymax, xmax] as the default bounding box input format. https://github.com/NVIDIA/TensorRT/blob/87f3394404ff9f9ec92c906cd4c39b5562aea42e/plugin/batchedNMSPlugin/batchedNMSInference.cu#L113-L119 How can I use the bounding box input format of [xmin, ymin,...
## description When we run ```python benchmark_ait.py --batch-size=1``` the first time, it will raise exceptions with message 'OSError: ./tmp/resnet50_1/test.so: cannot open shared object file: No such file or directory'. This...
Hi, I want to load lora dynamically, but I found it can't be unloaded and the results of the remaining rounds are the same. The code is as follows. ```python...