batch-inference topic
List
batch-inference repositories
onnx_tensorrt_project
587
Stars
124
Forks
Watchers
Support Yolov5(4.0)/Yolov5(5.0)/YoloR/YoloX/Yolov4/Yolov3/CenterNet/CenterFace/RetinaFace/Classify/Unet. use darknet/libtorch/pytorch/mxnet to onnx to tensorrt
cpp-project
587
Stars
124
Forks
Watchers
Boiler plate template for C++ projects, with CMake, Doctest, Travis CI, Appveyor, Github Actions and coverage reports.
yolov5_torchserve
92
Stars
18
Forks
Watchers
Torchserve server using a YoloV5 model running on docker with GPU and static batch inference to perform production ready and real time inference.