batch-inference topic

List batch-inference repositories

onnx_tensorrt_project

585
Stars
124
Forks
Watchers

Support Yolov5(4.0)/Yolov5(5.0)/YoloR/YoloX/Yolov4/Yolov3/CenterNet/CenterFace/RetinaFace/Classify/Unet. use darknet/libtorch/pytorch/mxnet to onnx to tensorrt

cpp-project

585
Stars
124
Forks
Watchers

Boiler plate template for C++ projects, with CMake, Doctest, Travis CI, Appveyor, Github Actions and coverage reports.

yolov5_torchserve

92
Stars
18
Forks
Watchers

Torchserve server using a YoloV5 model running on docker with GPU and static batch inference to perform production ready and real time inference.