batch-inference topic
                        List
                        batch-inference repositories
                    
                onnx_tensorrt_project
                            
                                587
                            
                            
                        
                        Stars
                    
                            
                                124
                            
                            
                        
                        Forks
                    Watchers
                    Support Yolov5(4.0)/Yolov5(5.0)/YoloR/YoloX/Yolov4/Yolov3/CenterNet/CenterFace/RetinaFace/Classify/Unet. use darknet/libtorch/pytorch/mxnet to onnx to tensorrt
cpp-project
                            
                                587
                            
                            
                        
                        Stars
                    
                            
                                124
                            
                            
                        
                        Forks
                    Watchers
                    Boiler plate template for C++ projects, with CMake, Doctest, Travis CI, Appveyor, Github Actions and coverage reports.
yolov5_torchserve
                            
                                92
                            
                            
                        
                        Stars
                    
                            
                                18
                            
                            
                        
                        Forks
                    Watchers
                    Torchserve server using a YoloV5 model running on docker with GPU and static batch inference to perform production ready and real time inference.