triton-server topic

List triton-server repositories

flexible-yolov5

652
Stars
119
Forks
Watchers

More readable and flexible yolov5 with more backbone(gcn, resnet, shufflenet, moblienet, efficientnet, hrnet, swin-transformer, etc) and (cbam,dcn and so on), and tensorrt

fastDeploy

93
Stars
18
Forks
Watchers

Deploy DL/ ML inference pipelines with minimal extra code.

Setup-deeplearning-tools

44
Stars
7
Forks
Watchers

Set up CI in DL/ cuda/ cudnn/ TensorRT/ onnx2trt/ onnxruntime/ onnxsim/ Pytorch/ Triton-Inference-Server/ Bazel/ Tesseract/ PaddleOCR/ NVIDIA-docker/ minIO/ Supervisord on AGX or PC from scratch.

yolov8-triton

22
Stars
6
Forks
Watchers

Provides an ensemble model to deploy a YoloV8 ONNX model to Triton

triton-server-yolo

19
Stars
1
Forks
Watchers

This repository serves as an example of deploying the YOLO models on Triton Server for performance and testing purposes

triton-grpc-proxy-rs

15
Stars
1
Forks
Watchers

Proxy server for triton gRPC server that inferences embedding model in Rust