triton-inference-server topic

Serving Example of CodeGen-350M-Mono-GPTJ on Triton Inference Server with Docker and Kubernetes

Curt-Park

Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> ONNX -> TensorRT, Inference pipelines (TensorRT, Triton server -...

k9ele7en

An Alternative for Triton Inference Server. Boosting DL Service Throughput 1.5-4x by Ensemble Pipeline Serving with Concurrent CUDA Streams for PyTorch/LibTorch Frontend and TensorRT/CVCUDA, etc., Bac...

torchpipe

Provides an ensemble model to deploy a YoloV8 ONNX model to Triton

omarabid59

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

NVIDIA

Build Recommender System with PyTorch + Redis + Elasticsearch + Feast + Triton + Flask. Vector Recall, DeepFM Ranking and Web Application.

akiragy

Tiny configuration for Triton Inference Server

rtzr

Diffusion Model for Voice Conversion

trinhtuanvubk

OpenAI compatible API for TensorRT LLM triton backend

npuichigo

Magface Triton Inferece Server Using Tensorrt

tonhathuy