Triton Inference Server

icon indicating a website link https://developer.nvidia.com/nvidia-triton-inference-server

Results 23 repositories owned by Triton Inference Server

fastertransformer_backend

408
Stars
133
Forks
Watchers

verified publisher icon triton-inference-server

fil_backend

61
Stars
33
Forks
Watchers

FIL backend for the Triton Inference Server

verified publisher icon triton-inference-server

hugectr_backend

49
Stars
9
Forks
Watchers

verified publisher icon triton-inference-server

paddlepaddle_backend

31
Stars
6
Forks
Watchers

verified publisher icon triton-inference-server

pytorch_backend

94
Stars
38
Forks
Watchers

The Triton backend for the PyTorch TorchScript models.

verified publisher icon triton-inference-server

tensorflow_backend

39
Stars
17
Forks
Watchers

The Triton backend for TensorFlow.

verified publisher icon triton-inference-server

tensorrt_backend

40
Stars
24
Forks
Watchers

The Triton backend for TensorRT.

verified publisher icon triton-inference-server

pytriton

672
Stars
45
Forks
Watchers

PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.

verified publisher icon triton-inference-server

developer_tools

15
Stars
5
Forks
Watchers

verified publisher icon triton-inference-server

openvino_backend

23
Stars
13
Forks
Watchers

OpenVINO backend for Triton.

verified publisher icon triton-inference-server