inference-platform topic

List inference-platform repositories

BentoML

6.7k
Stars
752
Forks
Watchers

The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!