BentoML

The easiest way to serve AI apps and models - Build reliable Inference APIs, LLM apps, Multi-model chains, RAG service, and much more!

bentoml

Model Deployment at Scale on Kubernetes 🦄️

bentoml

BentoML Example Projects 🎨

bentoml

Fast model deployment on any cloud 🚀

bentoml

Deploy Your Own Stable Diffusion Service

bentoml

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.

bentoml

Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and more

bentoml

OneDiffusion: Run any Stable Diffusion models and fine-tuned weights with ease

bentoml

Turn any OCR models into online inference API endpoint 🚀 🌖

bentoml

CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search

bentoml