model-inference-service topic

The easiest way to serve AI apps and models - Build reliable Inference APIs, LLM apps, Multi-model chains, RAG service, and much more!

bentoml

Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and more

bentoml

CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search

bentoml