model-inference-service topic

The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!

bentoml

Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and more

bentoml

CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search

bentoml