model-inference-service topic

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

bentoml

Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and more

bentoml

CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search

bentoml

Learn the ins and outs of efficiently serving Large Language Models (LLMs). Dive into optimization techniques, including KV caching and Low Rank Adapters (LoRA), and gain hands-on experience with Pred...

ksm26