bentoml topic
Serving-Machine-Learning-Models
This repository contains instructions, template source code and examples on how to serve/deploy machine learning models using various frameworks and applications such as Docker, Flask, FastAPI, BentoM...
BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Yatai
Model Deployment at Scale on Kubernetes 🦄️
gallery
BentoML Example Projects 🎨
fellowship-prediction
Analyzes your GitHub Profile and presents you with a report on how likely you are to become the next MLH Fellow!
MLZoomcamp2022
My repo for the Machine Learning Engineering bootcamp 2022 by DataTalks.Club
OpenLLM
Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.
whispercpp
Pybind11 bindings for Whisper.cpp
Awesome-MLOPS
All the available resources to master MLOPS from scratch
audiolizr
A bentoML-powered API to transcribe audio and make sense of it