bentoml topic

List bentoml repositories

Serving-Machine-Learning-Models

52
Stars
10
Forks
Watchers

This repository contains instructions, template source code and examples on how to serve/deploy machine learning models using various frameworks and applications such as Docker, Flask, FastAPI, BentoM...

BentoML

7.0k
Stars
781
Forks
Watchers

The easiest way to serve AI apps and models - Build reliable Inference APIs, LLM apps, Multi-model chains, RAG service, and much more!

Yatai

770
Stars
70
Forks
Watchers

Model Deployment at Scale on Kubernetes 🦄️

gallery

133
Stars
50
Forks
Watchers

BentoML Example Projects 🎨

fellowship-prediction

49
Stars
5
Forks
Watchers

Analyzes your GitHub Profile and presents you with a report on how likely you are to become the next MLH Fellow!

MLZoomcamp2022

22
Stars
3
Forks
Watchers

My repo for the Machine Learning Engineering bootcamp 2022 by DataTalks.Club

OpenLLM

9.8k
Stars
626
Forks
49
Watchers

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.

whispercpp

330
Stars
66
Forks
Watchers

Pybind11 bindings for Whisper.cpp

Awesome-MLOPS

205
Stars
35
Forks
Watchers

All the available resources to master MLOPS from scratch

audiolizr

38
Stars
2
Forks
Watchers

A bentoML-powered API to transcribe audio and make sense of it