ai-infra topic

List ai-infra repositories

AI-System-School

2.7k
Stars
306
Forks
Watchers

🚀 AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻...

BentoML

7.0k
Stars
781
Forks
Watchers

The easiest way to serve AI apps and models - Build reliable Inference APIs, LLM apps, Multi-model chains, RAG service, and much more!

klever

129
Stars
20
Forks
Watchers

Cloud Native ML/DL Platform

raptor

147
Stars
11
Forks
Watchers

Transform your pythonic research to an artifact that engineers can deploy easily.

ai-infra-landscape

123
Stars
55
Forks
Watchers

This is a landscape of the infrastructure that powers the generative AI ecosystem

trustgraph

108
Stars
8
Forks
Watchers

TrustGraph Engine - LLM Agnostic Knowledge Agent Dev Platform ⚡🚀