ai-infra topic
AI-System-School
🚀 AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑💻...
BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
klever
Cloud Native ML/DL Platform
raptor
Transform your pythonic research to an artifact that engineers can deploy easily.
ai-infra-landscape
This is a landscape of the infrastructure that powers the generative AI ecosystem
trustgraph
Eliminate hallucinations from your AI agents.
vgpu.rs
vgpu.rs is the fractional GPU & vgpu-hypervisor implementation written in Rust
TME-Agent
TME: Structured memory engine for LLM agents to plan, rollback, and reason across multi-step tasks.
awesome-ai-infrastructure
A curated list of awesome tools, frameworks, platforms, and resources for building scalable and efficient AI infrastructure, including distributed training, model serving, MLOps, and deployment.