ai-infra topic
AI-Infra-from-Zero-to-Hero
🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLS...
BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
klever
Cloud Native ML/DL Platform
raptor
Transform your pythonic research to an artifact that engineers can deploy easily.
ai-infra-landscape
This is a landscape of the infrastructure that powers the generative AI ecosystem
trustgraph
Eliminate hallucinations from your AI agents.
vgpu.rs
vgpu.rs is the fractional GPU & vgpu-hypervisor implementation written in Rust
TME-Agent
TME: Structured memory engine for LLM agents to plan, rollback, and reason across multi-step tasks.
awesome-ai-infrastructure
A curated list of awesome tools, frameworks, platforms, and resources for building scalable and efficient AI infrastructure, including distributed training, model serving, MLOps, and deployment.
RLinf
RLinf is a flexible and scalable open-source infrastructure designed for post-training foundation models (LLMs, VLMs, VLAs) via reinforcement learning.