TensorChord
TensorChord
Awesome-LLMOps
An awesome & curated list of best LLMOps tools for developers
envd
🏕️ Reproducible development environment
pgvecto.rs
Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database.
inference-benchmark
Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
modelz-llm
OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
openmodelz
One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or even a single machine).
ai-infra-landscape
This is a landscape of the infrastructure that powers the generative AI ecosystem
ai-infra-statistics
This repository contains statistics about the AI Infrastructure products.