llmops topic
sagify
LLMs and Machine Learning done easily
continuous-eval
Data-Driven Evaluation for LLM-Powered Applications
markdown-crawler
A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG
openmodelz
One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or even a single machine).
openinference
OpenTelemetry Instrumentation for AI Observability
logikon
Analyzing and scoring reasoning traces of LLMs
spelltest
AI-to-AI Testing | Simulation framework for LLM-based applications
UniLLM
🦄 Consume any LLM from any provider, using the OpenAI API
litellm
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]