llmops topic

List llmops repositories

sagify

434
Stars
69
Forks
Watchers

LLMs and Machine Learning done easily

continuous-eval

436
Stars
28
Forks
Watchers

Data-Driven Evaluation for LLM-Powered Applications

markdown-crawler

279
Stars
29
Forks
Watchers

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG

openmodelz

239
Stars
22
Forks
Watchers

One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or even a single machine).

openinference

195
Stars
33
Forks
Watchers

OpenTelemetry Instrumentation for AI Observability

logikon

38
Stars
0
Forks
Watchers

Analyzing and scoring reasoning traces of LLMs

spelltest

136
Stars
8
Forks
Watchers

AI-to-AI Testing | Simulation framework for LLM-based applications

UniLLM

25
Stars
0
Forks
Watchers

🦄 Consume any LLM from any provider, using the OpenAI API

litellm

26.6k
Stars
3.7k
Forks
131
Watchers

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]