llm-observability topic

List llm-observability repositories

langfuse

14.4k
Stars
1.3k
Forks
Watchers

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

agenta

3.3k
Stars
393
Forks
Watchers

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

radicalbit-ai-monitoring

59
Stars
4
Forks
Watchers

A comprehensive solution for monitoring your AI models in production

helicone

2.6k
Stars
279
Forks
Watchers

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

palico-ai

295
Stars
12
Forks
Watchers

A framework for building, experimenting, deploying, and continuously iterating on your LLM application

myscale-telemetry

41
Stars
2
Forks
Watchers

Open-source observability for your LLM application.

lmnr

774
Stars
25
Forks
Watchers

Laminar - Open-source DataDog + PostHog for AI agents / RAG apps. Fast, reliable and insightful. Written in Rust 🦀. YC S24.

opik

8.4k
Stars
560
Forks
Watchers

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.