llm-observability topic

List llm-observability repositories

langfuse

19.2k
Stars
1.9k
Forks
19.2k
Watchers

🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

agenta

3.5k
Stars
413
Forks
3.5k
Watchers

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

radicalbit-ai-monitoring

82
Stars
11
Forks
82
Watchers

A comprehensive solution for monitoring your AI models in production

helicone

4.9k
Stars
461
Forks
4.9k
Watchers

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

palico-ai

341
Stars
28
Forks
341
Watchers

Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework

myscale-telemetry

53
Stars
7
Forks
53
Watchers

Open-source observability for your LLM application.

lmnr

2.5k
Stars
156
Forks
2.5k
Watchers

Laminar - open-source all-in-one platform for engineering AI products. Create data flywheel for your AI app. Traces, Evals, Datasets, Labels. YC S24.

opik

16.6k
Stars
1.2k
Forks
16.6k
Watchers

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

langfuse-java

36
Stars
6
Forks
36
Watchers

🪢 Auto-generated Java Client for Langfuse API

coze-loop

5.3k
Stars
723
Forks
5.3k
Watchers

Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to...