agentops icon indicating copy to clipboard operation
agentops copied to clipboard
Published 2 months ago • verified publisher icon AgentOps-AI

Update LiteLLM provider for v4

Open areibman opened this issue 10 months ago • 2 comments

IMPORTANT: Open a PR basing your branch off redesign to merge onto redesign

areibman avatar Feb 20 '25 20:02 areibman

Suggested: Use the callbacks provided in similar examples like Langfuse

areibman avatar Feb 20 '25 20:02 areibman

Will need to add an instrumentor for LiteLLM as openllmetery doesn't have one. We can take reference from Openlit

Dwij1704 avatar Mar 06 '25 17:03 Dwij1704

Raised a PR for litellm docs https://github.com/BerriAI/litellm/pull/9561 Preview link

Dwij1704 avatar Mar 26 '25 18:03 Dwij1704

LiteLLM Integration Feedback Report

Current Situation

  • LiteLLM has rejected our PR due to dependency concerns for proxy users
  • They prefer an approach similar to Langsmith's integration model
  • The core issue is requiring additional dependencies that proxy users cannot use

How Langsmith Handles Integration

From Langsmith's documentation:

  1. They support multiple integration paths:
    • Direct HTTP-based logging via their core integration 🔗
    • OpenTelemetry integration as an optional feature 🔗
    • Client-side trace exporter for advanced use cases 🔗

Dwij1704 avatar Mar 27 '25 17:03 Dwij1704

Raised another PR with the changes requested, here is a preview of the document

Dwij1704 avatar Apr 01 '25 15:04 Dwij1704

waiting on this pr

bboynton97 avatar Apr 03 '25 15:04 bboynton97