litellm icon indicating copy to clipboard operation
litellm copied to clipboard

Update support for langfuse metadata

Open alexanderepstein opened this issue 9 months ago โ€ข 6 comments

Title

Update support for langfuse metadata

Relevant issues

Builds upon #3221

Type

๐Ÿ†• New Feature ๐Ÿงน Refactoring ๐Ÿ“– Documentation โœ… Test

Changes

  • Added ability to set trace release, version, metadata
  • Added ability to update fields during a trace continuation
  • Added ability to update input and output during a trace continuation
  • Wrote new test for verifying metadata is set correctly
  • Small improvement to setting secret boolean, prevent unnecessary literal_eval
  • Small improvements to langfuse tests

Testing

  • Ran existing test suite along with new test

Notes

  • Updates to support most langfuse metadata facilities

Pre-Submission Checklist (optional but appreciated):

  • [x] I have included relevant documentation updates (stored in /docs/my-website)

OS Tests (optional but appreciated):

  • [ ] Tested on Windows
  • [ ] Tested on MacOS
  • [x] Tested on Linux

alexanderepstein avatar May 05 '24 03:05 alexanderepstein

The latest updates on your projects. Learn more about Vercel for Git โ†—๏ธŽ

Name Status Preview Comments Updated (UTC)
litellm โœ… Ready (Inspect) Visit Preview ๐Ÿ’ฌ Add feedback May 5, 2024 6:57pm

vercel[bot] avatar May 05 '24 03:05 vercel[bot]

@alexanderepstein added some comments.

If we can address those + attach a screenshot of the langfuse testing passing for you - i think this should be good to merge

krrishdholakia avatar May 05 '24 04:05 krrishdholakia

I am not sure I see your comments, let me know if I'm missing something.

Had to add mark one test as skippable if you don't have an OpenAI api key.

Here is the test output for the file.

litellm-langfuse-tests

alexanderepstein avatar May 05 '24 05:05 alexanderepstein

Screenshot 2024-05-04 at 11 00 54 PM

are you not able to see these? @alexanderepstein

krrishdholakia avatar May 05 '24 06:05 krrishdholakia

Looks like your comments are pending https://github.com/orgs/community/discussions/10369

alexanderepstein avatar May 05 '24 06:05 alexanderepstein

I attempted to address the comments I can see in your screenshot.

alexanderepstein avatar May 05 '24 17:05 alexanderepstein