litellm icon indicating copy to clipboard operation
litellm copied to clipboard

[Feature]: Log region to Langfuse

Open Manouchehri opened this issue 10 months ago • 4 comments

The Feature

For things like Vertex AI, it'd be useful if we logged the region that was used.

Motivation, pitch

For troubleshooting/checking perf of regions.

Twitter / LinkedIn details

https://www.linkedin.com/in/davidmanouchehri/

Manouchehri avatar Apr 10 '24 19:04 Manouchehri

makes sense - would this be in the metadata? @Manouchehri

krrishdholakia avatar Apr 11 '24 12:04 krrishdholakia

I think so. I was debating between metadata and model parameters, but metadata sounds more "correct" to me (since in theory the same model in a different region should always behave the same).

Manouchehri avatar Apr 11 '24 12:04 Manouchehri

I'm working on this, PR incoming soon.

Manouchehri avatar Apr 11 '24 20:04 Manouchehri

Thanks!

krrishdholakia avatar Apr 11 '24 20:04 krrishdholakia