[Bug]: Prometheus seems broken

[rjanovski]

What happened?

followed the instructions of adding prometheus metrics:

  litellm_settings:
    success_callback: [ "prometheus" ]
    failure_callback: [ "prometheus" ]
    service_callback: ["prometheus_system"]

and /metrics just reports 307 Temporary Redirect

Relevant log output

127.0.0.1:60754 - "GET /metrics HTTP/1.1" 307

Twitter / LinkedIn details

No response

[ishaan-jaff]

works for me on latest

[ishaan-jaff]

@rjanovski can you try http://localhost:4000/metrics/ ?

[rjanovski]

Thanks Ishaan,

yes, that works (trailing slash) /metrics/ since prometheus can scrape that, I'm happy.

could be better to expose the metrics with both paths: /metric and /metric/

but since you are exposing exactly like the prometheus_client docs, I guess this is the correct way.

great work! thanks again :)