🚀 Feature: OpenTelemetry Metrics

[nirga]

Which component is this feature for?

All Packages

🔖 Feature description

Some values, like token usage, are better reported (also) as otel metrics. We should update all instrumentations to send metrics as well as traces.

🎤 Why is this feature needed ?

More ways to use the outputted data. Observability platforms can use metrics to set alerts on or to create dashboards.

✌️ How do you aim to achieve this?

Similar to the issue in OpenLLMetry - https://github.com/traceloop/openllmetry/issues/251 This needs to be researched and defined. Please consult on slack before starting to work on this.

🔄️ Additional Information

No response

👀 Have you spent some time to check if this feature request has been raised before?

• [X] I checked and didn't find similar issue

Are you willing to submit PR?

None

[detunjiSamuel]

Hey, I would love to work on this issue.

[nirga]

Sounds good @detunjiSamuel! You can look at the python project we've already done some work there in the SDK and the OpenAI instrumentation

[deepshahcode]

I would be glad to work on this issue.

[nirga]

Amazing @deepshahcode! Let me know if you need any help