ai21-python

ai21-python copied to clipboard

Is your feature request related to a problem? Please describe. There is no Documentation or blog guide for monitoring AI21 usage (cost, tokens, interactions)

Describe the solution you'd like Add a Documentation or blog guide for monitoring AI21 usage (cost, tokens, interactions)

Describe alternatives you've considered Refer users using AI21 and looking for Observability with OpenTelemetry to https://docs.openlit.io/latest/integrations/ai21

Additional context Hi Team, I am one of the maintainers of OpenLIT and we support Observability for LLM apps built using AI21, It is all OpenTelemetry-native so the traces and metrics can be sent to any platform like Grafana or any OSS OTel tools

OpenLIT helps when the users are using LLM + VectorDBs + Other framework actions as the consolidated monitoring gives them a complete picture. Plus since its OpenTelemetry which a lot of people are looking to use.

I wanted to figure out a way to share this information to AI21 users especially the ones using python SDK. I was looking to add a guide in docs or a blog, Can someone help me with a process?