openllmetry
openllmetry copied to clipboard
🚀 Feature: Tracing support for Amazon SageMaker endpoints
Which component is this feature for?
All Packages
🔖 Feature description
Add tracing support for Amazon SageMaker endpoints
🎤 Why is this feature needed ?
Developers may deploy a variety of LLMs as endpoints on Amazon SageMaker. They'd query these endpoints using the InvokeEndpoint API to retrieve the LLM response.
✌️ How do you aim to achieve this?
- Create
opentelemetry-instrumentation-sagemaker
package - Create instrumentation for the
sagemaker-runtime
service and patch theinvoke_endpoint
method. - Create span for the request.
🔄️ Additional Information
No response
👀 Have you spent some time to check if this feature request has been raised before?
- [X] I checked and didn't find similar issue
Are you willing to submit PR?
Yes I am willing to submit a PR!