openllmetry icon indicating copy to clipboard operation
openllmetry copied to clipboard

🚀 Feature: Tracing support for Amazon SageMaker endpoints

Open bobbywlindsey opened this issue 7 months ago • 1 comments

Which component is this feature for?

All Packages

🔖 Feature description

Add tracing support for Amazon SageMaker endpoints

🎤 Why is this feature needed ?

Developers may deploy a variety of LLMs as endpoints on Amazon SageMaker. They'd query these endpoints using the InvokeEndpoint API to retrieve the LLM response.

✌️ How do you aim to achieve this?

  1. Create opentelemetry-instrumentation-sagemaker package
  2. Create instrumentation for the sagemaker-runtime service and patch the invoke_endpoint method.
  3. Create span for the request.

🔄️ Additional Information

No response

👀 Have you spent some time to check if this feature request has been raised before?

  • [X] I checked and didn't find similar issue

Are you willing to submit PR?

Yes I am willing to submit a PR!

bobbywlindsey avatar Jul 23 '24 19:07 bobbywlindsey