apm-agent-python icon indicating copy to clipboard operation
apm-agent-python copied to clipboard
verified publisher icon elastic

Support for Azure OpenAI

Open sorenlouv opened this issue 1 year ago • 0 comments

The APM agent should have support for auto-instrumentation of OpenAI library in order to better support applications that interacts with this LLM.

What we need to collect that we don’t collect OOTB today :

  • User prompt (string)
  • LLM response (string)
  • Token count (number)

Related

  • https://github.com/elastic/observability-docs/issues/3961
  • https://github.com/elastic/apm-agent-nodejs/issues/4074

sorenlouv avatar Jun 10 '24 12:06 sorenlouv