newrelic-java-agent icon indicating copy to clipboard operation
newrelic-java-agent copied to clipboard

Java APM agent: AI Monitoring - Support for Converse and ConverseStream methods

Open doshidhaval opened this issue 1 year ago • 2 comments

Is your feature request related to a problem? Please describe.

The Converse API for Bedrock provides a consistent approach to trigger different models and has quite a few advantages over the InvokeModel APIs. Currently only the InvokeModel is instrumented.

Feature Description

Add AIM instrumentation for AWS SDK Bedrockruntime Converse and ConverseStream API

Describe Alternatives

Additional context

Priority

Please help us better understand this feature request by choosing a priority from the following options: Really Want

doshidhaval avatar Sep 19 '24 14:09 doshidhaval

https://new-relic.atlassian.net/browse/NR-315369

https://docs.aws.amazon.com/bedrock/latest/userguide/conversation-inference.html

https://newrelic.slack.com/archives/C05DWELBP0F/p1726868512084289

jasonjkeller avatar Sep 20 '24 22:09 jasonjkeller