openinference icon indicating copy to clipboard operation
openinference copied to clipboard
verified publisher icon Arize-ai

[anthropic] add support for streaming

Open mikeldking opened this issue 1 year ago • 2 comments

Most conversational products use streaming so we need to accumulate the tokens.

mikeldking avatar Aug 28 '24 16:08 mikeldking

Planning on starting work on this in 2 weeks.

mikeldking avatar Aug 28 '24 18:08 mikeldking

https://github.com/Arize-ai/openinference/pull/990

harrisonchu avatar Sep 03 '24 18:09 harrisonchu

Closing as completed via #990

mikeldking avatar Dec 02 '24 16:12 mikeldking