gateway icon indicating copy to clipboard operation
gateway copied to clipboard

Fix Steaming response usage object for anthropic

Open narengogi opened this issue 1 year ago • 0 comments

What Happened?

Anthropic transform currently sends completion_tokens and prompt_tokens in separate chunks

What Should Have Happened?

Openai format is to send them together in the last chunk

Relevant Code Snippet

No response

Your Twitter/LinkedIn

No response

narengogi avatar Aug 08 '24 07:08 narengogi