gateway
gateway copied to clipboard
Fix Steaming response usage object for anthropic
What Happened?
Anthropic transform currently sends completion_tokens and prompt_tokens in separate chunks
What Should Have Happened?
Openai format is to send them together in the last chunk
Relevant Code Snippet
No response
Your Twitter/LinkedIn
No response