gateway
gateway copied to clipboard
fix: Make anthropic usage object in streaming mode compliant with openAI response
Title:
- Make anthropic usage object in streaming mode compliant with openAI response
Description:
- Moved prompt_tokens to streamState object
- used the streamState object to access the prompt_tokens
Related Issues:
- https://github.com/Portkey-AI/gateway/issues/496