langroid
langroid copied to clipboard
Add streaming token usage for OpenAI models
Streaming output did not include usage information until now.
This week OpenAI updated their API to include this