langroid icon indicating copy to clipboard operation
langroid copied to clipboard

Add streaming token usage for OpenAI models

Open pchalasani opened this issue 1 year ago • 0 comments

Streaming output did not include usage information until now.

This week OpenAI updated their API to include this

pchalasani avatar Jun 07 '24 00:06 pchalasani