go-gpt3 icon indicating copy to clipboard operation
go-gpt3 copied to clipboard

Published 20 hours ago • verified publisher icon PullRequestInc

No Token Usage Information when Streaming

Open abdulrabbani00 opened this issue 2 years ago • 3 comments

Hello, when I use the CompletionStreamWithEngine function I notice that all token values are marked as 0. Is it safe to assume that every message that is streamed is a single token?

abdulrabbani00 avatar Jan 21 '23 12:01 abdulrabbani00