openai-multi-client icon indicating copy to clipboard operation
openai-multi-client copied to clipboard

Published 20 hours ago • verified publisher icon cozodb

Does this allow for token streaming?

Open cassianlewis opened this issue 2 years ago • 0 comments

Ie would batching (ChatCompletion) work with token streaming?

cassianlewis avatar Oct 30 '23 11:10 cassianlewis