async-openai icon indicating copy to clipboard operation
async-openai copied to clipboard

Published 20 hours ago • verified publisher icon 64bit

Support Azure Streaming

Open dougtallmadge opened this issue 1 year ago • 1 comments

Addresses https://github.com/64bit/async-openai/issues/74 and adds support for Embedding Deserialization. This also allows for streaming completion to fail gracefully on any Stream ended event as supposed to hanging until a timeout.

dougtallmadge avatar Sep 16 '23 22:09 dougtallmadge

Thanks for the fix and PR @dougtallmadge

Interesting fix, I'm still left to wonder why [DONE] marker doesn't work as expected.

There's a corresponding test (commented out) in examples/azure-openai-service to help test this - it would be much appreciated if you can see that works with this fix?

64bit avatar Sep 20 '23 02:09 64bit