azure-functions-openai-extension icon indicating copy to clipboard operation
azure-functions-openai-extension copied to clipboard

Published 20 hours ago • verified publisher icon cgillum

Feature Request: streaming support

Open sowsan opened this issue 1 year ago • 0 comments

Seems Azure Functions HTTP Trigger for Open AI doesn't support streaming as of today. Would be great to have streaming support like other frameworks supports.

Ref:

https://cookbook.openai.com/examples/how_to_stream_completions

https://platform.openai.com/docs/api-reference/streaming

sowsan avatar Aug 26 '24 15:08 sowsan