inference icon indicating copy to clipboard operation
inference copied to clipboard

Published 20 hours ago • verified publisher icon xorbitsai

ENH: Support stream_options for OpenAI create chat completion

Open qinxuye opened this issue 9 months ago • 0 comments

Is your feature request related to a problem? Please describe

OpenAI SDK released v1.26.0 added a stream_options for create chat completion when stream=True, see

https://github.com/openai/openai-python/releases/tag/v1.26.0

and

https://platform.openai.com/docs/api-reference/chat/create#chat-create-stream_options

We could follow the behaviour.

qinxuye avatar May 07 '24 02:05 qinxuye