langchain icon indicating copy to clipboard operation
langchain copied to clipboard

fix for azure open ai not returning content sometimes for the when stopping.

Open venatir opened this issue 1 year ago • 1 comments

When making hundreds of async calls to azure openai, sometimes the response is missing content. {"finish_reason":"stop", ...} This happens in _create_chat_result(). From here _convert_dict_to_message() is called and _dict["content"] is accessed. This leads to very long chain crashing. This error is not caught by any retry mechanism.

venatir avatar May 04 '23 22:05 venatir

hmmm do we know why the response is missing content?

hwchase17 avatar May 14 '23 03:05 hwchase17

hmmm do we know why the response is missing content?

not really. It happens rarely.

venatir avatar Jun 19 '23 14:06 venatir

believe this has been fixed

baskaryan avatar Aug 01 '23 00:08 baskaryan