openai-python icon indicating copy to clipboard operation
openai-python copied to clipboard

Extend reqeust timeout

Open penut85420 opened this issue 1 year ago • 2 comments

To fix the async API hang issue during message sending, allow setting a sock_read timeout to prevent program unresponsiveness from incomplete transmissions.

penut85420 avatar Mar 22 '23 13:03 penut85420

I think with gpt-4, and the rest api running slower, if you send a big request - it's quite slow, and blows past the default 5 minute timeout.

I even think you need an async method, send a job, get a ticket, check the ticket. Or send a job, poll the queue.

sfarrell5123 avatar Mar 22 '23 15:03 sfarrell5123

much needed feature

suhjohn avatar Mar 23 '23 16:03 suhjohn

This is resolved in v1, which was released earlier this week 🎉

rattrayalex avatar Nov 10 '23 02:11 rattrayalex