agents icon indicating copy to clipboard operation
agents copied to clipboard

OpenAI timeouts are too low / aren't handled well

Open jezell opened this issue 4 months ago • 2 comments

The LLM client is configured with a 5 second read timeout. If the client times out (which it does very often with a short timeout), the stream is not resumed.

The error handling needs to be more graceful, but the timeout really shouldn't be 5 seconds by default.

jezell avatar Sep 28 '24 07:09 jezell