LLPhant icon indicating copy to clipboard operation
LLPhant copied to clipboard

Feature Request: Specifying timeout

Open Quazz opened this issue 11 months ago • 1 comments

Hello,

When we do larger prompts we often run into timeouts.

Currently it defaults to default_socket_timeout I believe.

The OpenAI client offers a way to specify the timeout. I'm not sure if this can be directly applied as such here.

Reference: https://github.com/openai-php/client?tab=readme-ov-file#timeout

Would be awesome if this could be added to this library as well.

Thanks

Quazz avatar Nov 26 '24 11:11 Quazz