LLPhant
LLPhant copied to clipboard
Feature Request: Specifying timeout
Hello,
When we do larger prompts we often run into timeouts.
Currently it defaults to default_socket_timeout I believe.
The OpenAI client offers a way to specify the timeout. I'm not sure if this can be directly applied as such here.
Reference: https://github.com/openai-php/client?tab=readme-ov-file#timeout
Would be awesome if this could be added to this library as well.
Thanks