strix
strix copied to clipboard
[FEATURE] Add Configurable LLM Timeout
The timeout is hard coded to 180 [seconds]. When running a low-budget setup, the models can run very slow and timeout. We should have a configurable timeout via ENV variable, while 180 can still be the default setting.