haystack
haystack copied to clipboard
Add timeout to AzureOpenAIChatGenerator and AzureOpenAIChatGenerator
Is your feature request related to a problem? Please describe.
We utilize timeouts when calling OpenAI via Azure. In Haystack 1.X timeout could be provided via PromptNode but that's not available as a parameter to be passed any more with the AzureOpenAIChatGenerator and AzureOpenAIChatGenerator. It is available on OpenAIGenerator.
Describe the solution you'd like
Add timeout parameter to AzureOpenAIChatGenerator and AzureOpenAIChatGenerator
Describe alternatives you've considered Nothing yet.
Additional context None