haystack icon indicating copy to clipboard operation
haystack copied to clipboard

Add timeout to AzureOpenAIChatGenerator and AzureOpenAIChatGenerator

Open tomarharsh opened this issue 1 year ago • 0 comments

Is your feature request related to a problem? Please describe.

We utilize timeouts when calling OpenAI via Azure. In Haystack 1.X timeout could be provided via PromptNode but that's not available as a parameter to be passed any more with the AzureOpenAIChatGenerator and AzureOpenAIChatGenerator. It is available on OpenAIGenerator.

Describe the solution you'd like Add timeout parameter to AzureOpenAIChatGenerator and AzureOpenAIChatGenerator

Describe alternatives you've considered Nothing yet.

Additional context None

tomarharsh avatar May 21 '24 19:05 tomarharsh