Forge.OpenAI icon indicating copy to clipboard operation
Forge.OpenAI copied to clipboard

Published 20 hours ago • verified publisher icon JZO001

Setting the timeout on requests to ChatCompletionService

Open robertstewartnz opened this issue 2 years ago • 2 comments

Is there an easy way to change the timeout.

I've been hitting a timeout issue in my response from the ChatCompletionService. The max appears to be 100seconds.

robertstewartnz avatar Oct 10 '23 02:10 robertstewartnz

Where is the timeout comes? From the HttpClient or from the OpenAI service? If your would like to configure HttpClient Timeout value, the quickest way right now, if you extend the ApiHttpClientFactory and replace the service registration in the DI container.

JZO001 avatar Oct 10 '23 07:10 JZO001

Thanks.

Get Outlook for Androidhttps://aka.ms/AAb9ysg

From: Zoltan Juhasz @.> Sent: Tuesday, October 10, 2023 8:49:59 PM To: JZO001/Forge.OpenAI @.> Cc: Robert Stewart @.>; Author @.> Subject: Re: [JZO001/Forge.OpenAI] Setting the timeout on requests to ChatCompletionService (Issue #2)

Where is the timeout comes? From the HttpClient or from the OpenAI service? If your would like to configure HttpClient Timeout value, the quickest way right now, if you extend the ApiHttpClientFactory and replace the service registration in the DI container.

— Reply to this email directly, view it on GitHubhttps://github.com/JZO001/Forge.OpenAI/issues/2#issuecomment-1754608597, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AXN6OCPCBMDPUFH5WU5OFX3X6T42PAVCNFSM6AAAAAA5ZUGLYOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONJUGYYDQNJZG4. You are receiving this because you authored the thread.Message ID: @.***>

robertstewartnz avatar Oct 10 '23 07:10 robertstewartnz