kubeai icon indicating copy to clipboard operation
kubeai copied to clipboard

Configure a default timeout of 30 minutes

Open samos123 opened this issue 1 year ago • 2 comments

Any request that's pending for more than 30 minutes should return a 408 HTTP timout error

This timeout should be configurable. A value of 0 would disable it such that there is no timeout.

samos123 avatar Jan 13 '24 04:01 samos123

Any suggestions for where you would want the implementation to go, I was thinking maybe a timer could go here:

https://github.com/substratusai/lingo/blob/7a474239f2dd806a0f97fd9e453abf77461b8384/pkg/proxy/request.go#L38

willschneider15 avatar Apr 02 '24 20:04 willschneider15

I am not up to speed on the correct implementation off the cuff so I skimmed this article and it looks pretty informative: https://ieftimov.com/posts/make-resilient-golang-net-http-servers-using-timeouts-deadlines-context-cancellation/

nstogner avatar Apr 04 '24 19:04 nstogner