seldon-core icon indicating copy to clipboard operation
seldon-core copied to clipboard

Allow configurable upstream timeout for envoy

Open ukclivecox opened this issue 2 years ago • 2 comments

Presently hardwired to 60s. This could initial be changed to 0 to disable timeout. Ideally, a setting per Model/Pipeline.

ukclivecox avatar Aug 21 '23 06:08 ukclivecox

@cliveseldon how can I currently increase that timeout for all requests to all Models? Env var in the envoy pod? And which timeout are we talking about when model takes too long to respond?

mafs12 avatar Oct 11 '23 20:10 mafs12

Found it: https://github.com/SeldonIO/seldon-core/blob/v2.7.0-rc1/scheduler/pkg/envoy/resources/resource.go#L58. Already set to 0.

mafs12 avatar Oct 12 '23 21:10 mafs12