BentoML icon indicating copy to clipboard operation
BentoML copied to clipboard

Add configuration option for runner timeout

Open ssheng opened this issue 2 years ago • 0 comments

Long model inference request could timeout the current runner request. Runner timeout is currently hardcoded at 5 minutes. We should make the runner timeout value configurable. SageMaker deployment through bentoctl can generate the configuration with an updated timeout value during build.

ssheng avatar Aug 10 '22 04:08 ssheng