BentoML
BentoML copied to clipboard
Add configuration option for runner timeout
Long model inference request could timeout the current runner request. Runner timeout is currently hardcoded at 5 minutes. We should make the runner timeout value configurable. SageMaker deployment through bentoctl can generate the configuration with an updated timeout value during build.