BentoML
BentoML copied to clipboard
feat: Cascade readiness and liveness checks to runners in the same container
Health check endpoints, e.g. /readyz
, /livez
, on the API server and runner are limited to checking the health of the processes. Ideally, health check to the API server should be cascaded to the runners deployed in the same bento container.