BentoML icon indicating copy to clipboard operation
BentoML copied to clipboard

feat: Cascade readiness and liveness checks to runners in the same container

Open ssheng opened this issue 2 years ago • 0 comments

Health check endpoints, e.g. /readyz, /livez, on the API server and runner are limited to checking the health of the processes. Ideally, health check to the API server should be cascaded to the runners deployed in the same bento container.

ssheng avatar Sep 21 '22 04:09 ssheng