Sean Sheng

- Health checking (https://github.com/bentoml/BentoML/issues/2630) - Start/stop hooks

## Goals - Instrument input and output of every prediction in both `api_server` and `runners` - Schematized - Agnostic of the wire protocols, e.g. HTTP, gRPC - Transferred in binary...

AWS’s ECR get-login-password expires every 12 hours

3

K8s to refresh secret with a cron job. Document in the AWS admin guide.

- CICD (covered in BentoML docs) - Architecture of distributed runners (P0) - Architecture of Yatai (P0) - Dependencies and explanations - Resource and replica configuration guide (P0) - Configure...

Health check endpoints, e.g. `/readyz`, `/livez`, on the API server and runner are limited to checking the health of the processes. Ideally, health check to the API server should be...

bug: incorrect tracing when batching is enabled

2

When batching is enabled, runner’s `/receive` span and any subsequent spans created in the service are always attributed towards the first trace id. The the trace of the first request...

feat: restrict mime types on Image IO descriptor

1

Allow only a subset of image mime types and reject the rest. ``` @api(input=Image(mime_type=['image/jpeg', 'image/png'], validate=True), output=JSON()) def predict(input_image: PIL.Image.Image) -> dict: ... ```