DeepSpeed-MII icon indicating copy to clipboard operation
DeepSpeed-MII copied to clipboard

Add Kubernetes health check route to REST server

Open richiejp opened this issue 1 year ago • 0 comments

A minimal health check which can be used by Kubernetes (amongst others) to check if the service is ready to receive requests.

It doesn't check if the backend is active, so should be combined with a check to the gRPC backend.

richiejp avatar Mar 20 '24 10:03 richiejp