DeepSpeed-MII
DeepSpeed-MII copied to clipboard
Add Kubernetes health check route to REST server
A minimal health check which can be used by Kubernetes (amongst others) to check if the service is ready to receive requests.
It doesn't check if the backend is active, so should be combined with a check to the gRPC backend.