ray
ray copied to clipboard
[Serve] Introduce new deployment state in the deployment for autoscaling.
Description
Currently autoscaling event will trigger deployment to be 'UPDATING'.
It is useful to differentiate the autoscaling state out of the UPDATING state for better observability. (Sometimes autoscaling will trigger too often, it will cause confusion to the user.)
Use case
No response
Simplest version is to just avoid state changing to UPDATING on autoscaling changes