dask-kubernetes icon indicating copy to clipboard operation
dask-kubernetes copied to clipboard

Cleanup pending pods on scale down

Open BitTheByte opened this issue 9 months ago • 2 comments

Currently, the operator retires workers using the HTTP or RPC APIs however those only control the connected dask workers, the operator should take into count dask's Kubernetes worker pods that are in a pending state as those will cause a useless Kubernetes cluster scale-up and then connect to dask and get retired thus a scale down should retire active workers and prevent pending pods from entering running state

BitTheByte avatar Sep 16 '23 14:09 BitTheByte