dask-kubernetes icon indicating copy to clipboard operation
dask-kubernetes copied to clipboard

Ability to set NodePort IP manually

Open andersbogsnes opened this issue 4 years ago • 2 comments

I love the new setup for KubeCluster with the in-cluster Scheduler. We have the same usecase of wanting to run Dask jobs on remote K8s cluster from laptops and I pretty much have it running in the static version.

Our blocker for transitioning to KubeCluster is that we need to use Nodeports for accessing the scheduler, but our service accounts aren't allowed to have the "list node" privilege. Is there a way to pass in the IP to use for the scheduler, bypassing the NodePort lookup?

andersbogsnes avatar Jul 20 '21 14:07 andersbogsnes

There isn't a way to do this currently, but we could definitely add this.

We would need a new config option which would make its way here and set the host instead of doing the lookup.

https://github.com/dask/dask-kubernetes/blob/6da9413cdfeac686217ccae3ae29189e04e16144/dask_kubernetes/utils.py#L56-L57

Do you have any interest in contributing this?

jacobtomlinson avatar Jul 20 '21 15:07 jacobtomlinson

Certainly, I'd love to give it a shot!

andersbogsnes avatar Jul 20 '21 17:07 andersbogsnes

The classic KubeCluster was removed in https://github.com/dask/dask-kubernetes/pull/890. All users will need to migrate to the Dask Operator. Closing.

jacobtomlinson avatar Apr 30 '24 15:04 jacobtomlinson