dask-kubernetes
dask-kubernetes copied to clipboard
dask
Native Kubernetes integration for Dask
Using make_pod_spec, it is not possible to add additional containers correctly. ``` In [43]: type(make_pod_spec('testimage').spec.containers[0]) Out[43]: kubernetes.client.models.v1_container.V1Container In [44]: type(make_pod_spec('testimage', extra_pod_config={"containers":[{"name":"test"}]}).spec.containers[0]) Out[44]: dict In [45]: type(make_pod_spec('testimage', extra_pod_config={"containers":[{"name":"test"}]}).spec.containers[1]) Out[45]: dict ```...
The new experimental cluster manager relies on the operator and CRDs to create the Dask cluster components for us. We need to ensure that the user experience is good for...
Thanks for the great work on the dask-operator! Three quick notes from trying it on our cluster: * The scaling of workers assumes that each worker pod only has one...
When `2022.5.1` was released the `ghcr.io/dask/dask-kubernetes-operator:2022.5.1` Docker image was built and published by Chartpress. However `ghcr.io/dask/dask-kubernetes-operator:latest` wasn't updated and continued to point to the previous release. I've manually tagged `latest`...
Closes #497. The PR aims to ensure the operator will play nicely with Istio. As discussed in #482 the way to achieve this is for the workers to have a...
A follow up to #482 which was solved by disabling Istio sidecar injection on our pods in #496. It would be nice to get actual support working. ### Tasks -...
**What happened**: I am using `KubeCluster` for running ad-hoc dask cluster as part of my script. I am trying to gracefully shut down the cluster in case there was an...
Adding some default config options suggested by @philipp-sontag-by in [#392](https://github.com/dask/dask-kubernetes/pull/392#pullrequestreview-907545869). @philipp-sontag-by would you mind reviewing to make sure I captured your suggestions correctly?
There are various workflows that the operator enables. Some steps are carried out by the user (creating `daskcluster` resources), some things are done by the operator (creating pods/services), some things...
I hate being the first issue after minutes of release, `KubeCluster2` adapt is broken ```python from dask_kubernetes.experimental import KubeCluster from dask.distributed import Client cluster = KubeCluster(name='helloworld') cluster.adapt(minimum=1, maximum=4) client =...
