Guillaume Eynard-Bontemps
Guillaume Eynard-Bontemps
I hesitated to put this issue as a comment in #567, but I'm under the impression we have two separate problems. In #562, I override the `cleanup` fixture from distributed...
See discussions in #565. In particular https://github.com/dask/dask-jobqueue/pull/565#pullrequestreview-1052591018. It is not safe to create a `ProcessInterface` without a running loop. Use of the default event loop is deprecated in Python. We...
Since https://github.com/dask/dask-jobqueue/pull/545, we have added in most of the CI runs a `docker compose build` command that was not there (by choice) to use pre-backed Docker images. Without a `docker...
Closes #11. Main concern here: is this really useful in addition to cluster.__repr__ or client.__repr__. Personnaly, I like to have kind of detailed status, but find it only useful in...
In a recent PR #200, I've become aware that every JobQueueCluster implementation defines similar kwargs: * queue * project * walltime * job_extra (except sge) What should we do with...
One of the goal of `ClusterManager` object is to be able to launch a remote scheduler. In dask-jobqueue scope, this probably means submitting a job which will start a Scheduler,...
Currently, we only know that we have submitted some jobs to a cluster scheduler. We don't know if these jobs are running or queued, or in any other state. What...
While looking in several issues here, I feel that adding the ability to instanciate a JobQueueCluster with an already started Scheduler could help some use cases, and be a first...
I feel https://github.com/jupyterhub/batchspawner is using an interesting way of templating job script. See [SlurmSpawner](https://github.com/jupyterhub/batchspawner/blob/master/batchspawner/batchspawner.py#L532) for instance. I know we used some templated script before too, but we did not make...
Original problem raised by @jmichel-otb in https://github.com/dask/dask-jobqueue/issues/196#issuecomment-548412595. > I currently encounter the limitation of maximum number of jobs in queue. Our maximum number of jobs in queue is 100, which...