Joe Hamman
Joe Hamman
Would people like to see a prototype conda-buildpack that implements some of these ideas? I think we can knock that out in the next few weeks and be ready to...
I've bumped the time to 315 ET so @nbren12 and I can join. Hopefully that works for everyone.
Hi @jsadler2 - Can you show us what `sm_from_zarr` looks like (`print(sm_from_zarr)`) will do.
Thanks @jsadler2 - I think this is a bug in xarray. We should be able to round trip the `site_coordinate` variable.
Thanks @andersy005 for the write up and for digging into this. Doesn't this seem like it could be a bug in Zarr's `create` method?
> Is this something that we want to coordinate with other cluster managers (dask-yarn, dask-kubernetes). If so, how? cc @jcrist @jacobtomlinson I'd argue that the running/pending/finished job/worker classification is going...
Is this worth reviving? I still think this would be a worthwhile addition.
I think this is a good idea. I think our current approach made sense as a starting point but poses some challenges when maintaining many job schedulers.
@jacobtomlinson gave CuPy a go a few months back. I seem to remember that he ran into a few problems but it would be good to get those documented here.
I think this would be useful when using an autoscaling cluster. Particularly when jobs are waiting in the queue and the adaptive cluster is trying to decide if it should...