Florian Jetter

I'm not thrilled about the drain option and would prefer teaching lifetime / retire_workers to not kill workers which are still running stuff. I haven't tested this but it may...

@jaabberwocky Of course, let me know if there are any questions!

With https://github.com/dask/distributed/pull/8634 this will be a little less severe since we're delaying the initialization of logging until we actually need it but once we do it may still be global

I just stumbled over this via https://github.com/dask/distributed/issues/5383 and wanted to add that there is also a way to tell dask what the size of an object is without overloading `__sizeof__`,...

I stumbled over this in https://github.com/pydata/xarray/issues/9088 again Given that... 1. There appears to be some reluctance of implementing a dunder method 2. apparently all dask imports in xarray are lazy...

xarray is important enough that we can put this into dask itself. We can handle lazy registration there as well and are doing this for others important libs as well....

> What does dask use this size for? Does it want the size in memory when all buffers are loaded? Or just the in-memory of the Xarray object at present...

The SystemError looks like a CPython error. I wonder if this goes away with python 3.12. Dask is _likely_ not to blame for this one. It happens when we execute...

This is almost certainly https://github.com/dask/dask/pull/11790 and it is indeed more strict than before. Are you sure that your test case actually worked before? > See comments https://github.com/dask-contrib/dask-awkward/pull/572#issuecomment-2749343496 for more weirdness....

HLGs are still supported but will likely see even less attention than they've had over the last few years. I expect that once dask arrays are backed by HLGs, they...