Florian Jetter

@AmirAflak yes please! Contributions are always welcome. If you need help getting started, see https://docs.dask.org/en/latest/develop.html#contributing-to-code or just ask here for help

The too large payload problem should've been addressed by https://github.com/dask/distributed/pull/8507 which has been released in [2024.2.1](https://github.com/dask/distributed/releases/tag/2024.2.1)

@yoninachmany I assume you should receive this error message with pretty much every version of dask. At least in your example, you are using `processes` to schedule your computation. In...

> cloudpickle, can't pickle a 'weakref.ReferenceType' object > Related to the use of metpy/pint units The pickle vs cloudpickle thing here is not that important. I suggest to inspect whatever...

> I don't see any progress on the dashboard. @sudarshan85 It's very likely that you are encountering a different issue and the GC warning log is unrelated. I suggest to...

Putting this in without allowing configuration is probably actually dangerous. If there are applications runnign which print a lot, this would suddenly cause a lot of logs which might otherwise...

This looks very interesting. I'll try to take a closer look at the code and think about where this should end up in. From first glance this is a mixture...

I also do consider this plugin to be a bit too complex, in particular considering that recently a lot of work has been poured into the graph representation and I'm...

> The plugin is still marginally superior in terms of transfer reduction/speed (but not by much in this example), but this will likely be infinitely more robust. > there is...

I completely forgot, performance reports Before  https://gistcdn.githack.com/fjetter/6e04f5ced602378977c8fea0037e2c31/raw/b8dbbd5ae962ede8c0853926649619714ae1ded3/gh4471.html After  https://gistcdn.githack.com/fjetter/6e04f5ced602378977c8fea0037e2c31/raw/b8dbbd5ae962ede8c0853926649619714ae1ded3/gh4471_combined.html