Patrick Hoefler

Results 345 comments of Patrick Hoefler

Just linking my other comment here: https://github.com/dask/dask/issues/11026#issuecomment-2455922728

Can you help me understand a bit better what high-level API would be useful here? My understanding of the steps involved is as follows: - map blocks to do a...

No worries, let's just tackle this a bit later then.

Can you elaborate a bit more? Did we break something in Dask since we fixed the ordering? Edit: I think I misread your comment. You mean that the improved ordering...

Puuuh, you had me worried there for a bit 😂

Good point, I mixed that up.... Is delayed generally better or is that incorrect?

Can you share a reproducer and your Dask / Xarray versions?

That's indeed not supported. Might be easy to add, but haven't looked closely yet.

You really should be using a Cluster if you have anywhere close to full memory sized or larger datasets, the performance of the threaded scheduler is terrible because of GIL...