Ryan Abernathey

@martindurant thanks for the pointer. Yes kerchunk netcdf3 support would be a great because then we could use `open_input_with_kerchunk` here! However, it seems like it would also be good to...

Just to confirm this is not an xarray issue ```python %%filprofile from scipy.io import netcdf_file with fsspec.open(url, "rb") as fp: ncf = netcdf_file(fp, mmap=False) ```

> I believe this is doable by including the configuration for the pangeo-forge logger under the `logging` key in the dask config, but that needs to be confirmed (I have...

The environment is listed out here: https://github.com/pangeo-forge/pangeo-forge-recipes/runs/4358634535?check_suite_focus=true#step:11:42 Would pinning a specific version somewhere help?

As I mentioned at our latest meeting, I'm having some challenges around this refactor because our current "opener" mixes together file opening and caching. Caching is essentially a side effect...

This is a good idea. Making it work would require significant refactoring to the "pipelines" execution model. We would need the ability for sequence for a map stage to be...

Thanks for the issue. Can you give a little more context. What code produced this error?

Ok and how are you "running" it? Via the prefect executor? Can you share the code that is loading and executing the recipe? We need to get to a reproducer...

Sorry to keep asking questions! ... but can you link me to the worker logs? Do you have the pangeo_forge logs turned on?

Ok, glad it resolved, but nevertheless we should keep an eye on this. Intermittent bugs are the hardest to squash!