Ryan Abernathey

Great, thanks for chiming in! The problem is that in Pangeo Forge (in contrast to the toy example I shared), we don't necessary know that it's an http link. It...

What about this? ```python fs, _, paths = fsspec.get_fs_token_paths(url, storage_options={'auth': auth}) cache_fs = fsspec.implementations.cached.CachingFileSystem(fs=fs) with cache_fs.open(paths[0]) as fp: data = fp.read() ```

The only real problem with `pattern_from_file_sequence` is that it _may_ contribute to the task-graph memory issues that we have struggled with in the past. The way to resolve this would...

Hi @nbarlowATI and welcome! You are correct that this is not yet supported. You are welcome to try to implement it, and we would love to have your contribution. However,...

Having just written that up, I realize that I may be able to make some progress on this fairly quickly and also refactor the code along the lines Martin suggested....

Since we all seem to be online, could we drop in https://whereby.com/pangeo right now? I can work for another 2 hours today, then I am checking out for a long...

Also noting that this is basically the same as #98.

I highly recommend using some profiling on `xr.open_dataset` to learn about what is taking so much time. [Snakeviz](https://jiffyclub.github.io/snakeviz/) works great here. We could be generating the reference file system as...

There are three basic uses: - Validation against data corruption (most effective if the original hash is available somewhere) - Determining if we need to re-download a cached file -...

Now that #219 has been merged, it should be much easier to implement unit tests. This is because all of the "work" of the recipe now happens in standalone functions,...