Charles Stern

> Could you just do? %time ds = xr.open_dataset(cache_path) Yes, I did try that in https://github.com/cisaacstern/cesm-open-dataset/blob/main/cesm_open_dataset.ipynb. But at the time I didn't know that ... > It's acceptable if prepare_target...

@paigem, this data is now available as a zarr store on OSN: ```python import fsspec import xarray as xr path = "s3://Pangeo/pangeo-forge/cesm_pop_lowres_1deg/v5_rel04_BC5_ne30_g16.zarr" mapper = fsspec.get_mapper( path, anon=True, client_kwargs={'endpoint_url': 'https://ncsa.osn.xsede.org'}, )...

@rabernat, the usage pattern for the [subsetting module](https://github.com/pangeo-forge/staged-recipes/pull/56/files#diff-d67a81480194bcd8f026355ee7dbce0d9c5fb71de1d911c663732ec2f4d5a4ab) I mentioned in https://github.com/pangeo-forge/staged-recipes/pull/56#issuecomment-899180590 is: ```python from subset_recipe import variables fs_gcs = gcsfs.GCSFileSystem( # ...creds, etc ) target_bins = 60 # number...

> It looks like the SST variable did not get transferred here. Thanks for catching this, Paige. This was indeed an oversight on my part. When I ran the NetCDF...

> I'll notify you on this thread when the corrected zarr is available. Rebuild is complete. The complete dataset should now be accessible via the code block provided above in...

> One question that came up however is whether it would be best to move these data from their current residence on the NOAA FTP server to THREDDS Up to...

@jordanplanders, if the data is small enough to host on GitHub, perhaps hosting on Zenodo is preferable? Re: side-stepping auth this way, let's just make sure that the data provider's...

Yep, that makes sense to me. Thanks for thinking through it out loud. Among other things, hopefully these conversations may be useful to others contemplating similar things down the line....

Looking forward to the PR! Please let me know if/how I can help.

> Can I send you the password? Yep! https://keybase.io/cstern