netcdf-c icon indicating copy to clipboard operation
netcdf-c copied to clipboard

Add testing for Zarr S3 support

Open dopplershift opened this issue 4 years ago • 4 comments

Without on-going testing of the Zarr-S3 support, it will undoubtedly break. Plus it would be really helpful to test/document the build steps, etc. There are now numerous public datasets available on AWS; for instance HRRR data available in Zarr. We should make use of this to have a regular integration test of this support, just like we do for the DAP code.

dopplershift avatar May 10 '21 20:05 dopplershift

cc @DennisHeimbigner

dopplershift avatar May 10 '21 20:05 dopplershift

Thanks for the HRRR pointer; that will allow at read testing of pure-zarr support.

DennisHeimbigner avatar May 10 '21 20:05 DennisHeimbigner

@DennisHeimbigner If you want any more datasets, you can go to the AWS Public Dataset Registry and search for "zarr". That gave me 6 datasets--might be good to at least do a local test and see if they all work. 😉

dopplershift avatar May 10 '21 21:05 dopplershift

Upvote from me. Could the Pangeo and broader zarr community rally a shared set of test resources to be hosted on some community object store?

Maybe host it on https://www.openstoragenetwork.org/ ?

dblodgett-usgs avatar Dec 10 '22 15:12 dblodgett-usgs