YAXArrays.jl icon indicating copy to clipboard operation
YAXArrays.jl copied to clipboard

savecube does not write .zmetadata file for zarr data

Open felixcremer opened this issue 1 year ago • 1 comments

I am not entirely sure what the purpose of the .zmetadata file is and therefore I am not sure whether this is supposed to be written or not. This is just something that is different when opening and saving one of the Geozarr examples. I will add the link to the example datasets when I have a more reliable internet connection

felixcremer avatar Mar 06 '24 18:03 felixcremer

Some info here.

"Finally, it’s worth noting that Xarray writes (and attempts to read) “consolidated metadata” by default (the .zmetadata file), which is another non-standard Zarr extension, albeit one implemented upstream in Zarr-Python. You do not need to write consolidated metadata to make Zarr stores readable in Xarray, but because Xarray can open these stores much faster, users will see a warning about poor performance when reading non-consolidated stores unless they explicitly set consolidated=False. See Consolidated Metadata for more details."

https://docs.xarray.dev/en/latest/internals/zarr-encoding-spec.html https://docs.xarray.dev/en/latest/user-guide/io.html#io-zarr-consolidated-metadata

Balinus avatar Mar 13 '24 15:03 Balinus