Ryan Abernathey

Welcome and thanks for the questions. > For example, if a chunk file is malformed, this won't be detected until you actually try to use the containing array. This is...

> we are (at least for our backend on s3) working on a tree-hash scheme to store checksums associated with every file and "directory" in the tree. In that case...

> The other thing that typically comes to mind when discussing dimensions, which I don't think has come up thus far is units. > For tracking time in some cases...

It might be useful for the discussion if I explain what xarray currently does to add dimension support to zarr stores. This might help clarify some of the tradeoffs between...

This recent blog post by @rprudden gives some very pertinent suggestions: https://medium.com/informatics-lab/arrays-on-the-fly-9509b6b2e46a

> It would be great if the zarr specification owners weigh in on this. I just read through this long and thoughtful thread. Thanks to everyone participating. I am :+1:...

Thanks for sharing. This sounds like a perfect application for Zarr. > * What would be the metadata size for that ? Is there an explicit mapping to each chunk,...

> 1. Do you confirm that zarr can map from array index to chunk index only by function of the chunk shape ? Yes. If you have a 3D Zarr...

This is related to #843. I would also note that it has been proposed to factor Xarray's lazy indexing classes into a standalone package (https://github.com/pydata/xarray/issues/5081).

HI @cgohlke! Thanks for reporting this issue and sorry that no one has replied to you yet. It sounds like you are suggesting that an optimization should be made such...