zarr-python icon indicating copy to clipboard operation
zarr-python copied to clipboard
verified publisher icon zarr-developers

Support consolidated metadata in v2 > v3 conversion CLI

Open K-Meech opened this issue 3 months ago • 2 comments

Currently, the CLI for converting between zarr v2 and v3 metadata (https://github.com/zarr-developers/zarr-python/pull/3257) doesn't handle consolidated metadata. If a .zmetadata file is detected, then conversion is stopped and an error is thrown.

It would be useful to support consolidated metadata in future.

K-Meech avatar Sep 17 '25 13:09 K-Meech

@K-Meech we are highly interested in that feature, and I would like to understand why consolidated metadata is not supported at the moment ? what makes it more difficult compared to the non consolidated metadata archives?

meteoDaniel avatar Dec 10 '25 19:12 meteoDaniel

Thanks @mateoDaniel - it wasn't included in the initial converter PR, mainly for ease of review (it was already quite large, and adding support for consolidated metadata would have needed extra checks for validity / extra tests etc…). It was decided it would be best to add this in a separate follow-up PR.

I haven't had time to do this as of yet - but anyone else is very welcome to have a go at this! I'm not sure how difficult it would be to add this - it would need extra checks to make sure the consolidated metadata is valid + consistent with the rest of the metadata before and after the converter is run.

K-Meech avatar Dec 16 '25 09:12 K-Meech