Tom Nicholas
Tom Nicholas
To go back to the original issue, let me summarize where we are at with encoding. Opening encoded variables as `ManifestArray`s works in the sense that they can be round-tripped,...
Thanks for the update @sharkinsspatial ! I don't know a huge amount about the best way to do this either. > I think a lot of encoding challenges can be...
Part of this story is to delegate handling of CF conventions to xarray - see #157.
@sharkinsspatial suggested an interesting idea to aim for today: can we open data from a netCDF file using a zarr reader and roundtrip it? This would require the chunk manifest...
> @sharkinsspatial suggested an interesting idea to aim for today: can we open data from a netCDF file using a zarr reader and roundtrip it? I just raised https://github.com/zarr-developers/zarr-specs/issues/303 to...
v2.0.0 @DeanHenze ! Not 1. anything 😆
Better to just raise another issue instead of deleting anything here @DeanHenze
100%. We need a `get_virtual_ref` method to be implemented in Icechunk upstream. Then this should be easy - it's mostly the same as the existing `ZarrParser` (See https://github.com/earth-mover/icechunk/issues/104)
> At a high level it took 40sec to lazily open one subgroup in one of the hdf5 files using virtualizarr and it took ~3sec to open the full dataset...
> prevent needing to infer array metadata from the `ndarray` properties inside `store.get()` at runtime. I agree this would be nice. However I don't think this proposal really works >...