Tom Nicholas
Tom Nicholas
We also might want `ManifestStore.to_virtual_dataset()` to automatically create in-memory numpy-array-backed Variables for any ManifestArrays containing only `memory://` chunk references. But because an individual ManifestArray can contain a mixture of `memory://`...
This is really interesting! It sounds very much related to other conversations we have been having about using zarr stores that are either in-memory on one machine (see https://github.com/cubed-dev/cubed/issues/502), in-memory...
Thanks @mdsumner . Looking at this more closely, there is a tab that displays different code for different backends. The current code with `{bucket}/{path}` is correct for the `S3` case....
> RuntimeError: Can't get fill value (fill value is undefined) That's weird but it's an upstream issue in kerchunk. EDIT: Possibly related to https://github.com/fsspec/kerchunk/issues/177 > returns a dataset with most...
Also we should probably have some more tests that explicitly check that all the same variables and coordinates are present for a set of different example real-world files, whether opened...
> I made a kerchunk JSON of the file and the missing variables (lon, lat, lon_bnds, lat_bnds) do not even have a corresponding .zarray in the JSON. That definitely sounds...
> Should that be added as an explicit kwarg here? Or should we pass arbitrary kwargs to the [xr.open_zarr() call](https://github.com/zarr-developers/VirtualiZarr/blob/8230c365ebb4f44ad9393d508e0ea89b976c5c74/virtualizarr/xarray.py#L341-L348)? I guess we might need to do that yes. We...
My thoughts about that NISAR file are here: https://github.com/zarr-developers/VirtualiZarr/pull/713#pullrequestreview-3036255517. But I think the parsers option sounds best - if possible we want anything that has already been parsed to be...
Coordinates don't exist in zarrs model, so when Xarray opens a zarr store (or a kerchunk references representation of one), my understanding of how it determines zarr arrays should be...
Hi @louisletoumelin , thanks for raising this. > I tried to replicate the behavior with datatree version's on the xarray repo. The `.pad` issue disappear In that case then unless...