Tom Nicholas
Tom Nicholas
We should be able to write a new VirtualiZarr reader for the Hugging Face SafeTensors format. > Hugging Face [safetensors](https://huggingface.co/docs/safetensors/index) is an interesting example - it's uncompressed so basically just...
> Also might as well add all your dependencies. You should add all dependencies even optional ones IMO > > - numcodecs: https://numcodecs.readthedocs.io/en/stable/objects.inv > - fsspec: https://filesystem-spec.readthedocs.io/en/latest/objects.inv > - requests:...
Replacement for #183, but this PR takes advantage of indexing internals from zarr-python v3 - [ ] Closes #51 - [ ] Tests added - [ ] Tests passing -...
Allows you to subset `ManifestArray` objects, as long as your indexer slice aligns with chunk boundaries. - [x] Closes #51 - [x] Tests added - [x] Tests passing - [x]...
https://github.com/zarr-developers/VirtualiZarr/issues/124 describes @ayushnag's idea to allow loading data variables directly from the in-memory `ManifestArrays`, rather than having to write to kerchunk/icechunk then reading from that. PR #458 will add a...
From https://docs.csc.fi/support/tutorials/gis/virtual-rasters/ (emphasis mine): > [Virtual rasters](https://gdal.org/drivers/raster/vrt.html) is useful GDAL concept for managing large raster datasets that are split into not overlapping map sheets. Virtual rasters are not useful for...
Can we Virtualize Parquet data? See also this spec for storing raster data in Parquet: https://github.com/CartoDB/raquet
I'm not super happy with the `vds.virtualize.to_` accessor name. It's confusing - really the "virtualize" accessor doesn't "virtualize" anything, the references are already virtual, it just allows you to write...
I ran the scientific-python.org [repo-review tool](https://learn.scientific-python.org/development/guides/repo-review/) on this repository: ``` (dev3.11) tom@Toms-MBP virtualizarr % pipx run 'sp-repo-review[cli]' . General: • Detected build backend: MISSING • Detected license(s): Apache Software License...
- [x] Closes #436 - [x] Tests added - [x] Tests passing - [x] Full type hint coverage - [ ] Changes are documented in `docs/releases.rst` - [ ] ~~New...