zarr-python
zarr-python copied to clipboard
An implementation of chunked, compressed, N-dimensional arrays for Python.
In v2, at array access time it is possible to set whether empty chunks (defined as chunks that are entirely `fill_value`) should be written to storage or skipped. This is...
### Zarr version 3.0.0.beta ### Numcodecs version 0.13 ### Python Version 3.11 ### Operating System Mac ### Installation pip ### Description `write_empty_chunks` was a very useful write-time optimization that we...
For some specific shapes of `chunks_per_shard` (e.g. `[5,2]`), the current implementation of morton code will produce indices that are not within the shape. Therefore reading the sharding index will drop...
This PR adds a boolean `array.write_empty_chunks` value to the global config, and uses this value to control whether chunks that are "empty", i.e. filled with values equivalent to the array's...
### Zarr version 3.0.0.beta ### Numcodecs version 0.13 ### Python Version 3.11 ### Operating System Mac ### Installation pip ### Description We are missing the `Group.tree` method from 2.x. We...
This is a weird and unexpected behavior ```python import xarray as xr import zarr import s3fs print(xr.__version__, zarr.__version__) # -> ('0.9.7.dev3734+g26081d4f', '3.0.0b1.dev8+g9bbfd88') s3 = s3fs.S3FileSystem() # replace with your favorite...
### Zarr version 3 ### Numcodecs version ? ### Python Version ? ### Operating System ? ### Installation ? ### Description deleting a group does not delete subgroups. Discovered in...
Adds a `path` attribute to all the store classes. Key operations like `get`, `set`, `list`, `list_prefix` etc are now scoped to the subtree rooted by the `path` attribute of the...
This PR implements the main ideas from #2391, removing `crc32c` and `fsspec` as core dependencies and adding them to the `sharding` and `remote` groups respectively. Imports are adjusted in minor...
Port over some stateful tests from [Arraylake](https://docs.earthmover.io/). [Description of PR] - [ ] blocked by https://github.com/zarr-developers/zarr-python/issues/2191 - [ ] check for https://github.com/zarr-developers/zarr-python/issues/2228 - [ ] check for https://github.com/zarr-developers/zarr-python/pull/2262 TODO: *...