zarr-python

zarr-python copied to clipboard

Should all stores have a cache? Should arrays and groups have a cache?

1

The current implementation of caching for stores is via a [store-like wrapper](https://github.com/zarr-developers/zarr-python/blob/f542fca7d0d42ee050e9a49d57ad0f5346f62de3/zarr/storage.py#L2354) that encapsulates an existing store. An alternative approach would be to add caching to the store API, which...

d-v-b

Sharded array is very slow to load

9

### Zarr version '2.13.7.dev9' ### Numcodecs version 0.11.0 ### Python Version 3.10.9 ### Operating System Linux ### Installation Pip from main branch ### Description Loading data using the new ShardingStorageTransformer...

ska-incom

Implement np.delete to surgically remove pieces of an array along an axis

3

Currently we only support simple resizing of zarr arrays. In the case of shrinking, data is removed from the end of axes. However, users, might want to remove data from...

rabernat

Basic command line tools -- copy, remove, convert, rechunk

4

I think it could be helpful to expose basic hierarchy transformations to users via a CLI. Usage would look something like `zarr cp src dest` # efficient array / group...

d-v-b

performance optimization in `delitems`

6

in [`FSStore.delitems`](https://github.com/zarr-developers/zarr-python/blob/6f11ae78b142e242d2ac8bc67019e7528539fe73/zarr/storage.py#L1432), only keys that exist in the store are deleted. This requires [checking each key in a loop](https://github.com/zarr-developers/zarr-python/blob/6f11ae78b142e242d2ac8bc67019e7528539fe73/zarr/storage.py#L1436), which incurs a lot of overhead for filesystems like s3. I...

d-v-b

Sync v3 implementation with spec

3

### Description There have been (and still are) updates to the spec since #898 introduced v3 support, that did not land in zarr-python yet. A changelog is available here: https://zarr-specs.readthedocs.io/en/latest/v3/core/v3.0.html#change-log...

jstriebel

Accessing restricted groups over s3 produces zero filled array

6

### Zarr version 2.15.0 ### Numcodecs version 0.11.0 ### Python Version 3.11.4 ### Operating System Linux/Ubuntu ### Installation pip install zarr ### Description Hi, I am attempting to read a...

samueljackson92

Using a group prefixed with `-` causes lstrip issue

1

### Zarr version 2.15.0 ### Numcodecs version N/A ### Python Version 3.8.17 ### Operating System Linux ### Installation Installed via pip ### Description Not sure about what version of Numcodecs...

youngchoan

Use type annotations for `meta_array` information

1

`Array` takes a `meta_array` argument in its constructor. This argument determines the array class instance to return when data is requested. E.g., ```python x = Array(meta_array=MyArray, ...) x[0] # returns...

d-v-b

Mask based indexing works when the mask is a list, but not a numpy array

1

### Zarr version 2.16.1.dev4,2.15.0 ### Numcodecs version 0.10.2 ### Python Version 3.9.16,3.10.12 ### Operating System Mac ### Installation Dev environment + pip install from pypi ### Description Indexing with a...

ivirshup