zarr-python

zarr-python copied to clipboard

Improve LRU Store Cache Performance by Partial Key Cache Update

2

When data is added/updated in an LRU store, the `keys_cache` and `contains_cache` are invalidated. In my case this causes a large slowdown due to occasional writes and many reads because...

Yannicked

small 3D-tif-file memmap convert to zarr failed

2

### Zarr version '2.16.0' ### Numcodecs version '0.11.0' ### Python Version '3.11.3' ### Operating System Ubuntu 22/ Debian 10 (tried it on 2 systems with 2 Fiji versions) ### Installation...

SaibotMagd

Allow batched/concurrent (de)compression support

13

I have a proposal for an enhancement and would like to get feedback on this and potentially better ways of achieving the same goal. In many use cases that are...

akshaysubr

slow tests in CI

1

The duration of tests in CI is approaching 9 minutes. In a recent [run](https://github.com/zarr-developers/zarr-python/actions/runs/5601271443/jobs/10244889630?pr=1473), these were the worst offenders in terms of test duration: ``` ============================= slowest 10 durations =============================...

d-v-b

Allow setting of `write_empty_chunks` for `zarr.core.Array` objects

3

When opening a Zarr group via `zarr.hierarchy.open_group()` there is currently no way to specify `write_empty_chunks=False`, this can be problematic when appending to existing zarr groups with sparse data as found...

RKuttruff

`save` doesn't allow array creation options

1

The [`save`](https://github.com/zarr-developers/zarr-python/blob/13cdbfff86de2f39d520e6333687e1b434857eca/zarr/convenience.py#L270) function defined in `convenience.py` doesn't allow specifying the array creation options like chunks, compressor, etc. The natural place for these parameters would be in `**kwargs`, but It looks...

d-v-b

[WIP] Attempt to continue LRU cache for decoded chunks

9

Continuation attempt of #306 - do not merge yet - ~very likely still not correct behaviour when chunks get deleted from store by #738~. Still have very limited knowledge of...

croth1

NumPy 2.0 support

2

NumPy 2.0 is coming out soon ( https://github.com/numpy/numpy/issues/24300 ). NumPy 2.0.0rc1 packages for conda & wheels came out 3 weeks back ( https://github.com/numpy/numpy/issues/24300#issuecomment-2030603395 ) To prepare for NumPy 2.0, it...

jakirkham

[V3] Support for batched Store API in v3

24

The `Store` API in v3 supports fetching a single key at a time or partial values of multiple keys. ```python class Store(ABC): @abstractmethod async def get( self, key: str, byte_range:...

akshaysubr

updates: - [github.com/astral-sh/ruff-pre-commit: v0.4.1 → v0.4.2](https://github.com/astral-sh/ruff-pre-commit/compare/v0.4.1...v0.4.2) - [github.com/psf/black: 24.4.0 → 24.4.2](https://github.com/psf/black/compare/24.4.0...24.4.2) - [github.com/pre-commit/mirrors-mypy: v1.9.0 → v1.10.0](https://github.com/pre-commit/mirrors-mypy/compare/v1.9.0...v1.10.0)

pre-commit-ci[bot]