zarr-python icon indicating copy to clipboard operation
zarr-python copied to clipboard

Remove zstandard dependency in favor of numcodecs

Open normanrz opened this issue 1 year ago • 1 comments

I added zstandard as a dependency because the zstd in numcodecs doesn't expose the checksum config. This will be introduced in https://github.com/zarr-developers/numcodecs/pull/519. Once that PR is merged, we can use the numcodecs version.

normanrz avatar May 05 '24 20:05 normanrz

The correct default level should be 0 which will then allow the Zstd C library to use the default setting according to how it was built: https://github.com/facebook/zstd/blob/97291fc5020a8994019ab76cf0cda83a9824374c/lib/zstd.h#L338

mkitti avatar May 08 '24 20:05 mkitti

Now that numcodecs 0.13 is out, we can move forward with this.

normanrz avatar Jul 22 '24 16:07 normanrz