numcodecs

numcodecs copied to clipboard

Some questions about implementing custom Codec classes

16

Hello :wave: Myself and @astrofrog are currently re-implementing how astropy handles the compression of tiled image data in it's FITS library. We have implemented the compression algorithms in the form...

Cadair

> This was added since there were issues compiling with AVX2 on Linux. Would be good to revisit why this is occurring. That said, this is already [how we build...

jakirkham

> Barring that this feels like a candidate for refactoring (_a la_ https://docs.github.com/en/actions/using-workflows/reusing-workflows) :+1: for unification. _Originally posted by @joshmoore in https://github.com/zarr-developers/numcodecs/pull/398#pullrequestreview-1180691357_

jakirkham

Revisit development status

2

Currently we have the development status marked as beta, but maybe we should revisit this. https://github.com/zarr-developers/numcodecs/blob/e929c96edb4692fe50afb9b1cc0c5186505d00be/setup.py#L324 xref: https://github.com/zarr-developers/numcodecs/pull/382#discussion_r1015923512 cc @joshmoore

jakirkham

Add wrappers for zarr v3

19

The Zarr v3 specification only lists a few codecs that are officially supported. However, it is desirable to expose the codecs in numcodecs for use with v3 arrays as well....

normanrz

Release 0.12.2?

6

I've noticed that the last release was ~7 months ago, and pcodec support was added 3 months ago. Should a new version be released?

mwlon

I suggest that Huffman encoding and decoding is added. I know it is an old fashioned algorithm but it is still in use. I'm trying to decode quake2 cinematic files...

TimSC

Add out-of-tree Pyodide builds in CI for `numcodecs`

5

This PR adds a CI job (`emscripten-ci.yaml`) that builds WASM wheels for numcodecs for use in Pyodide-based environments using the Emscripten toolchain. This was discussed in one of the [community...

agriyakhetarpal

0.12.1: `cannot import name 'MsgPack' from 'numcodecs'` in numcodecs/__init__.py

6

Looks like on testing `zarr` has been exposed probably missing `msgpack` import (and missing install time dependency of that module as well if I'm right). ```console _________________________________________________________________________ ERROR collecting zarr/tests/test_core.py...

kloczek

#### Minimal, reproducible code sample, a copy-pastable example if possible ```python import multiprocessing as mp import numcodecs mp.set_start_method("spawn") ``` #### Problem description Trying to use `multiprocessing.set_start_method()` results in an exception:...

mboquien