vortex icon indicating copy to clipboard operation
vortex copied to clipboard

Chunked array statistical compression

Open gatesn opened this issue 1 year ago • 0 comments

As a chunked array loops over its chunks, the compressor could pick the most recently used compression scheme provided the resulting compression ratio remains within some bound.

This would short-cut sampling, but hopefully in a way that allows the compressor to bail out and re-sample if the patterns in the data change. Could also periodically re-sample in the background.

gatesn avatar Feb 07 '24 08:02 gatesn