bloscpack icon indicating copy to clipboard operation
bloscpack copied to clipboard

actually use the offset in CompressedFPSource

Open mmohrhard opened this issue 5 years ago • 7 comments

mmohrhard avatar Jul 30 '20 11:07 mmohrhard

@mmohrhard hi and welcome to bloscpack. Thank you very much for your contribution and your efforts to improve bloscpack. I just had a look at the CI system and noticed, that the project has been dormant for some time. Hence the tests are not in good shape, they are testing older versions of Python and probably the APIs of the Numpy dependency have changed. This means, it is a bit tricky to work out why the tests are failing. I think it would be a good idea to improve the state of the test suite first before attempting to merge this fix.

esc avatar Jul 30 '20 12:07 esc

Hey, I fixed master, can you rebase this and force push please?

esc avatar Aug 07 '20 15:08 esc

I have pushed an updated patch but found one place where the current code is a bit ugly. I'm not too fond of the change in bloscpack/cli.py but it seems that there can be files without an offset header.

mmohrhard avatar Aug 10 '20 20:08 mmohrhard

Coverage Status

Coverage increased (+0.003%) to 95.397% when pulling a6636de9f0b6fb0f44e9f255fe3a8425d2734e32 on mmohrhard:fix-offset-in-compressedfpsource into 2c0086b4f353b6635e4cf4f309debc36cb11477b on Blosc:master.

coveralls avatar Aug 11 '20 00:08 coveralls

From what I recall, it is possible to disable offsets in a file with the settings:

https://github.com/blosc/bloscpack#settings

This was done, in case people wanted smaller files with less over head but without the additional features that offsets enables.

esc avatar Aug 11 '20 08:08 esc

@mmohrhard thanks very much for contributing this, I have added it to the queue for review.

esc avatar Aug 11 '20 08:08 esc

@mmohrhard apologies for the delay, could you rebase this against current master. All CI issues have been fixed there. Thank you!

esc avatar Mar 11 '21 20:03 esc