adler32-rs icon indicating copy to clipboard operation
adler32-rs copied to clipboard

Published 20 hours ago • verified publisher icon remram44

Perhaps consider using SIMD?

Open antonmarsden opened this issue 4 years ago • 3 comments

Just a thought :) https://software.intel.com/en-us/articles/fast-computation-of-adler32-checksums

It appears that there's already an SIMD implementation on this fork: https://github.com/myfreeweb/adler32-simd-rs

antonmarsden avatar Apr 18 '20 21:04 antonmarsden

I'm taking his benchmark d28c892e :wink:

I don't know if SIMD is crucial, since I'm seeing speeds well over 1GB/s without, but if there is interest and the implementation is good why not.

remram44 avatar Apr 19 '20 01:04 remram44

You make a fair point. The current implementation is probably adequate for now, and improvements would only really benefit applications doing a lot of [de]compression (file/image processing).

antonmarsden avatar Apr 19 '20 08:04 antonmarsden

I'm going to experiment with an implementation of this - looks like adler32 is still being used by miniz_oxide, which is a pure Rust [de]compressor, which is used by flate2. adler32 is also still used by the "older" compression libraries.

antonmarsden avatar Apr 20 '20 06:04 antonmarsden