fastcdc-rs
fastcdc-rs copied to clipboard
Problems with right-shift in Gear rollsum.
This implementation copies another implementation that uses a right-shift in its Gear rollsum. This has problems I reported here;
https://github.com/ronomon/deduplication/issues/7
I see that Joran closed the original issue, but regardless, I'm going to keep this open so that I can think about it more. I did not research this topic at all, merely read the paper once and translated the readily available implementation by Joran. Thank you for thinking about this and reporting it.
In case you are interested, I've also just finished some testing and analysis of chunker algorithms inspired by FastCDC here;
https://github.com/dbaarda/rollsum-chunking/blob/master/RESULTS.rst
The insights gained from this prompted me to post some other observations and recommendations when using that implementation of FastCDC here;
https://github.com/ronomon/deduplication/issues/8