fastcdc-py
fastcdc-py copied to clipboard
FastCDC implementation in Python https://pypi.org/project/fastcdc/
When a chunk is smaller than `min_size`, such as a small file/stream , the reported size is incorrect. Consider the following example: ```python data = b'\x04\xc9KM\x8a\xeaiH\x83\xaf\x01{\xd6\xe1\xab(# \xdb\xaf' # from os.urandom(20)...
Hey there, Thanks for a lovely piece of code. I couldn't help but notice a tremendous (at least 20%) amount of runtime wasted on string copying, and it seems quite...
Currently, the `fastcdc_(py|cy)` functions leave the file descriptor open after returning the generator since the generator requires it. This can result in a memory leak for non-CPython interpreters that do...
Hey there, Here is what you get when you try to install fastcdc without poetry on your system: ``` $ pip install --user fastcdc Collecting fastcdc Downloading fastcdc-1.4.2.tar.gz (19 kB)...
Hello, Sorry for sending you a PR out of the blue, but I came across this implementation recently and ran into some conflicts when trying to integrate it into a...