pcompress
pcompress copied to clipboard
moinakg
A Parallelized Data Deduplication and Compression utility
i'm trying to decompress a file but i was getting segment fault/killed by SIGSEGV, downloaded the latest version and tried again, also segfault, so i tried enabling debug.. moinakg-pcompress-c6e779c# ./config...
On my [criteria list](https://github.com/szepeviktor/debian-server-tools/tree/master/backup#backup-criteria-list) pcompress almost fullfills every item. I've read in your blog that you plan to add this feature. Do you have a branch for that?
Hi! make[1]: Entering directory '/tmp/pcompress/archive/libarchive' make all-am make[2]: Entering directory '/tmp/pcompress/archive/libarchive' depbase=`echo libarchive/archive_acl.lo | sed 's|[^/]*$|.deps/&|;s|\.lo$||'`;\ /bin/sh ./libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -Wall -Wformat -Wformat-security -g -O2 -MT libarchive/archive_acl.lo...
`make test` with gcc version 4.9.1 (Debian 4.9.1-19) `./config`output: https://gist.github.com/szepeviktor/6b26af8344bff1aa1284 Please help me.
In rabin/rabin_dedup.c between line 187 and 208 https://github.com/moinakg/pcompress/blob/master/rabin/rabin_dedup.c#L187 variables 'pow' and 'poly_pow' holds exactly the same value = (power of RAB_POLYNOMIAL_CONST) mod (POLY_MASK+1). This value is 5 bytes in size...
It seems to be pcompress lacks feature like write to stdout when reading from compressed file. In my use case I compress raw LVM volume with virtual machine's disk inside...
hey, was just reading this paper http://www-users.cs.umn.edu/~lv/FBC.pdf and looked for implementations but didn't find any. it proposes some pretty interesting space saving capabilities that go beyond e.g. rabin fingerprinting. was...
After done reading of input file main thread will never be finished if error occured in one of decompression thread.
``` g++ -pthread -fopenmp -fopenmp -fPIC -o buildtmp/pcompress main.o -ldl -L./buildtmp -Wl,-R/usr/lib/x86_64-linux-gnu,--enable-new-dtags -lbz2 -L./buildtmp -Wl,-R/usr/lib/x86_64-linux-gnu,--enable-new-dtags -lz -lm -L./bsc -lbsc -L./buildtmp -Wl,-R/usr/lib/x86_64-linux-gnu,--enable-new-dtags -lcrypto -lrt -Larchive/libarchive/.libs -larchive -Wl,-R/usr/lib,--enable-new-dtags -Wl,-R/usr/lib64,--enable-new-dtags -L/usr/src/wavpack-4.70.0/src/.libs -lwavpack -L....
``` # ./config --disable-wavpack # make g++ -c -fPIC -fvisibility=hidden -ftree-vectorize -msse4.2 -O2 -fsched-spec-load \ -ftree-vectorize -DBUILD_LIB -I. -I./lzma -I./lzfx -I./lz4 -I./rabin -I./bsdiff -DNODEFAULT_PROPS -DFILE_OFFSET_BITS=64 -D_REENTRANT -D__USE_SSE_INTRIN__ -D_LZMA_PROB32 -I./filters/lzp -I./bsc/libbsc...