AfterQC icon indicating copy to clipboard operation
AfterQC copied to clipboard

output gzipped data

Open tao-bioinfo opened this issue 7 years ago • 3 comments

If the input is gzipped data, the output should be automatically gzipped. Otherwise users would encounter large files

tao-bioinfo avatar Oct 07 '17 05:10 tao-bioinfo

Actually I implemented this feature but finally discarded it since the python gzip lib is too slow for direct gz output.

Currently I suggest to add a gzip after AfterQC is done. I am considering to reimplement AfterQC with C++ for some performance and threading issue.

sfchen avatar Oct 07 '17 14:10 sfchen

Some tools have --gzip parameter to allow users decide whether to gzip output or not

antonkulaga avatar Oct 07 '17 22:10 antonkulaga

gzip output has been enabled on master branch.

For gzipped input, then the output will be also gzipped. If the input is not gzipped, you can enable --gzip or -z option to force gzip compression.

gzip input --> gzip output
ungzip input --> ungzip output
ungzip input + --gzip (-z) option --> gzip output

Use --compression to change the compression level (0~9), default is 2. The better the compression, the lower the speed.

sfchen avatar Oct 28 '17 14:10 sfchen