mccortex icon indicating copy to clipboard operation
mccortex copied to clipboard

Link files should use bgzf block compression

Open noporpoise opened this issue 9 years ago • 0 comments

When threading reads, a large amount of time is spent writing the link files (.ctp.gz) to disk. Currently the compression is single threaded. If many threads simultaneously compressed blocks in parallel, a single lock could be used to write one compressed block to disk at a time.

Not sure if we should use bgzf block compression in htslib or roll our own block headers.

noporpoise avatar Aug 09 '15 21:08 noporpoise