smoove icon indicating copy to clipboard operation
smoove copied to clipboard

lumpy_filter slower with 2 threads than 1

Open jemunro opened this issue 3 years ago • 2 comments

The lumpy_filter command used by smoove call uses 2 threads, regardless of the --processes argument given to smoove call. Observing the running processes shows around 5-10% cpu utilisation. Testing the same lumpy_filter command outside of smooth with 1 thread instead of 2 yields ~100% cpu utilisation and much faster split and discordant bam generation.

Tested on both docker container 'quay.io/biocontainers/smoove:0.2.5--0' and a conda environment with smoove version 0.2.8.

jemunro avatar Nov 15 '21 23:11 jemunro

This is surprising. Maybe it's due to your disk speed. And you verified that running the lumpy_filter command outside of smoove with 2 threads remains slow?

brentp avatar Nov 16 '21 10:11 brentp

Hi Brent,

Yes I verified by running the command outside of smoove.

I does look like it might be related to disk speed though, I tried copying the bams to a faster disk and the issue was no longer present (~160% cpu utilisation). Still with the slow disk it was definitely much faster to use only a single thread for lumpy_filter command.

jemunro avatar Nov 17 '21 06:11 jemunro