ThermoRawFileParser icon indicating copy to clipboard operation
ThermoRawFileParser copied to clipboard
verified publisher icon compomics

CPUs Parlallelization available?

Open rolivella opened this issue 3 years ago • 2 comments

Hi all, is there a way to use more CPUs while running the TRFP? Or are you planning to add this option?

Thanks!

rolivella avatar Feb 21 '22 14:02 rolivella

Hi @rolivella, that is an long lasting issue, see #23 and #95 In short, the bottleneck is writing the mzML file (and index); this process essentially has to be single-threaded. Multithreaded processing of a single file is not on the list for any near future. It is possible, however, to run several instances of TRFP working on different files (for example, to process a folder faster). I have old and ugly python script that I can share.

caetera avatar Feb 21 '22 16:02 caetera

Ah yes, it makes sense. Thanks for the python script but I'm developping a single-file pipeline so I don't need it yet. I'm trying to optimize every single step but I see that, at least, regarding the TRFP I can't do nothing (or little) more.

rolivella avatar Feb 21 '22 16:02 rolivella