tombo icon indicating copy to clipboard operation
tombo copied to clipboard

memory control of tombo

Open forrwill opened this issue 4 years ago • 1 comments

I am using combo for human data, the memory of resquiggle and detect_modification process is really large, up to 500G memories,Is there any parameters to set the max memory? thank you!

forrwill avatar Aug 26 '20 12:08 forrwill

There are no parameters to specifically limit memory usage, but there are a couple of options to lower the memory required for this command.

High memory usage at the detect modifications step usually occurs due to very high coverage. Generally there is a limit to the added benefit of added coverage at some point. If results can be achieved with less coverage the tombo filter level_coverage command can be used (docs here).

The other option to more directly limit the memory usage of the detect_modifications command is to use a smaller value for the --multiprocess-region-size (docs here). This will lower the number of reference bases processed by each process and thus lower the memory required.

marcus1487 avatar Aug 31 '20 16:08 marcus1487