verkko icon indicating copy to clipboard operation
verkko copied to clipboard

Snakemake memory allocation

Open steven-solar opened this issue 2 years ago • 1 comments

Running verkko in trio mode, and failing on the createLayout step due to insufficient memory, but snakemake doesn't try to request more memory for the second job, and then fails again and exits. Think all jobs should request increased memory in the case of failure.

steven-solar avatar Feb 13 '23 19:02 steven-solar

The code looks like it should be requesting additional memory on the second retry, but, indeed, cluster logs show two jobs with the same memory request. Advise manually increasing the memory limit with verkko option --lay_run <ncpus> <mem-in-gb> <time-in-h> (the default is --lay_run 2 32 24) until we figure out what's going wrong.

brianwalenz avatar Feb 13 '23 20:02 brianwalenz