Bismark icon indicating copy to clipboard operation
Bismark copied to clipboard

Bismark Extract failed always ran out of memory after 8hrs.

Open RachaelAjayi opened this issue 11 months ago • 4 comments

Bismark_mapping Failed, Run time 08:18:26, OUT_OF_MEMORY.

Please see code bismark --genome_folder genomes/bismark -o bam/ --non_directional --parallel 8 --score_min L,-0.6,-0.6 -1 trimmed/${base1}_val_1.fq.gz -2 trimmed/${base2}_val_2.fq.gz

What am I doing wrong? I am running on a cluster using 16 nodes for the job submission.

RachaelAjayi avatar Mar 13 '24 14:03 RachaelAjayi

Assuming the human genome, and easy to work numbers, a single run of Bismark requires ~3 cores (at 100%) and ~14GB of RAM for a standard directional run, and 5 cores and ~20GB of RAM for a non directional run. Since you used --parallel 8 you need to roughly multiply these values with 2, meaning the run would be in the region of roghly 40 cores and up to 160GB. If you don't have that much, the job will be killed using due to a OUT_OF_MEMORY error.

Does that make sense?

FelixKrueger avatar Mar 13 '24 15:03 FelixKrueger

Thank you.

RachaelAjayi avatar Mar 13 '24 17:03 RachaelAjayi

Thank you so much for your reply.

New Error: 2- bowtie2-align died with signal 9 (KILL) (ERR): bowtie2-align died with signal 9 (KILL)

RachaelAjayi avatar Mar 13 '24 17:03 RachaelAjayi

That still sounds like memory issues, what did you change? Can you google (ERR): bowtie2-align died with signal 9 (KILL)?

FelixKrueger avatar Mar 13 '24 18:03 FelixKrueger