deepTools icon indicating copy to clipboard operation
deepTools copied to clipboard

multiple instances of bamcoverage

Open ijcbioinfo opened this issue 3 years ago • 1 comments

Welcome to deepTools GitHub repository! Before opening the issue please check that the following requirements are met :

  • [ ] Search whether this issue (or a similar issue) has been solved before using the search tab above. Link the previous issue if appropriate below.

  • [ ] Paste your deepTools version (deeptools --version) and your python version (python --version) below.

  • [ ] Paste the full deepTools command that produces the issue below (ignore if you simply spotted the issue in the code/documentation).

  • [ ] Paste the output printed on screen from the command that produces the issue below (ignore if you simply spotted the issue in the code/documentation).

ijcbioinfo avatar Dec 22 '22 10:12 ijcbioinfo

Hi,

I am trying to run multiple instances of bamcoverage on our hpc at the same time (as array job) to convert alignments from RNAseq to bigwigs. Always, the first 3 finish, and the others simply sit ideling. I tried playing around with 'OMP_NUM_THREADS' but it had no effect.

The HPC has 3 nodes with with 128Cores and 1T Ram each.

` #! /bin/bash

#SBATCH --array=1-42 #SBATCH --job-name=BamCov #SBATCH --cpus-per-task=12 #SBATCH --time=02:00:00 #SBATCH --output=Bamcov_%A_%a.log

modules

module load deepTools/3.5.1

run

awk -v expNo=$SLURM_ARRAY_TASK_ID 'NR==expNo' Samplesheet.failed.csv | while read ID NAME do bamCoverage -b ./Bam/$ID.bam -o ./BamCoverage/$NAME.\bw -p 12 --minMappingQuality 20 -v done `

ijcbioinfo avatar Dec 22 '22 10:12 ijcbioinfo