canu icon indicating copy to clipboard operation
canu copied to clipboard

Option not to check for submit node when using `useGrid=remote`?

Open xgrau opened this issue 3 years ago • 0 comments

Hi,

I am using the useGrid=remote option in Canu v2.2 so that it prepares qsub submission scripts, which I then execute manually on my local cluster. However, the intermediate steps between the parallelised parts of the pipeline are sometimes a bit computationally intensive (e.g. the seqStore building step), which, due to the configuration of my cluster (which I'm not managing myself), often results in halted jobs due to excess resource usage. In a normal scenario, I would use the useGrid=true option, but this is not possible because my qsub configuration prevents me from launching nested qsub jobs.

A possible workaround to this issue would be running these intermediate steps as independent qsub jobs and keep launching the generated submission scripts manually, but this is apparently only not possible, as the following error appears when launching canu from a compute node:

error: denied: host "XXXX" is neither submit nor admin host

Given that I'm using useGrid=remote and are therefore not interested in using the current node as a submit node, this check seems unnecessary. Is there any way of disasbling it, or any other workaround to this issue? Thanks a lot in advance.

Find my log attached below.

Any tips will be appreciated.

Cheers

Xavi

###
###  Reading options from '/nfs/users2/asebe/xgraubove/Programes/canu-2.2/bin/canu.defaults'
###

# Add site specific options (for setting up Grid or limiting memory/threads) here.

###
###  Reading options from the command line.
###

genomeSize=300m
useGrid=remote
gridEngineResourceOption=-pe smp 16 -l virtual_free=90G,h_rt=720:00:00 -q long-sl7
minReadLength=1000
corOutCoverage=200
batOptions=-dg 3 -db 3 -dr 1 -ca 500 -cp 50
correctedErrorRate=0.105

xgrau avatar Dec 20 '21 08:12 xgrau