gemini icon indicating copy to clipboard operation
gemini copied to clipboard

OpenBLAS errors when using `gemini load` under SGE cluster

Open sndrtj opened this issue 9 years ago • 0 comments

Hi there,

I'm having trouble loading in VCF files under an SGE cluster. Consider the following script:

gemini load -v the_vcf.vcf --cores 8 -t VEP the_database.db

When I run this with qsub -S /bin/bash -cwd -pe <THE_PE> 8 the_script.sh I invariably get the following error, after which the job dies:

OpenBLAS: pthread_creat error in blas_thread_init function. Error code:11

When I use the buit-in SGE scheduler with the following:

gemini load -v the_vcf.vcf --cores 8 -t VEP --queue the_queue.q --scheduler sge the_database.db

... I get the same error in some of the jobs, though not all. The scheduler gives a bunch of Attempting to load config file ipcontroller_config.py in path /home/<user>/.ipython/profile_<some_profile> messages. In the job error files for the jobs which did not give the OpenBLAS error I can see errors like:

2016-01-12 11:18:32.639 [IPEngineApp] Using existing profile dir: u'/home/<user>/.ipython/profile_b722ea62-b915-11e5-9dbe-f8bc12452266'
2016-01-12 11:18:32.865 [IPEngineApp] WARNING | url_file u'/home/<user>/.ipython/profile_b722ea62-b915-11e5-9dbe-f8bc12452266/security/ipcontroller-1d287613-ded1-4101-a706-11a900f086fe-engine.json' not found
2016-01-12 11:18:32.866 [IPEngineApp] WARNING | Waiting up to 960.0 seconds for it to arrive.

The jobs are scheduled, but do not appear to be running. No database file appears.

sndrtj avatar Jan 12 '16 10:01 sndrtj