Memory required for running pyscenic

[sidrahmaryam-cyber]

Hello, I am trying to run the dummy dataset using the given pyscenic workflow on the cluster using slurm script. However, when I assigned 180G memory usage, still it is giving me the error for memory exhaustion. When I submitted the job without any slurm script, it gave an overconsumption issue.

Showing you a glimpse of the error generated:

distributed.nanny - WARNING - Worker exceeded 95% memory budget. Restarting distributed.nanny - WARNING - Worker exceeded 95% memory budget. Restarting distributed.nanny - WARNING - Worker exceeded 95% memory budget. Restarting distributed.nanny - WARNING - Worker exceeded 95% memory budget. Restarting

Can I please be suggested an alternative for it? Or can I please get to know how much the memory will be needed for running? This is a sample data given in the tutorial.

I will be grateful for your help. Thanks.

[Erfan1369]

Hello, Did you find out answer or not? I want to run on the clusters too, Thanks

[sidrahmaryam-cyber]

Hello, No I could not find any answers yet. Trying to find alternatives still.