biomake
biomake copied to clipboard
evoldoers
SLURM: Option to join stdout and stderr
If SLURM's bsub -e option (standard error file) is not specified, the default is to join stdout and stderr, which is my preferred behaviour.
See http://www.glue.umd.edu/lsf-docs/man/bsub.html
Is there a way to achieve this behaviour by modifying QsubArgs, without adding an option to biomake?
You have saved my :bacon:. I have run 2,344 jobs in the last week with biomake -Q slurm, and I never would have been able to keep them all straight or get the analysis done in time if I had been scheduling them manually. ❤️ 👏 🤗
Could biomake -Q poolq optionally redirect joined stdout/stderr to .biomake/poolq/out/$@? I'd also find it quite useful to write the PID of active processes to .biomake/poolq/job/$@. I've fallen in love with using pstree and pv -pd $! to inspect and monitor active processes. If you haven't encountered pv -pd $! before, check it out! It's amazing.
http://www.ivarch.com/programs/pv.shtml