batchtools
batchtools copied to clipboard
mllg
Tools for computation on batch systems
## Problem I'll cross-post a [related feature request](https://github.com/HenrikBengtsson/future.batchtools/issues/73#issue-903034747) for future.batchtools, but I'm reliably getting: `Error : Log file ... for job with id 1 not available` when submitting jobs using...
Executing the following snippet leads to the exception `Error: BatchtoolsExpiration: Future ('') expired (registry path [..]).` on our LSF powered cluster. ```r library(future) library("future.batchtools") library(furrr) plan(batchtools_lsf, template = "lsf-simple.tmpl", resources...
The [makeClusterFunctions](https://mllg.github.io/batchtools/reference/makeClusterFunctions.html) documentation for the `store.jobs.collection` flag says > If set to `FALSE`, the `JobCollection` is serialized to the file system before submitting the job. But I assume exactly the...
Hello, using batchtools from inside containers I realized that the option of ssh execution of LSF commands, like e.g. for SLURM, would be a benefit. The little changes here do...
the `makeRegistry` function contains this line ``` with_dir(reg$work.dir, loadRegistryDependencies(reg)) ``` which itself will source the `source` argument of `makeRegistries` (if specified). This is often a good idea, since it allows...
Hi, I'm working on a debian server and try to use `makeClusterFunctionsSSH(...)` to distribute jobs to other debian servers. It throws the following error: ```syntax error near unexpected token `('```...
I've been troubleshooting stability of `batchtools` when used on Slurm with the default `makeClusterFunctionsSlurm` (PR #276 & #277 ). The last (rare) error I can reproduce is: ### Expected Behaviour...
I recently stumbled across the following rather weird behavior: If a custom function named `eval` is present in my `.GlobalEnv`, testing jobs with `external = TRUE` and potentially also submitting...
Question: Can I control the execution order of jobs in the same chunk? The situation is that I have a registry with many jobs and I want to use chunking....
See documentation https://slurm.schedmd.com/sbatch.html: > If the job can use more than one partition, specify their names in a comma separate list and the one offering earliest initiation will be used...
