Leandro Hermida

Results 157 comments of Leandro Hermida

I have a very large workflow where the DAG is reevaluated by a checkpoint many times (e.g. the checkpoint produces a batch of unknown number of files for each id...

> I'm afraid, I cannot reproduce this behaviour. The plugin only submittes a job at a time, yes. The speed will depend on file system latency, mainly. But with `-j...

> I also have experienced this behavior but only if there is a "max-jobs-per-timespan" or "max-jobs-per-second" set somewhere (command line, profile, etc.). I also have `max-jobs-per-second` set to 1 which...

Referencing https://github.com/snakemake/snakemake-executor-plugin-slurm/commit/c27f5f8b4dcf7c2d9bc34fd4870d13ff24c0dfae by @cmeesters as this should fix this issue. Will upgrade executor plugin and test it on my HPC.

> I'm afraid, @hermidalc , the issue is another one, too: [snakemake/snakemake-storage-plugin-fs#19](https://github.com/snakemake/snakemake-storage-plugin-fs/issues/19) - are you using the storage plugin? Yes. I could get it to work with the fs plugin...

> That sounds enticing! Do I understand correctly, that the in-job job fails, despite using the current version of the executor plugin for SLURM? (https://github.com/snakemake/snakemake-executor-plugin-slurm/releases/tag/v0.10.0) Oops sorry let me check...

> That sounds enticing! Do I understand correctly, that the in-job job fails, despite using the current version of the executor plugin for SLURM? (https://github.com/snakemake/snakemake-executor-plugin-slurm/releases/tag/v0.10.0) Sorry for the delay I...