toil
toil copied to clipboard
Prevent simultaneous pulls of Singularity images by toil-cwl-runner: add locking
We should make sure that, even if there isn’t a shared filesystem for a cluster, we don’t have several CWL jobs on the same node trying to simultaneously pull the same Singularity image, because this can corrupt Singularity’s internal files.
This is in addition to any prefetching we might want to do when we do have a shared filesystem.
┆Issue is synchronized with this Jira Story ┆Issue Number: TOIL-1603