rnaseq-pipeline icon indicating copy to clipboard operation
rnaseq-pipeline copied to clipboard

Minimize usage of network between DownloadSample and AlignSample

Open arteymix opened this issue 5 years ago • 0 comments

In the current setup, it's possible that the AlignSample task get scheduled on a different node than the matching DownloadSample task which disrupt the NFS caching.

We could first start by pinning align jobs on whichever node was used to download the data. If that works well, we would then switch to use the local scratch filesystem to completely avoid the NFS.

arteymix avatar Jan 10 '20 22:01 arteymix