scheduling icon indicating copy to clipboard operation
scheduling copied to clipboard

Improve files copy from Scratch to output dataspaces

Open lpellegr opened this issue 8 years ago • 0 comments

When dataspaces are used, the copy of files from input dataspaces (input, output, global or user space) to the Scratch dataspace on compute nodes is performed in parallel. However, when a task has finished, the copy of files from the Scratch space to the output dataspaces (output, global or user space) is performed in parallel per FileSelector which limits the parallelism to the number of files identified per selector.

See TaskProActiveDataSpaces#copyScratchDataToOutput.

lpellegr avatar Jun 27 '16 06:06 lpellegr