clustershell icon indicating copy to clipboard operation
clustershell copied to clipboard

Copying large files to remote nodes in treemode is slow

Open luxiaoyong opened this issue 1 year ago • 2 comments

I use the treemode to copy a 136MB file to 142 remote nodes with the following command, which took 36 minutes: clush -o-q -w "node1 node2" --copy test.tar --dest /tmp/ However, when I turn off the treemode, the same copy only took 20 seconds. Sometimes, copying large files may freeze (occasionally), but there are no error messages during the copying process. Could you please explain what protocol treemode uses for large file copying? Is it possible to optimize this feature?

luxiaoyong avatar Mar 10 '24 13:03 luxiaoyong