Transformer-SSL icon indicating copy to clipboard operation
Transformer-SSL copied to clipboard

Published 20 hours ago • verified publisher icon SwinTransformer

Multi-machine training

Open launchauto opened this issue 3 years ago • 0 comments

Thanks for your work! As shown in the markdown file, we can now pretrain Transformer-SSL via 8 GPUs and 1 node. Do you have scripts for multi-machine training? I want to pretrain it via 64 GPUs on 8 machines.

launchauto avatar May 13 '21 10:05 launchauto