hotline
hotline copied to clipboard
DDP training?
Hi,
Does it support DDP training?
No, not at the moment, but the existing algorithms in Hotline could be easily adapted to DDP. This is because DDP operates in a similar SIMD fashion to torch.DataParallel.
Hey hotline is awesome, I have been always seeking this kinds of DL profiler tool~ Do you guys have plan to support DDP? I want to contribute this feature, do you have some comments about break down steps to implement DDP training support?