hotline icon indicating copy to clipboard operation
hotline copied to clipboard
verified publisher icon UofT-EcoSystem

DDP training?

Open weimingzha0 opened this issue 2 years ago • 2 comments

Hi,

Does it support DDP training?

weimingzha0 avatar Jun 12 '23 23:06 weimingzha0

No, not at the moment, but the existing algorithms in Hotline could be easily adapted to DDP. This is because DDP operates in a similar SIMD fashion to torch.DataParallel.

danielsnider avatar Jun 13 '23 01:06 danielsnider

Hey hotline is awesome, I have been always seeking this kinds of DL profiler tool~ Do you guys have plan to support DDP? I want to contribute this feature, do you have some comments about break down steps to implement DDP training support?

Jack47 avatar Oct 31 '23 01:10 Jack47