lemniscate.pytorch icon indicating copy to clipboard operation
lemniscate.pytorch copied to clipboard

Published 20 hours ago • verified publisher icon zhirongw

training about DDP

Open YuanLiuuuuuu opened this issue 4 years ago • 0 comments

In distributed data parallel scenario, how can you guarantee the synchronization of memory bank in each process?

YuanLiuuuuuu avatar Jan 04 '21 08:01 YuanLiuuuuuu