torchdistx icon indicating copy to clipboard operation
torchdistx copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

torchrun with deferred_init hang

Open JsBlueCat opened this issue 10 months ago • 0 comments

i found that when use torchdistx with deferred_init it will hang as cuda memory copy

JsBlueCat avatar Apr 06 '24 09:04 JsBlueCat