PiPPy icon indicating copy to clipboard operation
PiPPy copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

Add device mesh / process group support for PipelineStage

Open H-Huang opened this issue 1 year ago • 0 comments

Will need to update which group the batch_p2p ops are sent to and remove the current assumptions using rank+1 and rank-1.

H-Huang avatar Feb 14 '24 21:02 H-Huang