PiPPy icon indicating copy to clipboard operation
PiPPy copied to clipboard

[SPMD][Fusion] - ensure matching ProcessGroups for fused comm calls

Open lessw2020 opened this issue 3 years ago • 0 comments

Currently we assume all comm calls can be fused with any other comm call (i.e. all use default process group). This is usually correct, but need to implement check of process groups and ensure only same process groups are fused to same process groups.

lessw2020 avatar Nov 29 '22 01:11 lessw2020