Yue Dong

Have we tried to build a training package and get the trace with the new code? IIRC, by the time I worked on this code, buck build failed/OOMed (I don't...

Agree with @yifuwang that for these kind of collective communication fusion, the absence of a global view poses a risk of de-syncing. One potential scenario involves the replacement of only...