Zihao Gong
Results
1
issues of
Zihao Gong
I just modified some codes about making some fake inputs to train swin-moe, and exported a nsys profiling. What confused me is that why there are 7 Allreduce in backward...