flux icon indicating copy to clipboard operation
flux copied to clipboard
verified publisher icon bytedance

Are there any difficulties in implementing gemm-allreduce?

Open Rainlin007 opened this issue 1 year ago • 2 comments

  1. In some projects, Gemm+AllReduce needs to be used. I would like to know whether Gemm+AllReduce can be implemented? and possible methods and issues. thanks.

#7

Rainlin007 avatar Jul 15 '24 11:07 Rainlin007

@kongroo

zheng-ningxin avatar Jul 18 '24 03:07 zheng-ningxin

@Rainlin007 Technically yes, but depends on priorities we haven't consider this case yet.

wenlei-bao avatar Aug 29 '24 17:08 wenlei-bao