Chenyu Jiang

icon indicating an email [email protected]

icon location The University of Hong Kong icon location Ph.D. student at The University of Hong Kong

Results 3 comments of Chenyu Jiang

No overlapping observed when enabling Smart Scheduling

Thanks for the fast reply! I tried to set `FMOE_FASTER_GROUP_SIZE=4`, but still not seeing any overlap:

No overlapping observed when enabling Smart Scheduling

Hi @zms1999, extremely sorry for the (very) delayed response.. After the fix, now I can see overlapping in the example program. Thanks a lot for the fix! It is tremendously...

No overlapping observed when enabling Smart Scheduling

Sorry for bothering again, but I am still running into problems when running the above example code with SwitchGate (i.e., add `gate=SwitchGate` when initializing `FMoETransformerMLP`. The error message is: ```...