flux
flux copied to clipboard
[QUESTION] /src/moe_ag_scatter/test/test_moe_ag_scatter.cc only shows a V3 version
Hey guys, /src/moe_ag_scatter/test/test_moe_ag_scatter.cc supports a v3 version of GemmGroupedAgScatterArguments. Can you provide an implementation of GemmGroupedV2AGScatterArguments? It will be convenient for testing on sm80 machines. Thank you.
V2 and V3 are nearly the same. refer to https://github.com/bytedance/flux/blob/main/python/flux/cpp_mod.pyi#L649 here