megablocks
megablocks copied to clipboard
ScatterMoE feature
I would like to request ScatterMoE feature in Megablocks
https://arxiv.org/abs/2403.08245
https://github.com/shawntan/scattermoe