withinmiaov

How to implement Fairseq-MoE training checkpoint like Swin-MoE?

1

First, I want to thank the tutel team for open-sourcing this work, it's a very good and practical framework. I want to use tutel's moe in fairseq nlp tasks, but...