InternEvo icon indicating copy to clipboard operation
InternEvo copied to clipboard

Published 20 hours ago • verified publisher icon InternLM

[Feature] MoE模型里稠密层和专家层zero和并行的解耦

Open sunpengsdu opened this issue 1 year ago • 0 comments

Describe the feature

MoE模型里稠密层和专家层zero和并行的解耦

Will you implement it?

  • [ ] I would like to implement this feature and create a PR!

sunpengsdu avatar Sep 11 '24 11:09 sunpengsdu