PaddleNLP icon indicating copy to clipboard operation
PaddleNLP copied to clipboard

Published 20 hours ago • verified publisher icon PaddlePaddle

Moe

Open Meiyim opened this issue 1 year ago • 5 comments

PR types

New features ！！！

PR changes

为了适配moe，更改了Trainer的很多功能。包括：

  • 在纯DP下支持MoE
  • 在PP/MP下支持MoE 【TODO】
  • 支持将打印网络中产生的Debug信息。

Description

Meiyim avatar Jul 26 '23 08:07 Meiyim

Thanks for your contribution!

paddle-bot[bot] avatar Jul 26 '23 08:07 paddle-bot[bot]

CLA assistant check
All committers have signed the CLA.

CLAassistant avatar Aug 10 '23 07:08 CLAassistant

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动，被标记为stale。

github-actions[bot] avatar Dec 14 '23 00:12 github-actions[bot]

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动，被标记为stale。

github-actions[bot] avatar Apr 28 '24 00:04 github-actions[bot]