[Auto Parallel] Support MoE expert parallelism with auto parallel

[pkuzyc]

PR Category

Auto Parallel

PR Types

Improvements

Description

Support MoE expert parallelism with auto parallel.

[paddle-bot[bot]]

你的PR提交成功，感谢你对开源项目的贡献! 请关注后续CI自动化测试结果，详情请参考Paddle-CI手册。 Your PR has been submitted. Thanks for your contribution! Please wait for the result of CI firstly. See Paddle CI Manual for details.

[paddle-ci-bot[bot]]

Sorry to inform you that b4c3b5b's CIs have passed for more than 7 days. To prevent PR conflicts, you need to re-run all CIs manually.