[Distributed] Support param and moment sync for pp shared layer

[zhangyuqin1998]

PR types

New features

PR changes

Others

Description

Support param and moment sync for pp shared layer

Pcard-76459

related with https://github.com/PaddlePaddle/Paddle/pull/73913

[paddle-bot[bot]]

Thanks for your contribution!

[codecov[bot]]

Codecov Report

:x: Patch coverage is 0% with 8 lines in your changes missing coverage. Please review. :white_check_mark: Project coverage is 46.76%. Comparing base (78741f9) to head (4ff3371). :warning: Report is 81 commits behind head on develop.

:warning: Current head 4ff3371 differs from pull request most recent head 1c767d2

Please upload reports for the commit 1c767d2 to get more accurate results.

Files with missing lines	Patch %	Lines
paddlenlp/trainer/training_args.py	0.00%	8 Missing :warning:

:x: Your patch check has failed because the patch coverage (0.00%) is below the target coverage (80.00%). You can increase the patch coverage or adjust the target coverage. :x: Your project check has failed because the head coverage (46.76%) is below the target coverage (58.00%). You can increase the head coverage or adjust the target coverage.

Additional details and impacted files

@@             Coverage Diff             @@
##           develop   #10831      +/-   ##
===========================================
- Coverage    46.80%   46.76%   -0.05%     
===========================================
  Files          802      802              
  Lines       133728   133890     +162     
===========================================
+ Hits         62597    62610      +13     
- Misses       71131    71280     +149     

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

:rocket: New features to boost your workflow:

• :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[zhangyuqin1998]

/re-run all-failed

[zhangyuqin1998]

/re-run all-failed

[github-actions[bot]]

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动，被标记为stale。

[github-actions[bot]]

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动，被标记为stale。