[WIP][Unified Checkpoint] Add split param and refactor code

[DesmonDay]

PR types

New features

PR changes

Others

Description

1. Support sharding stage1 v2 for unified checkpoint.
2. Refactor uc code.

[paddle-bot[bot]]

Thanks for your contribution!

[CLAassistant]

All committers have signed the CLA.

[codecov[bot]]

Codecov Report

Attention: Patch coverage is 11.13549% with 1620 lines in your changes missing coverage. Please review.

Project coverage is 52.84%. Comparing base (81ffc78) to head (dbd13df). Report is 259 commits behind head on develop.

Files with missing lines	Patch %	Lines
paddlenlp/trainer/unified_checkpoint/utils.py	12.07%	364 Missing :warning:
...p/trainer/unified_checkpoint/unified_checkpoint.py	11.34%	297 Missing :warning:
...ddlenlp/trainer/unified_checkpoint/load_dynamic.py	9.44%	259 Missing :warning:
...r/unified_checkpoint/sharding_split_param_utils.py	7.97%	173 Missing :warning:
...nlp/trainer/unified_checkpoint/check_completion.py	9.37%	145 Missing :warning:
...dlenlp/trainer/unified_checkpoint/async_handler.py	11.32%	141 Missing :warning:
paddlenlp/trainer/unified_checkpoint/load_local.py	12.12%	116 Missing :warning:
...rainer/unified_checkpoint/load_save_single_card.py	15.32%	116 Missing :warning:
paddlenlp/utils/nested.py	14.28%	6 Missing :warning:
paddlenlp/trainer/training_args.py	0.00%	3 Missing :warning:

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #9240      +/-   ##
===========================================
+ Coverage    52.78%   52.84%   +0.06%     
===========================================
  Files          661      669       +8     
  Lines       106945   107240     +295     
===========================================
+ Hits         56450    56671     +221     
- Misses       50495    50569      +74     

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.