PaddleNLP icon indicating copy to clipboard operation
PaddleNLP copied to clipboard

[Auto Parallel] fix loss sum for auto parallel

Open zhangyuqin1998 opened this issue 1 year ago • 4 comments

PR types

Others

PR changes

Others

Description

acc > 1时,自动并行之前使用numpy.sum对loss求和,动手下使用paddke.add对loss求和,两者算出的结果有微小diff。对齐模式下让自动并行与动手对齐。

zhangyuqin1998 avatar Oct 09 '24 07:10 zhangyuqin1998

Thanks for your contribution!

paddle-bot[bot] avatar Oct 09 '24 07:10 paddle-bot[bot]

Codecov Report

:x: Patch coverage is 0% with 15 lines in your changes missing coverage. Please review. :white_check_mark: Project coverage is 52.82%. Comparing base (753436a) to head (2679a3d). :warning: Report is 582 commits behind head on develop.

Files with missing lines Patch % Lines
paddlenlp/trainer/auto_trainer.py 0.00% 15 Missing :warning:

:x: Your patch check has failed because the patch coverage (0.00%) is below the target coverage (80.00%). You can increase the patch coverage or adjust the target coverage. :x: Your project check has failed because the head coverage (52.82%) is below the target coverage (58.00%). You can increase the head coverage or adjust the target coverage.

Additional details and impacted files
@@             Coverage Diff             @@
##           develop    #9234      +/-   ##
===========================================
- Coverage    52.97%   52.82%   -0.15%     
===========================================
  Files          703      703              
  Lines       110981   110803     -178     
===========================================
- Hits         58788    58533     -255     
- Misses       52193    52270      +77     

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

:rocket: New features to boost your workflow:
  • :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

codecov[bot] avatar Oct 09 '24 07:10 codecov[bot]

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动,被标记为stale。

github-actions[bot] avatar Feb 08 '25 00:02 github-actions[bot]

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动,被标记为stale。

github-actions[bot] avatar Apr 10 '25 00:04 github-actions[bot]

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动,被标记为stale。

github-actions[bot] avatar Jul 31 '25 00:07 github-actions[bot]