Add json configuration for llama-13b pretrain on 1, 2, 4 GPUs.

[Xreki]

PR types

Others

PR changes

Others

Description

RT

https://github.com/PaddlePaddle/PaddleNLP/pull/6978

[paddle-bot[bot]]

Thanks for your contribution!

[codecov[bot]]

Codecov Report

Attention: Patch coverage is 80.00000% with 3 lines in your changes missing coverage. Please review.

Project coverage is 59.00%. Comparing base (e398018) to head (c52fcfb). Report is 1282 commits behind head on develop.

Files with missing lines	Patch %	Lines
paddlenlp/transformers/llama/modeling.py	80.00%	3 Missing :warning:

Additional details and impacted files

@@           Coverage Diff            @@
##           develop    #7067   +/-   ##
========================================
  Coverage    59.00%   59.00%           
========================================
  Files          570      570           
  Lines        83906    83905    -1     
========================================
+ Hits         49506    49507    +1     
+ Misses       34400    34398    -2     

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

:rocket: New features to boost your workflow:

• :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[github-actions[bot]]

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动，被标记为stale。

[github-actions[bot]]

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动，被标记为stale。

[CLAassistant]

All committers have signed the CLA.

[github-actions[bot]]

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动，被标记为stale。

[github-actions[bot]]

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动，被标记为stale。