add cosine restart learning rate

[hellozhaoming]

[codecov[bot]]

Codecov Report

Attention: 39 lines in your changes are missing coverage. Please review.

Comparison is base (2fe6927) 75.36% compared to head (05052c1) 75.07%. Report is 16 commits behind head on devel.

Additional details and impacted files

@@            Coverage Diff             @@
##            devel    #2953      +/-   ##
==========================================
- Coverage   75.36%   75.07%   -0.30%     
==========================================
  Files         245      220      -25     
  Lines       24648    20297    -4351     
  Branches     1582      903     -679     
==========================================
- Hits        18577    15238    -3339     
+ Misses       5140     4526     -614     
+ Partials      931      533     -398     

Files	Coverage Δ
deepmd/common.py	83.65% <ø> (ø)
deepmd/utils/argcheck.py	96.16% <100.00%> (+0.08%)	:arrow_up:
deepmd/train/trainer.py	84.56% <54.54%> (-0.50%)	:arrow_down:
deepmd/utils/learning_rate.py	48.57% <22.72%> (-43.74%)	:arrow_down:

... and 62 files with indirect coverage changes

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.