feature(whl): add rlhf pipeline.

[kxzxvbk]

Description

Related Issue

TODO

Check List

• [ ] merge the latest version source branch/repo, and resolve all the conflicts
• [ ] pass style check
• [ ] pass all the tests

[codecov[bot]]

Codecov Report

Attention: 252 lines in your changes are missing coverage. Please review.

Comparison is base (d7a61c2) 76.78% compared to head (f3a8245) 76.83%.

Files	Patch %	Lines
ding/model/template/lm_vac.py	20.00%	92 Missing :warning:
ding/policy/ppof.py	5.74%	82 Missing :warning:
ding/framework/middleware/collector.py	15.62%	27 Missing :warning:
ding/rl_utils/gae.py	11.11%	16 Missing :warning:
ding/reward_model/language_reward_model.py	31.57%	13 Missing :warning:
ding/bonus/ppof.py	0.00%	12 Missing :warning:
ding/bonus/config.py	0.00%	10 Missing :warning:

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #748      +/-   ##
==========================================
+ Coverage   76.78%   76.83%   +0.04%     
==========================================
  Files         671      674       +3     
  Lines       53196    53935     +739     
==========================================
+ Hits        40847    41440     +593     
- Misses      12349    12495     +146     

Flag	Coverage Δ
unittests	76.83% <20.50%> (+0.04%)	:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.