WIP: feature(rjy): add dmc2gym+sac baseline both in state input and pixel input

[nighood]

Description

Related Issue

TODO

Check List

• [ ] merge the latest version source branch/repo, and resolve all the conflicts
• [ ] pass style check
• [ ] pass all the tests

[codecov[bot]]

Codecov Report

Merging #451 (df351a2) into main (741fe40) will increase coverage by 2.20%. The diff coverage is 76.72%.

:exclamation: Current head df351a2 differs from pull request most recent head a863579. Consider uploading reports for the commit a863579 to get more accurate results

@@            Coverage Diff             @@
##             main     #451      +/-   ##
==========================================
+ Coverage   83.50%   85.71%   +2.20%     
==========================================
  Files         565      537      -28     
  Lines       46325    43055    -3270     
==========================================
- Hits        38684    36903    -1781     
+ Misses       7641     6152    -1489     

Flag	Coverage Δ
unittests	85.71% <76.72%> (+2.20%)	:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
...ework/middleware/functional/advantage_estimator.py	97.05% <ø> (+18.79%)	:arrow_up:
ding/policy/sac.py	60.18% <69.23%> (-2.49%)	:arrow_down:
ding/model/template/qac.py	83.05% <69.33%> (-10.09%)	:arrow_down:
ding/model/common/head.py	99.20% <100.00%> (+2.34%)	:arrow_up:
ding/model/template/__init__.py	100.00% <100.00%> (ø)
ding/model/template/tests/test_qac.py	98.13% <100.00%> (+0.45%)	:arrow_up:
ding/torch_utils/loss/contrastive_loss.py	89.13% <0.00%> (-10.87%)	:arrow_down:
...r/collector/battle_interaction_serial_evaluator.py	88.41% <0.00%> (-5.39%)	:arrow_down:
ding/entry/cli_parsers/slurm_parser.py	90.27% <0.00%> (-4.07%)	:arrow_down:
ding/envs/env_manager/tests/test_shm.py	88.46% <0.00%> (-3.54%)	:arrow_down:
... and 231 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.