stable-baselines3 icon indicating copy to clipboard operation
stable-baselines3 copied to clipboard

[Feature Request] RAINBOW

Open araffin opened this issue 3 years ago • 7 comments

Important Note: We do not do technical support, nor consulting and don't answer personal questions per email. Please post your question on the RL Discord, Reddit or Stack Overflow in that case.

🚀 Feature

Implement RAINBOW (DQN + all extensions: noisy-net, double dqn, dueling, c51, prioritized experience replay).

closes #487 if it is implemented.

Motivation

This would allow to have DQN with all extensions while keeping DQN code simple.

  • [x] I have checked that there is no similar issue in the repo (required)

araffin avatar Oct 22 '21 12:10 araffin

Any updates about the rainbow implementation?

Sino-Huang avatar Oct 03 '22 07:10 Sino-Huang

Any updates about the rainbow implementation?

Contributions are welcomed ;) (if you do so, please read the contributing guide from SB3-Contrib, it explains how to test new algorithms) It is planned but not a priority.

EDIT: QR-DQN is available in SB3-Contrib, and double DQN is also available if needed (currently as an exercise)

araffin avatar Oct 06 '22 16:10 araffin

Hi there, I hope you're having a great day. I was reading through #487 and it leads me here. I see that the double-DQN is now available as an exercise. I looked through sb3 and sb3-contrib repositories, but I couldn't find any code or reference to it. Would you be able to point me in the direction of the material or pseudo code that explains the implementation of double-DQN in sb3? I'd really appreciate it. Thank you!

jenschwich avatar Feb 11 '23 11:02 jenschwich

Hi @jenschwich, check out https://github.com/Stable-Baselines-Team/rl-colab-notebooks/blob/sb3/README.md

qgallouedec avatar Feb 11 '23 13:02 qgallouedec