stable-baselines3
stable-baselines3 copied to clipboard
[Feature Request] RAINBOW
Important Note: We do not do technical support, nor consulting and don't answer personal questions per email. Please post your question on the RL Discord, Reddit or Stack Overflow in that case.
🚀 Feature
Implement RAINBOW (DQN + all extensions: noisy-net, double dqn, dueling, c51, prioritized experience replay).
closes #487 if it is implemented.
Motivation
This would allow to have DQN with all extensions while keeping DQN code simple.
- [x] I have checked that there is no similar issue in the repo (required)
Any updates about the rainbow implementation?
Any updates about the rainbow implementation?
Contributions are welcomed ;) (if you do so, please read the contributing guide from SB3-Contrib, it explains how to test new algorithms) It is planned but not a priority.
EDIT: QR-DQN is available in SB3-Contrib, and double DQN is also available if needed (currently as an exercise)
Hi there, I hope you're having a great day. I was reading through #487 and it leads me here. I see that the double-DQN is now available as an exercise. I looked through sb3 and sb3-contrib repositories, but I couldn't find any code or reference to it. Would you be able to point me in the direction of the material or pseudo code that explains the implementation of double-DQN in sb3? I'd really appreciate it. Thank you!
Hi @jenschwich, check out https://github.com/Stable-Baselines-Team/rl-colab-notebooks/blob/sb3/README.md