reinforcement-learning-algorithms icon indicating copy to clipboard operation
reinforcement-learning-algorithms copied to clipboard

Add prioritized experience replay

Open JasAva opened this issue 6 years ago • 5 comments

Thanks for the excellent implementations of multiple classic RL agents, I have tried some of them, worked very well. Just curious, do you plan to add the prioritized experience replay to the DQN? I have tried to embed the openai baseline PER files (https://github.com/openai/baselines/blob/master/baselines/deepq/replay_buffer.py) to the current DQN, should be a really easy job, sadly it doesn't work very well, seems no obvious improvements against the vanilla DQN. If you have any insights on this or have you tried some similar implementation, please let me know, really appreciate it.

JasAva avatar Apr 10 '19 10:04 JasAva

@JaceZA Hi, no problem - I will try to work on the prioritized experience replay in the next week. Before that maybe you can check this implementation from: https://github.com/Kaixhin/Rainbow

TianhongDai avatar Apr 11 '19 02:04 TianhongDai

Thanks so much, I have come across the Rainbow implementation and will continue to figure out where I did wrong. (Sorry for the accident close and reopen), keep me posted on your implementation. Thanks again.

JasAva avatar Apr 11 '19 02:04 JasAva

@JaceZA Don't worry, no problem.

TianhongDai avatar Apr 11 '19 05:04 TianhongDai

@JasAva Sorry for the delay of the update, I need to focus on the deadline in the next following weeks. Then i will try to make a huge update to the repository. Firstly, i will write the pre-processing functions. In this case, we don't need to install openai baselines for their pre-processing functions. Secondly, update the PER for DQN algorithms. Sorry for I don't update the code in these period😣.

TianhongDai avatar May 06 '19 15:05 TianhongDai

@TianhongDai No problem, thanks for letting me know, good luck with the deadline.

JasAva avatar May 07 '19 01:05 JasAva