playing-mario-with-deep-reinforcement-learning icon indicating copy to clipboard operation
playing-mario-with-deep-reinforcement-learning copied to clipboard

Broken Prioritized Experience Replay

Open Kautenja opened this issue 6 years ago • 1 comments

results on Pong seem to indicate that the experience replay functionality is not working correctly. Performance is terrible, and the agent is far worse than its vanilla alternative. The paper introducing this technique will need reviewed to locate the source of the learning error. A code review is necessary to understand performance limitations and improve the runtime.

Kautenja avatar Jun 12 '18 16:06 Kautenja

https://github.com/openai/baselines/blob/master/baselines/deepq/replay_buffer.py

Kautenja avatar Jun 12 '18 16:06 Kautenja