reinforcement-learning icon indicating copy to clipboard operation
reinforcement-learning copied to clipboard

Fail to converge for Breakout dqn

Open yhcao6 opened this issue 7 years ago • 4 comments

I have train the model for around 4 days, episode now is 14278, while the score is 40 ~ 50, what's the problem?

yhcao6 avatar Oct 10 '17 01:10 yhcao6

Did you change any parameters? Changing parameters affect performance very much.

if you give us any other information (like tensorboard graph) than we can figure out more things. But now we don't have any idea. Sorry.

zzing0907 avatar Oct 10 '17 14:10 zzing0907

Sorry for late replay. These are images. I don't change any parameters

2017-10-10 22:49 GMT+08:00 youngmoo [email protected]:

Did you change any parameters? Changing parameters affect performance very much.

if you give us any other information (like tensorboard graph) than we can figure out more things. But now we don't have any idea. Sorry.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/rlcode/reinforcement-learning/issues/66#issuecomment-335497918, or mute the thread https://github.com/notifications/unsubscribe-auth/AVnNGcALls8xU-ZgvL1DOLinyHR-chffks5sq4PlgaJpZM4PzP9X .

yhcao6 avatar Oct 12 '17 00:10 yhcao6

Hello, I have been troubled by this problem for a long time. How can I solve it

JUZI1 avatar Mar 12 '20 13:03 JUZI1

Use a better implementation.

e.g. https://github.com/tensorpack/tensorpack/tree/master/examples/DeepQNetwork

ppwwyyxx avatar Mar 12 '20 16:03 ppwwyyxx