laz8

the script does not converge to a solution

1

https://github.com/cyoon1729/deep-Q-networks/blob/cb3f1551bc927fedf7166d7b0b3834aaff07d32e/test_gym/dueling_dqn.py#L13 Episode 399: 12.0 Episode 400: 10.0 Episode 417: 11.0 ... Episode 997: 19.0 Episode 998: 11.0 Episode 999: 10.0 And why are you not using a target network?

https://github.com/cyoon1729/deep-Q-networks/blob/master/common/utils.py#L181 there is no buas ;)

You're making it more complicated to test your code by using some "unknown" environment, this is not very helpful.... Sorry ;( Using something like the gym "cartpole" would make it...