It seems not a standard ddqn implementation.

[mythsman]

https://github.com/YangRui2015/2048_env/blob/2e9b3938492e4f7a0a2b627b8607ad1c203d273a/dqn_agent.py#L96

I was new to DQN , and confused with this line . And it should be q_eval_4_next_state_argmax instead of q_eval_4_this_state_argmax , right ?