pytorch-rl
pytorch-rl copied to clipboard
'Done' not used in calculating Q-value targets
Why is done not being used in calculating the target Q-values in train_dqn.py? Shouldn't it be used as a mask to make sure the qvalue of this state is set to just R, not R + gamma*Q(s')