pytorch-rl icon indicating copy to clipboard operation
pytorch-rl copied to clipboard

'Done' not used in calculating Q-value targets

Open sritee opened this issue 5 years ago • 0 comments

Why is done not being used in calculating the target Q-values in train_dqn.py? Shouldn't it be used as a mask to make sure the qvalue of this state is set to just R, not R + gamma*Q(s')

sritee avatar Mar 29 '19 20:03 sritee