Yaxin1996Z

The calculation of loss function is inconsistent with the paper

1

`loss = F.mse_loss(expected_q_vals, current_q_values)` In this line of code, current_q_values are the mean of all branches Q values, the same with equation 6 in the paper, y. However, the calculation...