jax_muzero

jax_muzero copied to clipboard

[Question] What's the motivation for scaling the gradient?

3

Hello! I've noticed that the gradient is being scaled by 0.5 after every model step: https://github.com/Hwhitetooth/jax_muzero/blob/b8ab36251d22e0246d61514841ba17a22f4b2a36/algorithms/agents.py#L116-L120 Can you clarify the motivation for that? Are you aware of any experimental results...

hr0nix