adeptRL icon indicating copy to clipboard operation
adeptRL copied to clipboard

[Enhancement] Log the global gradient norms to tensorboard

Open benbellheron opened this issue 3 years ago • 0 comments

Adept uses global gradient norm clipping of 0.5 by default which could prevent learning (just slowing it down) if the gradients are high and the clipping occurs at every training step. At minimum we should log this to tensorboard so the user can decide/view for themselves.

benbellheron avatar Sep 29 '20 01:09 benbellheron