random-network-distillation-pytorch icon indicating copy to clipboard operation
random-network-distillation-pytorch copied to clipboard

global_grad_norm_ has no effect

Open shuang-liu opened this issue 6 years ago • 2 comments

shuang-liu avatar Jan 16 '19 22:01 shuang-liu

@shuang-liu Could you briefly explain why this doesn't work?

jcwleo avatar Jan 18 '19 05:01 jcwleo

As far as I can tell, this function (1) does not take clip_grad_norm as input (2) does not modify the gradients

shuang-liu avatar Jan 18 '19 06:01 shuang-liu