nnabla-ext-cuda icon indicating copy to clipboard operation
nnabla-ext-cuda copied to clipboard
verified publisher icon sony

Fix F.clip_grad_by_norm in the case of small norm

Open takuseno opened this issue 6 years ago • 1 comments

The operation of clip_by_norm must take the maximum value between the L2 norm and the clipping value.

See https://github.com/sony/nnabla/pull/572 .

cc. @TE-AkioHayakawa

takuseno avatar Jan 11 '20 13:01 takuseno

I've added some changes.

  • the unused kernel function has been removed
  • the backward function is corrected

@TE-AkioHayakawa

takuseno avatar Jan 23 '20 14:01 takuseno