indrnn-pytorch icon indicating copy to clipboard operation
indrnn-pytorch copied to clipboard

In IndRNNCell, what's the reason for doing the 'gradient_clip'?

Open MLjian opened this issue 6 years ago • 1 comments

I think the check_bounds has done the same operation.

MLjian avatar Jul 11 '18 21:07 MLjian

"Gradient clip" clips the gradient, while the actual weight is altered by check_bounds.

StefOe avatar Dec 30 '18 01:12 StefOe