java icon indicating copy to clipboard operation
java copied to clipboard

Q: How to add Regularizer and Constraint effect correctly to a weight/bias variable or activity?

Open Dong148 opened this issue 1 year ago • 1 comments

How to add Regularizer and Constraint effect correctly to a weight/bias variable or activity?

THANKS FOR HELP

Dong148 avatar Mar 24 '24 02:03 Dong148

You can add a regularization term the way you usually would, put an l2 penalty on the weights being large and add that to the loss function that you backprop.

Craigacp avatar Apr 01 '24 02:04 Craigacp