progressive-growing-torch icon indicating copy to clipboard operation
progressive-growing-torch copied to clipboard

Published 20 hours ago • verified publisher icon nashory

Weight normalization layer

Open nashory opened this issue 7 years ago • 5 comments

(https://github.com/torch/nn/blob/master/WeightNorm.lua)

nashory avatar Oct 30 '17 13:10 nashory

normalize the weights of the previous layer dynamically. need to be implemented.

nashory avatar Oct 31 '17 02:10 nashory

Can I use simply use torch nn.WeightNorm for equalized learning rate in the paper??

nashory avatar Oct 31 '17 17:10 nashory

https://github.com/stormraiser/GAN-weight-norm/tree/master/torch/modules

nashory avatar Nov 02 '17 14:11 nashory

tested torch nn.WeightNorm, but it seems to harm training.

nashory avatar Nov 03 '17 13:11 nashory

I found (https://github.com/stormraiser/GAN-weight-norm) maybe we can use this.

nashory avatar Nov 09 '17 15:11 nashory