Bi-Real-net icon indicating copy to clipboard operation
Bi-Real-net copied to clipboard

输出权重为什么不是二值化的

Open feifanzui opened this issue 6 years ago • 3 comments

我用python输出了训练得到的model,为什么权重都是小数,不是+1 -1 啊

feifanzui avatar Oct 04 '18 07:10 feifanzui

You need to set the weights to -1 and 1 in the convolution layers and also freeze the learning rate. Then you retrain the BatchNorm layer to absorb the scaling factor.

liuzechun avatar Oct 21 '18 08:10 liuzechun

You need to set the weights to -1 and 1 in the convolution layers and also freeze the learning rate. Then you retrain the BatchNorm layer to absorb the scaling factor.

excuse me, is what you said had been included in your code?

Lovegood-1 avatar Sep 18 '20 13:09 Lovegood-1

You need to set the weights to -1 and 1 in the convolution layers and also freeze the learning rate. Then you retrain the BatchNorm layer to absorb the scaling factor.

How to constraint the weights to -1 and 1?And, how to retrain the BatchNorm layer to absorb the scaling factor?

lihengxia avatar Aug 11 '21 06:08 lihengxia