Keras-FCN icon indicating copy to clipboard operation
Keras-FCN copied to clipboard

locking BatchNormalization Layers during training

Open ahundt opened this issue 9 years ago • 1 comments

Okay, I spoke with the author of https://github.com/warmspringwinds/tf-image-segmentation, and he mentioned another key aspect to maximizing performance when training resnet with pretrained weights for segmentation tasks is to lock the batch normalizations so they never change while training segmentation. I'm curious if there is an easy way to do that with Keras.

ahundt avatar Apr 19 '17 22:04 ahundt

Hmm, a tricky way could be setting momentum to 1 and trainable=False I think... But I don't know if there is better way if you don't change Keras source code.

aurora95 avatar Apr 20 '17 08:04 aurora95