pytorch-nested-unet icon indicating copy to clipboard operation
pytorch-nested-unet copied to clipboard

All bias in conv layers before the batch norm is unnecessary.

Open nzw0301 opened this issue 4 years ago • 0 comments

When BatchNorm with affine=True is used, the previous layer's bias is cancelled (See the original BN paper for details). The current implementation's Conv2D layers are used with bias=True, so by changing bias=False, UNet and NestedUnet might be faster.

nzw0301 avatar Jan 24 '21 18:01 nzw0301