VanillaNet icon indicating copy to clipboard operation
VanillaNet copied to clipboard

bias defaults to True for nn.Conv2d

Open jacobgorm opened this issue 1 year ago • 1 comments

Thanks for publishing this quite interesting work. I believe it is customary to use either bias or BatchNorm, but not both at once. the nn.Conv2d layers not have bias=False added to their constructor args, as otherwise they would default to bias=True?

jacobgorm avatar Jul 01 '23 21:07 jacobgorm

Thanks for the nice concern. Since the BatchNorm will normalize the input features, it is almost the same for setting bias=True and bias=False. Therefore, both settings are fine.

HantingChen avatar Jul 03 '23 08:07 HantingChen