RepVGG icon indicating copy to clipboard operation
RepVGG copied to clipboard

The diff is large when BN use other initialization method in verify script

Open 2h4dl opened this issue 1 year ago • 0 comments

Congratulations you guys make a big progress in deep learning nerual nets. I found an interesting thing in the model initialization, the diff is so large when BN module initialized with normal distribution, as the weights is 1 and bias is zero. There must be something I didn’t know. Wish you guys can help me to figure this out.

2h4dl avatar Oct 24 '23 02:10 2h4dl