Switchable_Normalization-Tensorflow icon indicating copy to clipboard operation
Switchable_Normalization-Tensorflow copied to clipboard

Published 20 hours ago • verified publisher icon taki0112

Is your calculation optimized?

Open guanfaqian opened this issue 7 years ago • 3 comments

Your calculations don't seem to be optimized, or three times the BN、LN、IN calculation.

guanfaqian avatar Oct 28 '18 07:10 guanfaqian

I implemented the code based on the author's first article, Fig.7

The author deleted it in his recent paper. I will be fixing the code soon. thank you for telling me.

taki0112 avatar Oct 28 '18 08:10 taki0112

In addition to optimization, the author also said that the batch average converges faster than the moving average. You can pay attention to it when you implement it.

guanfaqian avatar Oct 28 '18 08:10 guanfaqian

is the mean and var equal to moving mean and variance? Also I noticed the author's pytorch code used momentum as well, but I don't see any in the code?

TYS11 avatar Nov 05 '18 06:11 TYS11