Group-Normalization-Tensorflow I found that there is no moving_average_mean/var, which is necessary in BatchNorm. Is it ok?

I found that there is no moving_average_mean/var, which is necessary in BatchNorm. Is it ok?

Open clks-wzz opened this issue 6 years ago • 2 comments

Hello, sir. I found that there is no moving_average_mean/var, which is necessary in BatchNorm. Is it ok for GroupNorm?

Mar 29 '18 08:03 clks-wzz

i found the same problem there is no moving_average process. how is to compute gn in test step?

Apr 20 '18 09:04 Bingohong

@shenekeng853 i add the ema process, maybe you can try it https://github.com/Bingohong/GroupNormalization-tensorflow/blob/master/README.md

Apr 21 '18 02:04 Bingohong