complexPyTorch icon indicating copy to clipboard operation
complexPyTorch copied to clipboard

Published 20 hours ago • verified publisher icon wavefrontshaping

Another batch norm suggestion

Open MordehayM opened this issue 11 months ago • 0 comments

Hi, About the naive batch norm, I believe it's more effective to normalize the tensor with the absolute value rather than normalizing each part individually: https://github.com/wavefrontshaping/complexPyTorch/blob/2044cb077b3f139d59dff56abc378b1457de40d6/complexPyTorch/complexLayers.py#L213

What do you think?

MordehayM avatar Mar 07 '24 13:03 MordehayM