Cifar-Autoencoder icon indicating copy to clipboard operation
Cifar-Autoencoder copied to clipboard

Activation and norm sequence

Open zipging opened this issue 1 year ago • 0 comments
trafficstars

A thoughtful piece of work! I’d like to ask why the code applies batch normalization after the use of a restrictive activation function. Wouldn’t this cause a shift in the distribution of information before normalization?

zipging avatar Oct 30 '24 03:10 zipging