Barlow-Twins-HSIC icon indicating copy to clipboard operation
Barlow-Twins-HSIC copied to clipboard

The feature normalization is necessary?

Open roomo7time opened this issue 3 years ago • 0 comments

https://github.com/yaohungt/Barlow-Twins-HSIC/blob/a30baba4d2d3dcdf85a4ccebe57902f0d827c1ed/model.py#L31

Hi, your code is very helpful and I want to firstly appreciate the code share.

I have a question on whether this feature normalization is necessary (to make the cifar10 performance to about 92% accuracy).

The original Barlow Twins does not contain this step. On the other hand, they rather define all linear layers in the projector with no bias.

roomo7time avatar Jan 08 '22 17:01 roomo7time