SimCLRv2-Pytorch
SimCLRv2-Pytorch copied to clipboard
why 'ema' is needed
trafficstars
By reading Simclr V2 paper, I can only find 'ema' in "The memory buffer is set to 64K, and exponential moving average (EMA) decay is set to 0.999 according to [20]" where [20] is MoCo v1, and I can't find this 'ema' set up in official code of simclr. Do you know how this MoCo feature serve Simclr V2 ?