simclr icon indicating copy to clipboard operation
simclr copied to clipboard

I got curious while reading the paper. Why do we use just one positive sample?

Open babbu3682 opened this issue 3 years ago • 1 comments

I got curious while reading the paper. Why do we use just one positive sample?

I mean we can generate more positive samples by using strong augmentations.

I think many positive also help representation learning.

Do you already experiment?

babbu3682 avatar Jun 24 '21 06:06 babbu3682

Using more positive examples would converge faster (in iterations) but at a cost of more compute per iteration. There's a trick for doing it more efficient in SWAV (i.e. multi-crop).

chentingpc avatar Jun 28 '21 00:06 chentingpc