SupContrast icon indicating copy to clipboard operation
SupContrast copied to clipboard

SupContrast with Moco trick

Open richcmwang opened this issue 4 years ago • 5 comments

Hi, thank you for sharing the nice work. I notice the result of SupContrast with Moco trick on ImageNet 79.1. Do you have the plan to push the code here? It would be helpful to see that. Thanks!
Screenshot from 2020-08-09 16-46-56

richcmwang avatar Aug 09 '20 15:08 richcmwang

Hi! Just wanted to second this, it would be great to have the code and a pre-trained model for the SupContrast network on ImageNet.

jlindsey15 avatar Aug 26 '20 15:08 jlindsey15

Hi, I agree with the above.

About MoCo trick, I am curious on how it is implemented, in the original paper, the elements of momentum dict are only used as negatives. In this case, are the elements used for both the positives if they have the same label and as negatives? and is there any difference in the usage of the current results (current batch) and the momentum ones.

Thanks.

yassouali avatar Sep 23 '20 17:09 yassouali

Are there plans to release the code of Supcon with MoCo trick ?

seefun avatar Mar 04 '21 12:03 seefun

I think It would great if we can get the implementation for the code using the memory trick to alleviate those who have GPU memory constraints.

usama13o avatar Nov 28 '21 23:11 usama13o

@yassouali I have the same problem as you, have you figured out how to achieve it now?

songyonger avatar Dec 08 '22 11:12 songyonger