About Contrastive Loss

[YangGangZhiQi]

Thanks for your great works! After reading the papers and codes，I have a question about Contrastive loss。In your codes, using the unrelated samples in a batch as negative samples. How to select negative samples really interests me. As we all know, the unrelated samples in a batch is far away from the outputs of student networks. Could using this as negative samples really be a good lower bounds? Have you ever consider using other images as negative samples? eg. upsample(self.lq) or gaussianBlur(upsample(self.lq))... Hope for your reply, sincerely!