Suho Lee comments

Repositories
Issues
Comments

Results 1 comments of


                                            Suho Lee

The loss doesn't decrease when using multi nodes.

> Maybe a bug in [class NT_Xent(nn.Module)](https://github.com/Spijkervet/SimCLR/blob/04bcf2baa1fb5631a0a636825aabe469865ad8a9/simclr/modules/nt_xent.py#L7) when using multi-gpus. The `mask` and `positive/negative pairs` are wrong I think. I agree. To make the implementation work on multi node or...