contrastive_loss
contrastive_loss copied to clipboard
Experiments with supervised contrastive learning methods with different loss functions
Bumps [nbconvert](https://github.com/jupyter/nbconvert) from 5.6.1 to 6.3.0. Commits cefe0bf Release 6.3.0 a534fb9 Release 6.3.0b0 87920c5 Add changelog for 6.3.0 (#1669) dd6d9c7 add slide numbering (#1654) 5d2c5e2 Update state filter (#1664) 11ea593...
Bumps [mistune](https://github.com/lepture/mistune) from 0.8.4 to 2.0.3. Release notes Sourced from mistune's releases. Version 2.0.2 Fix escape_url via lepture/mistune#295 Version 2.0.1 Fix XSS for image link syntax. Version 2.0.0 First release...
Bumps [numpy](https://github.com/numpy/numpy) from 1.18.3 to 1.22.0. Release notes Sourced from numpy's releases. v1.22.0 NumPy 1.22.0 Release Notes NumPy 1.22.0 is a big release featuring the work of 153 contributors spread...
Bumps [notebook](http://jupyter.org) from 6.1.5 to 6.4.12. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a...
Why do need base_temperature when calculating the loss?
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.3.1 to 2.7.2. Release notes Sourced from tensorflow's releases. TensorFlow 2.7.2 Release 2.7.2 This releases introduces several vulnerability fixes: Fixes a code injection in saved_model_cli (CVE-2022-29216) Fixes...
Thanks for your sharing. I have some trouble in logits_mask. ` # mask-out self-contrast cases logits_mask = torch.scatter( torch.ones_like(mask), 1, torch.arange(batch_size * anchor_count).view(-1, 1).to(device), 0 ) mask = mask *...
Bumps [protobuf](https://github.com/protocolbuffers/protobuf) from 3.11.3 to 3.15.0. Release notes Sourced from protobuf's releases. Protocol Buffers v3.15.0 Protocol Compiler Optional fields for proto3 are enabled by default, and no longer require the...
Bumps [ipython](https://github.com/ipython/ipython) from 7.13.0 to 7.16.3. Commits d43c7c7 release 7.16.3 5fa1e40 Merge pull request from GHSA-pq7m-3gw7-gq5x 8df8971 back to dev 9f477b7 release 7.16.2 138f266 bring back release helper from master...
Hi, it is strange when using custom dataset the loss is nan (I just tried supervised_nt_xent_loss and max_margin_contrastive_loss). do you have any idea ? thanks