UER-py icon indicating copy to clipboard operation
UER-py copied to clipboard

Does finetune/run_simcse.py only support unsupervised training?

Open Eric8932 opened this issue 3 years ago • 1 comments

During training, the tgt of the loss function is torch.arange(batch_size), which is suitable for unsupervised training. But this will overwrite the labels of the supervised training set.

Eric8932 avatar May 17 '22 09:05 Eric8932

For now, we only implemented the unsupervised part of simcse. If you are interested, you can contribute your code and open a PR.

ydli-ai avatar Jul 31 '22 13:07 ydli-ai