Dual-Contrastive-Learning icon indicating copy to clipboard operation
Dual-Contrastive-Learning copied to clipboard

For the labels containing multiple words, How to take the mean-pooling?

Open TianlinZhang668 opened this issue 2 years ago • 1 comments

For the labels containing multiple words, How to take the mean-pooling? Is there this code in files?

TianlinZhang668 avatar Nov 07 '22 15:11 TianlinZhang668

There are two approaches to tackling this problem. We can take the mean-pooling on the BERT outputs to obtain the label representations. Alternatively, we can also take the first word in the label if it does not conflict with other labels.

hiyouga avatar Nov 08 '22 04:11 hiyouga