SimKGC icon indicating copy to clipboard operation
SimKGC copied to clipboard

Published 20 hours ago • verified publisher icon intfloat

negative samplings

Open Wangchuan0 opened this issue 1 year ago • 5 comments

Hello, if you train directly according to your steps, which one of IB, PB, SN will it turn out? If I want to test the results of different negative samples, how can I change the code 57444c4a0f1d42c6e8c1ade7097c58d 0f11625312930971ff42bf7b08777fc

Wangchuan0 avatar Jun 03 '23 15:06 Wangchuan0

--pre-batch 0 means it does not use pre-batch negatives.

Remove --use-self-negative if you do not want to use self-negatives.

In batch negatives are always used since they are almost free anyway.

intfloat avatar Jun 05 '23 02:06 intfloat

PB 0改成1是使用的意思吗

Wangchuan0 avatar Jun 05 '23 03:06 Wangchuan0

那我跑的结果应该是IB +SN,结果跟你的差的好大。我只改了batch size。求解答

Wangchuan0 avatar Jun 05 '23 03:06 Wangchuan0

batch size 就是对结果影响最大的参数，batch size小了，对比学习的效果就会下降

intfloat avatar Jun 05 '23 03:06 intfloat

okok，谢谢

Wangchuan0 avatar Jun 05 '23 04:06 Wangchuan0