SimKGC icon indicating copy to clipboard operation
SimKGC copied to clipboard

Negative sampling

Open NoviceCrom opened this issue 2 years ago • 1 comments

Hi! The paper argues that in-batch samples can be used as negatives. In the implementation of training, it seems there's no explicit positives, just mm() for all hr_vectors and tail_vectors?

NoviceCrom avatar Jun 07 '22 13:06 NoviceCrom

The diagonal elements of the resulting matrix correspond to positives.

To be more specific, for the i-th row in hr_vectors, the positive is the i-th row in tail-vectors, and all other rows are in-batch negatives.

intfloat avatar Jun 08 '22 02:06 intfloat