CLAPS icon indicating copy to clipboard operation
CLAPS copied to clipboard

need your help!

Open Lj4040 opened this issue 1 year ago • 0 comments

        labels = torch.arange(batch_size,
                              device=input_ids.device)


        cont_loss = cont_crit(logits, labels)
        new_cont_loss = cont_crit(new_logits, labels)

Hello! Look at your work and feel very good! So I tried to learn, in the process of learning I have a puzzle. Why is it always compared with this label in the model? This label is only randomly generated according to the size of batch_size 1, 2, 3, 4... I don't seem to have found the right position for such loss in the paper. Could you please give me an answer? I am very confused about it

Lj4040 avatar Nov 01 '23 03:11 Lj4040