How to calculate the test Agreement?

[Alan-JW]

Hi，@PolinaKirichenko ，How is the test Agreement in your paper calculated in the code? thanks for your answer！

[samuelstanton]

we calculate agreement as

agreement = teacher_logits.argmax(-1).eq(student_logits.argmax(-1)).float().mean()

[samuelstanton]

if you're using a teacher ensemble you'll want to softmax the logits and average across the ensemble dimension first