xhqi

+1

Thank you for your reply. The teacher model is the teacher's pre training model, as shown in the following code: teacher = TeacherBertForSequenceClassification.from_pretrained( training_args.teacher_path, from_tf=bool(".ckpt" in training_args.teacher_path), config=config, alignrep=training_args.alignrep, )

Hello, Thanks for the amazing repo! I also want to know the difference between "finetune" and "final-finetune" in /example. Big thanks again for the great work!