ChenDirk

How to get the student model checkpoint after finishing knowledge distillation?

11

Hi, I find that after finishing knowledge distillation, the checkpoint file is very huge I get, so I think the checkpoint file include the student model and the teacher model....

In the semantic segmentation task, even though the teacher model and the student model are trained in the same data set and have the same size of input, their outputs...