Teacher-free-Knowledge-Distillation icon indicating copy to clipboard operation
Teacher-free-Knowledge-Distillation copied to clipboard

Published 20 hours ago • verified publisher icon yuanli2333

Pretrained model for student network

Open he-y opened this issue 4 years ago • 2 comments

Thanks for the great work.

I find the pre-trained model for the teacher network. Will you release the Pretrained model for student network?

Thanks!

he-y avatar Jul 07 '20 10:07 he-y

Hi, There are many kinds of student network in our work. The teacher model can also be student (reverse-KD), and the model itself can also be student (self-teaching). So which pretrained models do you mean? I think the simplestest way to get the model parameters is to train by youself based on our codes. It is simple and fast to run our codes.

yuanli2333 avatar Jul 08 '20 10:07 yuanli2333

Thanks for the reply. Is it possible to release the student model based on the accuracy table? This might be easier for us to use.

For example, for every accuracy (such as 71.05) in the table below, a model corresponds to the setting could be released. image

This will save lots of time for rerunning the experiments. Thank you very much!

he-y avatar Jul 09 '20 01:07 he-y