knowledge-distillation-pytorch icon indicating copy to clipboard operation
knowledge-distillation-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon haitongli

in mnist folder，why teacher_mnist and stdudent_mnist do not contain the softmax?

Open parquets opened this issue 4 years ago • 3 comments

parquets avatar Aug 13 '20 06:08 parquets

Hi @parquets, FYI, they add softmax when they compute the loss function, see kd loss here https://github.com/peterliht/knowledge-distillation-pytorch/blob/master/model/net.py#L110-L112

briliantnugraha avatar Aug 13 '20 06:08 briliantnugraha

Hi @parquets, FYI, they add softmax when they compute the loss function, see kd loss here https://github.com/peterliht/knowledge-distillation-pytorch/blob/master/model/net.py#L110-L112

thank you， I get it

parquets avatar Aug 13 '20 07:08 parquets

@peterliht Could you give me pre-trained model for ResNet110?

parquets avatar Aug 13 '20 07:08 parquets