Knowledge-Distillation-Zoo
Knowledge-Distillation-Zoo copied to clipboard
Question on FitNet (Hint)
Thanks for your code!
From what I know, fitnet uses "hints" and both KD loss
seems like KDCriterion only use
is there something I might be missing? thanks!
I have the same question. Have you figured it out? Do you know how to train the "hints" ? Thx