Teacher-free-Knowledge-Distillation icon indicating copy to clipboard operation
Teacher-free-Knowledge-Distillation copied to clipboard

Published 20 hours ago • verified publisher icon yuanli2333

KD loss is zero

Open minato1000 opened this issue 2 years ago • 0 comments

My loss after distillation is 0, which feels very strange. I want to ask whether there is a problem with the distillation method or the calculation of distillation function in the code. A little confused, I hope the writer or someone who knows can tell me.Thanks.

minato1000 avatar Sep 11 '22 14:09 minato1000