selective_distillation
selective_distillation copied to clipboard
Help on reproducing selective_distillation on other framework
@LeslieOverfitting ,
Would you please share which code files did you develop, I have found selective_distillation/tree/main/fairseq/criterions/label_smoothed_cross_entropy.py
is the one that you develop the distillation strategy. What else? Thanks!