Retrain with Distillation

[MeowFET]

Hi,

First of all, thank you so much for releasing this repository.

As stated in Table 6 of the original paper, the DMCP results marked with "*" superscript are obtained by retraining pruned models with slimmable method. It is also explained in Section 4.3 that AutoSlim utilizes in-place distillation during retraining so that the comparison between AutoSlim and DMCP (without superscript) is not fair.

In that case, could you please provide some details regarding the "retraining pruned models with slimmable method" process? It would be better if relevant code and configurations could be released.

Thanks!