Questions about training process

[slcheng97]

Could you tell me the complete training process of side tuning? According to my understanding, your training process should be divided into the following stages:

• the pretraining of the base model
• the distillation of the side model
• training of the transfer part

But the training script of the side model is not provided in the code repository? I don't know if there is a problem with my understanding of the article. Could you explain it to me?

[jozhang97]

Sorry, the training code of the side models is not provided.