Lorenzo Baraldi

@rwightman since I need to work on that for my research, do you think is it useful to create new training functions (like "train_one_epoch" and validate) that are specific for...

Even for pre-training purposes? I'm trying to pre-train the model from scratch and I don't understand the utility of the teacher model. Why is not possible to do ` with...

Ok thank you for the explanation