Jie Huang

Computing teacher outpouts is called only onece?

1

Teacher model's outputs are only computed before training epoch. https://github.com/peterliht/knowledge-distillation-pytorch/blob/master/train.py#L277 It assumes that inputs are fixed in each epoch. But the inputs are different in each epoch due to the...