ViT-S and drop_path_rate

[vladchimescu]

Hi, I'm trying to train DINOv2 with the ViT-S backbone. I've noticed that the model training crashes if drop_path_rate > 0. In particular, I get the following error

RuntimeError: Expected source.size(1) % kNumElementsPerBlock == 0 to be true, but got false.  (Could this error message be improved?  If so, please report an enhancement request to PyTorch.)

with the traceback going all the way to line 173

As recommended in issue #108, one need to set drop_path_rate = 0 when using the ViT-S backbone. What is the reason for this behaviour? In the original DINO, the drop_path_rate = 0.1 for both ViT-S and ViT-B.