Error when loading&training EVAVisionTransformer with patch_dropout=0.5

[chenmc1996]

Hi, thanks for the good EVA-clip. I'm loading&training the EVAVisionTransformer in EVA02-CLIP-L-14 and find that setting the patch_dropout to 0.5 raise runtimeError The size of tensor a (128) must match the size of tensor b (256) at non-singleton dimension 2 in

https://github.com/baaivision/EVA/blob/b947f3fe50c50ee5370b9569efb80cd0ee2d2070/EVA-CLIP/rei/eva_clip/rope.py#L137

setting it to zero seem fine. Do you have any idea of how to fix it? Thanks!