ViT-pytorch
ViT-pytorch copied to clipboard
Not able to load ViT-H_14
I was testing using the provided visualize_attention_map.ipynb
The ViT-B_16-224 loads fine but when I downloaded and was loading ViT-H_14, it gave me the following error:
RuntimeError Traceback (most recent call last)
<ipython-input-36-0b02f0ab326a> in <module>
2 config = CONFIGS["ViT-H_14"]
3 model = VisionTransformer(config, num_classes=1000, zero_head=False, img_size=224, vis=True)
----> 4 model.load_from(np.load("imagenet21k_ViT-H_14.npz"))
5 model.eval()
~/Documents/clones/ViT-pytorch/models/modeling.py in load_from(self, weights)
287 nn.init.zeros_(self.head.bias)
288 else:
--> 289 self.head.weight.copy_(np2th(weights["head/kernel"]).t())
290 self.head.bias.copy_(np2th(weights["head/bias"]).t())
291
RuntimeError: The size of tensor a (1000) must match the size of tensor b (21843) at non-singleton dimension 0
What do you think might be the error?