External-Attention-pytorch

External-Attention-pytorch copied to clipboard

mvit_s = mobilevit_s() checkpoint = torch.load("mobilevit_s.pt",map_location='cpu') mvit_s.load_state_dict(checkpoint) **I downlod checkpoint from https://github.com/apple/ml-cvnets/blob/main/examples/README-mobilevit.md. How can I load this** RuntimeError: Error(s) in loading state_dict for MobileViT: Missing key(s) in state_dict: "conv_1.0.weight", "conv_1.0.bias",...

FeboReigns

mobilevit ’s structure output donot consistent with the paper

3

thanks you for the great work; here is the paper's graph: ![Uploading image.png…]() I print the layer input and output below: 0 fc x.shape torch.Size([1, 3, 224, 224]) 1 fc...

wilbur-caper

RuntimeError: Input type (torch.cuda.FloatTensor) and weight type (torch.FloatTensor) should be the same

11

作者你好，在实际网络中数据都是GPU张量，直接使用注意力就会出现以上错误，我使用attention.cuda()把注意力转为GPU格式还是报错，请问怎么解决呢？

kongyan66

MobileViT-einops.EinopsError: Error while processing rearrange-reduction pattern "b d (h ph) (w pw) -> b (ph pw) (h w) d".

4

Thanks for your great repo. I changed some models'backbone into MobileViT, but it were wrong in traning. I checked the feature size carefully and I don‘t know how to solve...

JiangMei0201

How to use attention module efficiently?

9

Hi, This repository helped me a lot. thank you By the way, I have a question. Is there a way to do attention only certain parts of the image? In...

SoyeongChoi

davide-coccomini

小白问下这个图是什么画的

1


yihui8776

I need to modify the following model by adding one linear layer followed by one dropout layer and finally one linear layer(by concatenating one output from dropout layer and one...

IamSparky

guanchuwang

Hi When I check this line, I thought that to make sure the spatial size won't change, the padding value should be consistent with the dilation value. Since `kernel_size =...

CiaoHe