External-Attention-pytorch
External-Attention-pytorch copied to clipboard
Published
20 hours ago •
xmu-xiaoma666
xmu-xiaoma666
Wrong BAM module in your code
I notice the code in BAM is :
def forward(self, x): b, c, _, _ = x.size() sa_out=self.sa(x) ca_out=self.ca(x) weight = self.sigmoid(sa_out*ca_out) weight=self.sigmoid(sa_out+ca_out) # here out=(1+weight)*x return out
here should be '*' instead of '+'.
