attention-module icon indicating copy to clipboard operation
attention-module copied to clipboard

Published 20 hours ago • verified publisher icon Jongchan

Element-wise summation

Open maria8899 opened this issue 6 years ago • 2 comments

Hi, in your paper you say you are choosing element-wise summation to combine the two branches, however in your code you are using a product

https://github.com/Jongchan/attention-module/blob/1a23ae52aa4669ad655c41fc2bb6957ce5d70f6e/MODELS/bam.py#L48

Could you elaborate on this? Thanks

maria8899 avatar Oct 15 '18 13:10 maria8899

look at the ablation study part in the paper 3 sum gets better performance than prod, maybe you can modify prod to sum.

splinter21 avatar Dec 23 '18 15:12 splinter21

How accurate is your BAM - based cifari100?

sankin1770 avatar Feb 20 '19 04:02 sankin1770