InstanceRefer icon indicating copy to clipboard operation
InstanceRefer copied to clipboard

About co-attention problem

Open ChengShiest opened this issue 4 years ago • 2 comments

Hi, thanks for your amazing work.

We notice that in your newly released version, you use co-attention from MCAN to achieve a much higher performance, I wonder that will this part of code be released?

Thanks!

ChengShiest avatar Oct 14 '21 13:10 ChengShiest

Hi @sH1cHEnG ,

You can refer to https://github.com/MILVLG/mcan-vqa for the implementaion. We may release the code in the future.

Best,

Zhihao

CurryYuan avatar Oct 14 '21 16:10 CurryYuan

Hi @sH1cHEnG ,

You can refer to https://github.com/MILVLG/mcan-vqa for the implementaion. We may release the code in the future.

Best,

Zhihao

@CurryYuan 非常感谢您的伟大的工作,我想请教一下您用的MCAN里面的Co-Attention对三个打分进行加权求和,而且比将三个打分进行逐元素相加效果好,请问您是用的MCAN里面的哪一部分对得到的最后三个打分进行加权求和的呢?是用的Stacking,encoder-decoder,还是attention-reduce?期待您的回复,谢谢!

image

longmalongma avatar Dec 09 '21 04:12 longmalongma