Dynamic-convolution-Pytorch icon indicating copy to clipboard operation
Dynamic-convolution-Pytorch copied to clipboard

Published 20 hours ago • verified publisher icon kaijieshi7

请问一下，这里的attention2d,是什么类型的attention机制呢？

Open shuyuandeqipa opened this issue 5 years ago • 2 comments

shuyuandeqipa avatar Aug 30 '20 15:08 shuyuandeqipa

我是按照《Dynamic Convolution: Attention over Convolution Kernels》这篇文章实现的。文章中图示了他的attention，就是简单的加权求和。 v2-253337874838d4b99e6a0609e6f0d150_720w

kaijieshi7 avatar Aug 31 '20 06:08 kaijieshi7

使用了SE block外加一个Softmax来生成注意力，属于通道注意力吧，不过是对卷积核的通道

Asthestarsfalll avatar Aug 01 '21 08:08 Asthestarsfalll