3DUX-Net icon indicating copy to clipboard operation
3DUX-Net copied to clipboard

similarities between the weighted sum approach in self-attention and the convolution per-channel basis.

Open AN-AN-369 opened this issue 11 months ago • 1 comments

Your ideas are great! But I have a question, when introducing this part of "Volumetric Depth-wise Convolution with LKs:", put forward" Inspired by the idea of depth-wise convolution, we have found similarities between the weighted sum approach in self-attention and the convolution per-channel basis.", I did not find a clear explanation in the article, may I ask how to understand this sentence?

AN-AN-369 avatar Aug 07 '23 04:08 AN-AN-369