CoTNet icon indicating copy to clipboard operation
CoTNet copied to clipboard

采用3*3卷积还能构建全局注意力吗?

Open 23jisuper opened this issue 1 year ago • 0 comments

k,q,v中k和v采用3*3卷积来提取局部特征,还能进行全局建模吗?

23jisuper avatar Jun 16 '24 12:06 23jisuper