External-Attention-pytorch icon indicating copy to clipboard operation
External-Attention-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon xmu-xiaoma666

MLP Confusion

Open abhimanyuchadha96 opened this issue 2 years ago • 1 comments

https://github.com/xmu-xiaoma666/External-Attention-pytorch/blob/2f80b03ef1cdd835d4a2d21eff6f8b3534e5d601/model/attention/CoAtNet.py#L21

Correct me, if I am wrong but isn't MLP usually a collection of fully-connected layers and not convolution layers?

abhimanyuchadha96 avatar May 16 '22 14:05 abhimanyuchadha96

same with CBAM ... https://github.com/xmu-xiaoma666/External-Attention-pytorch/blob/2f80b03ef1cdd835d4a2d21eff6f8b3534e5d601/model/attention/CBAM.py#L13

EricPengShuai avatar Mar 17 '23 01:03 EricPengShuai