CoordAttention icon indicating copy to clipboard operation
CoordAttention copied to clipboard

Published 20 hours ago • verified publisher icon houqb

why self.relu(x + 3) / 6 ?

Open Ritian-Li opened this issue 3 years ago • 3 comments

https://github.com/Andrew-Qibin/CoordAttention/blob/8ab857a3b3a149dfe1ce018a90c5c23816bbf860/coordatt.py#L12

Ritian-Li avatar May 03 '21 08:05 Ritian-Li

To normalize the result to between 0 and 1

Polaris231 avatar May 12 '21 07:05 Polaris231

To normalize the result to between 0 and 1 why normalize the result to between 0 and 1?

ZhangJT0127 avatar May 18 '21 06:05 ZhangJT0127

This is for better optimization for mobile networks.

houqb avatar Jun 22 '21 09:06 houqb