FasterNet icon indicating copy to clipboard operation
FasterNet copied to clipboard

Some problems in section 3.1

Open juan19941228 opened this issue 2 years ago • 4 comments

The equation (2) for calculating memory access does not include the pointwise convolution.

juan19941228 avatar Jun 06 '23 02:06 juan19941228

@juan19941228 Yes, equation (2) only compares the memory access for spatial feature extraction and does not account for the memory access by the pointwise convolution (PWConv).

JierunChen avatar Jul 13 '23 07:07 JierunChen

Is formula 2 only applicable to MobileNet v2, or can it be used with other models as well? This is an important question because in some cases, such as when DWConv is implemented before Conv 1*1, the memory access can be calculated using the formula h * w * 2c + k^2 * c, which results in lower memory usage compared to a regular Conv.

abcsimple avatar Aug 08 '23 09:08 abcsimple

@abcsimple Hi, the comparison of equations (2) and (3) is based on a reasonable assumption that the width or the number of channels when using DWConv is generally higher than that when using Conv.

JierunChen avatar Aug 08 '23 14:08 JierunChen

@JierunChen Thank you for your response. The number of channels in DWConv is increased by the Pointwise Convolution. If DWConv is implemented before Pointwise Convolution, the channel should be the same as the input feature map. Please let me know if I have misunderstood anything.

abcsimple avatar Aug 09 '23 01:08 abcsimple