UltraLight-VM-UNet icon indicating copy to clipboard operation
UltraLight-VM-UNet copied to clipboard

Ablation and comparison with Conv

Open fceex49 opened this issue 10 months ago • 3 comments

Hi

in your ablation experiments where you have used Conv in encoder and decoder, isn‘t that same as UNET?

why then do you have for the Conv variants so less params and GFLOPS compared with UNET?

fceex49 avatar Apr 14 '24 20:04 fceex49

Hi, the convolution used for ablation experiment 2 is a standard convolution with kernel 3. This is in contrast to UNet where our network framework uses a smaller number of channels.

wurenkai avatar Apr 15 '24 01:04 wurenkai

But then your comparison wrt param and Glops with UNET (2mio params) is not fair, if there the channel nr are different?

fceex49 avatar Apr 15 '24 10:04 fceex49

We don't think so. We use one of the most classical channel numbers of UNet, which maintains its excellent performance. In addition, a reduction in the number of traditional UNet channels results in a severe performance degradation, which is inconsistent with its use in UNet. Even so, the direct replacement of convolution with PVM Layer in traditional UNet results in an explosive parameter reduction of 80.38%.

wurenkai avatar Apr 15 '24 13:04 wurenkai