nmaac

Results 28 comments of nmaac

aconc和swish速度基本一样,如果慢可以参考hswish 把sigmoid换成hard sigmoid。另外一般不需要把relu全换掉

Hi @starsky68 @xuhao-anhe , seems the error is caused by the batch size value. If you set batch size = 1, please remove the bn layers: `beta = self.sigmoid(self.fc2(self.fc1(x.mean(dim=2, keepdims=True).mean(dim=3,...

> > Hi @starsky68 @xuhao-anhe , seems the error is caused by the batch size value. If you set batch size = 1, please remove the bn layers: > >...

看样子没什么问题,你的relu baseline是正常的map吗?不用预训练直接train from scratch呢?

@Zhou-boyi1997 hello我们这边没有VGG的模型,小模型可以参考使用ShuffleNetV2

暂时没有

Hi @glenn-jocher , (1) you should use torch.max(), which is different from [MegEngine API](https://github.com/MegEngine/MegEngine/blob/fecbfdbb170df96216fefac2b95b8a5fe80e5b00/python_module/megengine/functional/elemwise.py). (2) yes you could try to use FReLU only in the backbone first, then try it...

Hi @fuchao01 , the procedure of applying in InceptionV3 is the same as the other networks: - I would not suggest to replace all of them which would not only...

the regular depthwise convolution [(implementation here)](https://github.com/megvii-model/FunnelAct/blob/master/resnet/frelu.py#L9)

Hi @qbTrible, applying FReLU in the backbone is enough to obtain improvements. For the dataset question, besides the **open datasets** in our experiments, I have assisted others to apply the...