DAWN_WACV2020 icon indicating copy to clipboard operation
DAWN_WACV2020 copied to clipboard

number of parameters different between paper and model

Open thegodone opened this issue 3 years ago • 1 comments

Hi,

I ran your example using the CIFAR-10 32x32, with 16 init , kernel=3:

  • level 3: 42.2k parameters
  • level 4: 55.3k parameters with CIFAR-100 same config:
  • level 3: 56.7k parameters
  • level 4: 74.1k parameters While in the paper it's reported 59.3k in table 2 (I guess for CIFAR-100 but it's definitely not 56.7k).

Another question: I notice that you concate also into det the aprox. I don't see this in the paper ? https://github.com/mxbastidasr/DAWN_WACV2020/blob/7a5876c3dc27d3515eaaa76b57b09b9c29a002b5/models/dawn.py#L310

Finally, in the paper you are using huber loss and in the code it's clearly l1 norm instead in your code https://github.com/mxbastidasr/DAWN_WACV2020/blob/7a5876c3dc27d3515eaaa76b57b09b9c29a002b5/models/dawn.py#L88 why to change this part ?

In the paper you only write c,x for the approximation eq 7 but in the code also consider d,HL and c,LL additional constraints ?

I also cannot reproduce the 86% accuracy in the table, instead I got 82%

thanks for helping me

thegodone avatar Jan 15 '22 13:01 thegodone

To whom wanted to reproduce you need to modify the repo and add smoothL1 aka HuberLoss to get the correct accuracy values. Also something clearly not in the paper (but in the code) we need to use weighted_decay to regularize the network weights.

thegodone avatar Feb 02 '22 08:02 thegodone