DAWN_WACV2020
DAWN_WACV2020 copied to clipboard
number of parameters different between paper and model
Hi,
I ran your example using the CIFAR-10 32x32, with 16 init , kernel=3:
- level 3: 42.2k parameters
- level 4: 55.3k parameters with CIFAR-100 same config:
- level 3: 56.7k parameters
- level 4: 74.1k parameters While in the paper it's reported 59.3k in table 2 (I guess for CIFAR-100 but it's definitely not 56.7k).
Another question: I notice that you concate also into det the aprox. I don't see this in the paper ? https://github.com/mxbastidasr/DAWN_WACV2020/blob/7a5876c3dc27d3515eaaa76b57b09b9c29a002b5/models/dawn.py#L310
Finally, in the paper you are using huber loss and in the code it's clearly l1 norm instead in your code https://github.com/mxbastidasr/DAWN_WACV2020/blob/7a5876c3dc27d3515eaaa76b57b09b9c29a002b5/models/dawn.py#L88 why to change this part ?
In the paper you only write c,x for the approximation eq 7 but in the code also consider d,HL and c,LL additional constraints ?
I also cannot reproduce the 86% accuracy in the table, instead I got 82%
thanks for helping me
To whom wanted to reproduce you need to modify the repo and add smoothL1 aka HuberLoss to get the correct accuracy values. Also something clearly not in the paper (but in the code) we need to use weighted_decay to regularize the network weights.