Targeted-Dropout icon indicating copy to clipboard operation
Targeted-Dropout copied to clipboard

ResNet-32 architecture doesn't match ResNet paper

Open j201 opened this issue 5 years ago • 0 comments

The hparams for ResNet-32 seem to define an input layer with 16 filters followed by stacks of layers with 32, 64, and then 128 filters: https://github.com/for-ai/TD/blob/master/hparams/resnet.py#L12

This doesn't match the ResNet paper, which defines ResNet-32 with CIFAR-10 as having an input layer of 16 filters followed by stacks of layers with 16, 32, and 64 filters:

image

Also, the pruning code reports a total of 1 857 498 parameters, much more than the 0.46M reported in the paper. Changing hps.residual_filters to [16, 16, 32, 64] gives me a much closer value of 468 890 parameters.

j201 avatar Feb 12 '20 20:02 j201