CVPR_2019_PNI icon indicating copy to clipboard operation
CVPR_2019_PNI copied to clipboard

can't regain the claimed result

Open jiaming-lee opened this issue 5 years ago • 4 comments

I run your code but can't regain the claimed result except the baseline model. Can you upload your pretrained model?

jiaming-lee avatar Oct 20 '19 04:10 jiaming-lee

@yangadan which result you cannot regain?

elliothe avatar Oct 21 '19 01:10 elliothe

@yangadan which result you cannot regain?

noise_resnet20 PNI-W model Test Prec@1 83.090 Prec@5 99.080 Error@1 16.910 PGD Test Prec@1 44.080 Prec@5 93.550 Error@1 55.920 FGSM Test Prec@1 51.000 Prec@5 94.500 Error@1 49.000

jiaming-lee avatar Oct 21 '19 07:10 jiaming-lee

@yangadan Hi, I am sorry for the late reply. The pre-trained models for both layer-wise and channel-wise versions are uploaded at Readme result section.

I think there might be some setting problem. I just trained a new layerwise PNI model, and I can only get 84.11% for the clean accuracy. I will look at the training configuration and give you an update later.

elliothe avatar Oct 23 '19 19:10 elliothe

@yangadan Hi, I am sorry for the late reply. The pre-trained models for both layer-wise and channel-wise versions are uploaded at Readme result section.

I think there might be some setting problem. I just trained a new layerwise PNI model, and I can only get 84.11% for the clean accuracy. I will look at the training configuration and give you an update later.

Thank you

jiaming-lee avatar Oct 25 '19 12:10 jiaming-lee