Evaluation of defended Model
After training the defended model GOAT, when i am attacking this model, it is giving accuracy as rank1 : mean = 0.0008907363517209888, max = 0.0008907363517209888, min = 0.0008907363517209888, std = 0.0 rank5 : mean = 0.0029691210947930813, max = 0.0029691210947930813, min = 0.0029691210947930813, std = 0.0 rank10 : mean = 0.00801662728190422, max = 0.00801662728190422, min = 0.00801662728190422, std = 0.0 map : mean = 0.0020973790522167803, max = 0.0020973790522167803, min = 0.0020973790522167803, std = 0.0 Total computing time : 161.57796907424927 sec
Whereas, as stated in the paper, the accuracy should be higher after attacking the defended model.
Please provide me the checkpoints of defended model.
Thanks and Regards Astha Verma PhD Scholar
Hello ! Thank you for your interest in our work. Can you tell me which command did you run to train the model ? I'm currently reviewing the code to correct some mistakes. I will upload the checkpoints soon, they should be available in the following week.
Thanks for your reply. I used the following command for defending the model by giving my arguments in place of output_folder, dataset_folder, dataset and checkpoint_name
python train.py
<output_folder>
<dataset_folder>
--dataset
--lr 0.00035
-wd 5e-4
-n 60
-f <checkpoint_name>
-b 32
--classif
--pretrained
--adv
--inter
--pull
Please upload the defended model as soon as possible.
Astha
Hello ! We have uploaded checkpoints of the defended models, the links are now in the readme. I hope this will help you.
Thanks a lot. I will check it out.
Astha
On Tue, Sep 28, 2021, 20:40 Quentin Bouniot @.***> wrote:
Hello ! We have uploaded checkpoints of the defended models, the links are now in the readme. I hope this will help you.
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/CEA-LIST/adv-reid/issues/4#issuecomment-929322802, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKBFLWHTGANA7DOIGAZC6S3UEHLG7ANCNFSM5A3MM6YQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.