adv-reid icon indicating copy to clipboard operation
adv-reid copied to clipboard

Evaluation of defended Model

Open asthaverma13 opened this issue 4 years ago • 4 comments

After training the defended model GOAT, when i am attacking this model, it is giving accuracy as rank1 : mean = 0.0008907363517209888, max = 0.0008907363517209888, min = 0.0008907363517209888, std = 0.0 rank5 : mean = 0.0029691210947930813, max = 0.0029691210947930813, min = 0.0029691210947930813, std = 0.0 rank10 : mean = 0.00801662728190422, max = 0.00801662728190422, min = 0.00801662728190422, std = 0.0 map : mean = 0.0020973790522167803, max = 0.0020973790522167803, min = 0.0020973790522167803, std = 0.0 Total computing time : 161.57796907424927 sec

Whereas, as stated in the paper, the accuracy should be higher after attacking the defended model.

Please provide me the checkpoints of defended model.

Thanks and Regards Astha Verma PhD Scholar

asthaverma13 avatar Jul 23 '21 06:07 asthaverma13

Hello ! Thank you for your interest in our work. Can you tell me which command did you run to train the model ? I'm currently reviewing the code to correct some mistakes. I will upload the checkpoints soon, they should be available in the following week.

qbouniot avatar Jul 30 '21 14:07 qbouniot

Thanks for your reply. I used the following command for defending the model by giving my arguments in place of output_folder, dataset_folder, dataset and checkpoint_name

python train.py
<output_folder>
<dataset_folder>
--dataset
--lr 0.00035
-wd 5e-4
-n 60
-f <checkpoint_name>
-b 32
--classif
--pretrained
--adv
--inter
--pull

Please upload the defended model as soon as possible.

Astha

asthaverma13 avatar Jul 30 '21 17:07 asthaverma13

Hello ! We have uploaded checkpoints of the defended models, the links are now in the readme. I hope this will help you.

qbouniot avatar Sep 28 '21 15:09 qbouniot

Thanks a lot. I will check it out.

Astha

On Tue, Sep 28, 2021, 20:40 Quentin Bouniot @.***> wrote:

Hello ! We have uploaded checkpoints of the defended models, the links are now in the readme. I hope this will help you.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/CEA-LIST/adv-reid/issues/4#issuecomment-929322802, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKBFLWHTGANA7DOIGAZC6S3UEHLG7ANCNFSM5A3MM6YQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

asthaverma13 avatar Sep 28 '21 16:09 asthaverma13