CurricularFace icon indicating copy to clipboard operation
CurricularFace copied to clipboard

can not perform same as your pretrained res101

Open ruiming46zrm opened this issue 4 years ago • 13 comments

hello

Evaluation: LFW Acc: 0.9968333333333332, CFP_FP Acc: 0.8959999999999999, AgeDB Acc: 0.9726666666666667

it's my training result as 20 epoch , hyper param as you set .. acc on cfp-fp is quite bad...

ruiming46zrm avatar Apr 21 '20 02:04 ruiming46zrm

train on which dataset? I use refined ms1mv2 provided by the authors of arcface, which has 85742 ids.

HuangYG123 avatar Apr 21 '20 03:04 HuangYG123

@HuangYG123 in deepglint(trillion pairs), 18w id there. batchsize300. arcface train with deepglint is better than ms1mv2.

ruiming46zrm avatar Apr 23 '20 03:04 ruiming46zrm

@HuangYG123 in deepglint(trillion pairs), 18w id there. batchsize300. arcface train with deepglint is better than ms1mv2.

Hey, what are the results on ms1mv2 and deepglint with arcface? thx.

ainnn avatar Jul 06 '20 03:07 ainnn

please ruiming46zrm, I test the model provided by the author on LFW but the result is 0.661 not 99.+. So, please I need a link to LFW and its pair file. I think the problem for me is LFW itself.

Thanks in advance

HeshamAMH avatar Sep 04 '20 05:09 HeshamAMH

@HuangYG123 I got the results here when using file pretrained model CurricularFace_Backbone.pth. These are far more different from the pubic results. Please check your file CurricularFace_Backbone.pth Evaluation: LFW Acc: 0.661, CPLFW Acc: 0.5271666666666667

Thanks

vietth-bka avatar Oct 23 '20 11:10 vietth-bka

@HuangYG123 I got the results here when using file pretrained model CurricularFace_Backbone.pth. These are far more different from the pubic results. Please check your file CurricularFace_Backbone.pth Evaluation: LFW Acc: 0.661, CPLFW Acc: 0.5271666666666667

Thanks

I have the same problem, are you sloved?

luhairong11 avatar Sep 09 '21 10:09 luhairong11

@luhairong11 I downloaded the (preprocessed) LFW data including the pairs file from here and achieved at least on LFW = 99.783 using the provided CurricularFace model. Still a bit worse, but I guess it's the minor differences in preprocessing. So the provided pre-trained model shouldn't be the problem, maybe there is something wrong with your used preprocessing/pairs?

marcohuber avatar Oct 22 '21 12:10 marcohuber

@luhairong11 I downloaded the (preprocessed) LFW data including the pairs file from here and achieved at least on LFW = 99.783 using the provided CurricularFace model. Still a bit worse, but I guess it's the minor differences in preprocessing. So the provided pre-trained model shouldn't be the problem, maybe there is something wrong with your used preprocessing/pairs?

I downloaded the preprocessed LFW data is https://github.com/ZhaoJ9014/face.evoLVe,it is according to author provide https://github.com/HuangYG123/CurricularFace in Usage,is it wrong?

luhairong11 avatar Oct 25 '21 02:10 luhairong11

@HuangYG123 I got the results here when using file pretrained model CurricularFace_Backbone.pth. These are far more different from the pubic results. Please check your file CurricularFace_Backbone.pth Evaluation: LFW Acc: 0.661, CPLFW Acc: 0.5271666666666667 Thanks

I have the same problem, are you sloved?

This happens when you don't load the model checkpoint properly!

michellerybak avatar May 20 '22 23:05 michellerybak

@michellerybak what do u mean by loading the model checkpoint correctly?

billpsomas avatar Jun 01 '22 21:06 billpsomas

Sorry, should've specified!

In config.py make sure you specify the correct path for MODEL_ROOT = , otherwise it just loads the model without the pretrained weights and it does not throw an error.

michellerybak avatar Jun 01 '22 22:06 michellerybak

Sorry, should've specified!

In config.py make sure you specify the correct path for MODEL_ROOT = , otherwise it just loads the model without the pretrained weights and it does not throw an error.

@michellerybak perfect, you were right. Actually, I also added the path to BACKBONE_RESUME_ROOT = ... and it worked fine. I think this was the problem. I am able to reproduce the numbers now! Thank you!

billpsomas avatar Jun 01 '22 22:06 billpsomas

Sorry, should've specified! In config.py make sure you specify the correct path for MODEL_ROOT = , otherwise it just loads the model without the pretrained weights and it does not throw an error.

@michellerybak perfect, you were right. Actually, I also added the path to BACKBONE_RESUME_ROOT = ... and it worked fine. I think this was the problem. I am able to reproduce the numbers now! Thank you!

ah, I think that's probably what I meant and just misspoke. I'm glad you got it working!

michellerybak avatar Jun 01 '22 22:06 michellerybak