mAP icon indicating copy to clipboard operation
mAP copied to clipboard

Is the confidence only used for sorting?

Open SingL3 opened this issue 4 years ago • 4 comments

Hi, I read the evaluation code of wider face dataset and compare it with this repo. As I can see, the confidence is only used for sorting the detection result in this repo. In the evaluation code of wider face, seem it used confidence to decide to calculate the pr info. I have tested to let my confidence become "new_confidence = 0.1 x confidence + 0.6" to keep the order but different from the real confindence. And I got similar mAP. So is this an error or did I misunderstand the mAP?

SingL3 avatar Oct 22 '20 03:10 SingL3

Good point! Can you please send the a link to the "evaluation code of wider face"?

mfiro avatar Nov 12 '20 22:11 mfiro

@mfiro http://mmlab.ie.cuhk.edu.hk/projects/WIDERFace/support/eval_script/eval_tools.zip or http://shuoyang1213.me/WIDERFACE/support/eval_script/eval_tools.zip

SingL3 avatar Nov 18 '20 13:11 SingL3

I also wonder 'confidence' is not necessary for calculating mAP? It seem to used only showing on image.

eunyoung1124 avatar Jan 28 '21 16:01 eunyoung1124

I think the code of wider face is correct. The only different is that you should read all the detection results with confidence and normalize them using (confidence - min) / (max - min). This also helps one to choose the best score theshold for deployment.(For a two-class classifier, it is not always the best to choose 0.5 as threshold) This is my understanding. Feel free to share yours.

SingL3 avatar Jan 28 '21 16:01 SingL3