mmpose icon indicating copy to clipboard operation
mmpose copied to clipboard

[Docs] Confusion about the score range of the Simcc Head

Open T-S-Liang opened this issue 7 months ago • 0 comments

📚 The doc issue

Dear all,

Thank you for the great work! I’ve been confused about the range for the Simcc head for a long time. I’ve seen similar issues Duplicate of #2939 , but the details for applying specific scores for COCO evaluation still seem to be unclear.

The following are my doubts:

  1. The score value for the Simcc head seems not to be normalized. In the evaluation code from mmpose, a keypoint threshold is needed for filtering out the low quality predictions, would there be any standard guideline to implement this?

  2. I’m wondering if there would be a standard way for incorporating the keypoint score for evaluation. As far as I can understand from the several projects like RTMPose and DWPose, it seems that the the output score is considered as the maximum of the output logits (which is not normalized). Should we apply the logits maximum or the normalized value as the score for final evaluation?

Thank you so much!

Suggest a potential alternative/fix

No response

T-S-Liang avatar Apr 18 '25 02:04 T-S-Liang