torcheval icon indicating copy to clipboard operation
torcheval copied to clipboard

Add COCO mAP

Open songyuc opened this issue 1 year ago • 1 comments

🚀 The feature

COCO mAP

COCO mAP (mean average precision) is a widely used evaluation metric for object detection models, especially for the COCO dataset. Unlike the PASCAL VOC evaluation, which has a single IoU (Intersection over Union) threshold for assessing the detection model, the COCO mAP evaluator averages the mAP of 80 classes over 10 IoU thresholds from 0.5 to 0.95 with a step size of 0.05 (AP@[0.5:0.05:0.95]). This is to avoid the bias that a single threshold may induce in the evaluation metric and to provide a more complete analysis of the detection model.

Motivation, pitch

COCO mAP has an official API, which lacks maintenance and has been outdated.

Alternatives

No response

Additional context

No response

songyuc avatar Mar 30 '23 05:03 songyuc

Hey @songyuc, thanks for this feature request! Are you proposing to work on this yourself or did you want to leave it up for someone else to grab?

Can you explain how COCO mAP works? Do you need to have COCO on your device already or does it download part of it to run?

bobakfb avatar Mar 30 '23 23:03 bobakfb