FCOS.Pytorch icon indicating copy to clipboard operation
FCOS.Pytorch copied to clipboard

The eval code for the calculation of ap is wrong

Open happyConan opened this issue 4 years ago • 3 comments

In the eval.py file, pred_boxes,pred_classes,pred_scores are sorted before calculating ap. In eval_ap_2d function, zip(gt_single_cls, bbox_single_cls, scores_single_cls) was used. but the sizes of gt_single_cls, bbox_single_cls, scores_single_cls are different. This will make low-score results ignored. is it reasonable? eg: gt_single_cls=[[],[3],[],[3]], bbox_single_cls=[[],[3],[3],[3],[3]], scores_single_cls=[[],[0.9],[0.8],[0.7],[0.6]], the 0.6 box will be ignored. but maybe 0.9,0.8,0.7 has the same gt. Consequently, it will cause lower ap.

happyConan avatar Nov 12 '20 02:11 happyConan

The eval code is from network. There seems to be something wrong with this. Thanks!

VectXmy avatar Nov 12 '20 02:11 VectXmy

The eval code is from network. There seems to be something wrong with this. Thanks!

thanks for your reply

happyConan avatar Nov 12 '20 06:11 happyConan

iou is 3d?

howellma35 avatar Dec 15 '20 17:12 howellma35