RepQ-ViT icon indicating copy to clipboard operation
RepQ-ViT copied to clipboard

Discrepancy between reported and tested mAP for `mask_rcnn_swin_small`

Open GoatWu opened this issue 2 years ago • 3 comments

Hello! In your four detection experiments, I noticed a significant difference between the reported result and the test result for mask_rcnn_swin_small. The reported result is 44.2 mAP, but the tested result is 42.8 mAP. However, the results for the other three detection experiments match the reported results. I was wondering if there are any specific settings for mask_rcnn_swin_small, such as only quantizing the backbone?

GoatWu avatar Oct 28 '23 09:10 GoatWu

Same question, I also get the results of about 42.7 +- 0.1 AP on mask_rcnn_swin_small model.

heekhero avatar Oct 19 '24 14:10 heekhero

Hello! In your four detection experiments, I noticed a significant difference between the reported result and the test result for mask_rcnn_swin_small. The reported result is 44.2 mAP, but the tested result is 42.8 mAP. However, the results for the other three detection experiments match the reported results. I was wondering if there are any specific settings for mask_rcnn_swin_small, such as only quantizing the backbone?

Hi, I'm trying to reproduce the results of the COCO dataset, but I've been having problems with the environment configuration, what are the various versions you have configured?

Kishon-zzx avatar Jan 30 '25 08:01 Kishon-zzx

Same question, I also get the results of about 42.7 +- 0.1 AP on mask_rcnn_swin_small model.

Hi, I'm trying to reproduce the results of the COCO dataset, but I've been having problems with the environment configuration, what are the various versions you have configured?

Kishon-zzx avatar Jan 30 '25 08:01 Kishon-zzx