few-shot-object-detection icon indicating copy to clipboard operation
few-shot-object-detection copied to clipboard

The results of 3shot on VOC Split1

Open AmingWu opened this issue 4 years ago • 5 comments

I find the results of 3shot are lower than that of the paper. The nAP50 is 38.3. three-shot

AmingWu avatar Jun 14 '20 13:06 AmingWu

We expect there to be tiny differences between runs, so the numbers won't be exactly the same. You can try rerunning the training to see what the results are.

thomasehuang avatar Jun 18 '20 06:06 thomasehuang

We expect there to be tiny differences between runs, so the numbers won't be exactly the same. You can try rerunning the training to see what the results are.

The paper result of split0 shot3 is 43.6,really? this is not a tiny difference~

wuziheng avatar Jul 03 '20 02:07 wuziheng

The results could vary depending on your base model as well. We found the results to be fairly consistent with the same base model.

thomasehuang avatar Jul 17 '20 14:07 thomasehuang

@thomasehuang I can get the similar split1 5shot results with the reported one, ~ 55% nAP50 with the base model you released. However, if I train the base model by myself, it will degrade to ~52%. Note that my base model indeed has a consistent base mAP with yours, e.g., ~81% for AP50. Could you advise? Thanks.

Ze-Yang avatar Aug 17 '20 03:08 Ze-Yang

got similar problem

MartinYYYYan avatar Sep 30 '21 06:09 MartinYYYYan