faster_rcnn_pytorch icon indicating copy to clipboard operation
faster_rcnn_pytorch copied to clipboard

Question about the reslute mAP.

Open ayumiymk opened this issue 7 years ago • 7 comments

Does anyone get the comparable mAP on VOC07 in the origin paper?

ayumiymk avatar May 17 '17 09:05 ayumiymk

The author reported here: https://github.com/longcw/faster_rcnn_pytorch#training-on-pascal-voc-2007

zhanghang1989 avatar May 17 '17 13:05 zhanghang1989

But the author got a 0.661 mAP on VOC07 while the origin paper got a 0.699 mAP. The author said we may need to tune the loss function defined in faster_rcnn/faster_rcnn.py by ourself. So what I want to know is the config to get a mAP comparable to the origin paper.

ayumiymk avatar May 19 '17 09:05 ayumiymk

I rewrite the project, and calculate its mAP, only 0.356.

acgtyrant avatar Jul 10 '17 07:07 acgtyrant

I just git cloned this project and train on my 1080Ti machine. The finally mAP@100000iteration is 65.6%.

zchrissirhcz avatar Oct 07 '17 08:10 zchrissirhcz

@zchrissirhcz @longcw so what does the author mean by "tune the loss by ourselves in faster_rcnn.py" to get 0.699 mAP?

brisker avatar Oct 08 '17 16:10 brisker

@brisker In my opinion, I appreciate longcw's re-implementation. However, I'd like to use implementations with equal or higher accuracy than the paper. I suggest try this implementation:https://github.com/ruotianluo/pytorch-faster-rcnn

zchrissirhcz avatar Oct 08 '17 16:10 zchrissirhcz

@zchrissirhcz https://github.com/ruotianluo/pytorch-faster-rcnn this implementation seems to be more consistent with rbg's original caffe version implementation. But I like longcw's implementation more. But still, I have no idea where to modify the loss function, as longcw have indicated. Do you know?

brisker avatar Oct 08 '17 16:10 brisker