pva-faster-rcnn icon indicating copy to clipboard operation
pva-faster-rcnn copied to clipboard

the Small Object detection issue

Open xiaoxiongli opened this issue 9 years ago • 18 comments

Dear All,

When i training my own dataset(229 category logo, totally 3w+ images) using PVANet, i got mAP = 0.9672, indeed it is very high. PVANet is indeed so good, the original R-FCN is 0.953(i do a modify it get to 0.9705). by the way, they use different backbone. so it is just a reference. but i find that the small object detection result is not as good as faster-rcnn and R-FCN.

For the Small object, the faster-rcnn get the best result, but its false alarm is also the highest. R-FCN get middle result and the lowest false alarm. PVANet get a worse small object detection result and middle false alarm result.

So, I feel confuse about this result. because of using the idea of HyperNet, the PVANet supposed to be have a good performance in small object detection, but it is not in my dataset...

Anyone please give me some tips about this issue, How can i fix it and get a better result? @sanghoon @kyehyeon

xiaoxiongli avatar Oct 25 '16 09:10 xiaoxiongli

I think small objects maybe filtered by nms during generating proposals, you may check the nms parameter

argman avatar Oct 26 '16 02:10 argman

@argman Dear argman, i check the cfg file lib/fast_rcnn/config.py:

__C.TRAIN.RPN_MIN_SIZE = 16 __C.TEST.RPN_MIN_SIZE = 16

it seems the parameter is OK, So What's the problem about this issue?

xiaoxiongli avatar Oct 27 '16 02:10 xiaoxiongli

dear xiaoxiongli,I also want to train my own dataset with py-R-FCN,however i cannot modify my model correctly.Maybe, there are something else i didn't know ,for example i didn't get the right pre-trained model ,could you please show me your models and give me some advice.My Email address is [email protected] 。thank you so much

Simonhong111 avatar Oct 27 '16 06:10 Simonhong111

@Simonhong111 i am not use py-R-FCN, i implement the 4-stage training in MATLAB according the shaoqingren's faster-rcnn MATLAB code, I think you can ask the py-R-FCN code's author for help. i think after i done the PVANet, i will release the MATLAB version R-FCN 4-stage training code.

xiaoxiongli avatar Oct 27 '16 07:10 xiaoxiongli

Hi @xiaoxiongli, I guess maybe it's due to limited computational costs. Could you share some quantitative comparison results?

sanghoon avatar Oct 30 '16 12:10 sanghoon

@sanghoon Dear sanghoon, sure, i already send you a e-mail with the test result and also some comment, thank you very much^_^...

xiaoxiongli avatar Oct 30 '16 15:10 xiaoxiongli

Also curious about small object detection

squidszyd avatar Nov 06 '16 13:11 squidszyd

@xiaoxiongli Dear xiaoxiongli,have you solve the problem?

Caojunxu avatar Nov 21 '16 02:11 Caojunxu

@Caojunxu NO!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

xiaoxiongli avatar Nov 21 '16 06:11 xiaoxiongli

@xiaoxiongli How small of objects do you need to detect? (16x16 is the smallest object?) I also want to resolve this problem, SSD (single shot multibox detection) also has this problem.

ck196 avatar Nov 21 '16 08:11 ck196

@ck196 above 24x24, or maybe above 32x32.................................... i send you a email and hope discuss with you when you are free

xiaoxiongli avatar Nov 21 '16 08:11 xiaoxiongli

@xiaoxiongli hi , I wonder how you finetune your own data? Use full/test.model or example_finetune384/? when I use test.model,I can't get a good result.When I use exampe_finetune384/,the speed is slow(0.18s/img,gtx1070).Can u give me some advice? Thank you in advance!

AITTSMD avatar Nov 29 '16 06:11 AITTSMD

@AITTSMD example_finetune384, i use K40. in the aspect of speed, make sure that you do NOT compile caffe with cudnn, because cudnn's 1x1 convolution is slow.

xiaoxiongli avatar Nov 29 '16 06:11 xiaoxiongli

hello,why the caffemodel th author provided i cant download it, do you success? if you hava download them, could you share with me?thanks a lot~

solemnrole avatar Jan 12 '17 08:01 solemnrole

@xiaoxiongli

I appreciate if you have a look at my question: #63 Also I appreciate if you inform me if you have published your MATLAB version R-FCN 4-stage training codes.

MyVanitar avatar Feb 15 '17 01:02 MyVanitar

Facing the same small object not detected problem when using SSD. Was anyone able to find the cause? Did tweaking the nms parameter help? Would greatly appreciate it if someone could share their experience /solution attempts

shivam6294 avatar Jul 27 '17 07:07 shivam6294

@shivam6294

Increase the network image size to higher numbers

MyVanitar avatar Jul 27 '17 07:07 MyVanitar

https://www.zhihu.com/question/49455386 ?

FreeApe avatar Dec 09 '17 07:12 FreeApe