Faster_RCNN_for_Open_Images_Dataset_Keras icon indicating copy to clipboard operation
Faster_RCNN_for_Open_Images_Dataset_Keras copied to clipboard

AP=1.0 for all but one classes and no boxes drawn on test set

Open giorgosrigas opened this issue 3 years ago • 5 comments

Hello guys. I am facing some issues on the testing phase: no boxes are drawn on the images and when I calculate the AP for each class for each image, three of my four classes always have AP = 1.0. Any idea as to why it could be happening? Thank you

giorgosrigas avatar Apr 30 '21 08:04 giorgosrigas

try lowering the bbox_threshold and debug using the initial list of probabilities of predicted bbxs

Sylv-Lej avatar Apr 30 '21 12:04 Sylv-Lej

Hi, i am facing the same kind of problem as mentioned above. Can you please explain a little further about the initial list of probabilities of predicted bbxs? Thanks in advance.

charinho8 avatar Apr 30 '21 20:04 charinho8

try lowering the bbox_threshold and debug using the initial list of probabilities of predicted bbxs

Thank you for the reply. Could you elaborate a bit more on the bit about the "list of probabilities of predicted bbxs"?

giorgosrigas avatar May 01 '21 00:05 giorgosrigas

probs is the list of predicted classes, you should see here some class and their probabilities.

if np.max(P_cls[0, ii, :]) < 0.7 or np.argmax(P_cls[0, ii, :]) == (P_cls.shape[2] - 1): continue

this line will exclude low probabilities or background predictions. By removing it you should be able to debug the predictions by showing probabilities of low confidence predictions. Debug using this then come back with your results

Sylv-Lej avatar May 12 '21 09:05 Sylv-Lej

Hello, I also do not get any bboxes during testing and AP=1.0 on my 4 classes + bg

with the stated line active, I get no probs at all, with the line commented out, I get probs {'bg': [0.7346484, 0.7075835, ...]} does this mean my classes do net get recognized at all?

I also tried bbox_threshold = 0.01 and R = rpn_to_roi(Y1, Y2, C, K.image_dim_ordering(), overlap_thresh=0.01) but still no bboxes for me

what can i do? I did about 15 hours of cpu training with ~20k images

edit: I have overlapping objects edit: over night i trained another model with self.anchor_box_scales = [32, 64, 128, 256, 512] so i added two more options here and the training worked better in loss_rnp_regr and now i get some boxes in testing i can further work with

Gerro385 avatar Nov 25 '21 09:11 Gerro385