objectdetection-saliency-maps icon indicating copy to clipboard operation
objectdetection-saliency-maps copied to clipboard

Is it possible for D-RISE to generate heatmaps for mask R-CNN?

Open mingqiJ opened this issue 2 years ago • 9 comments

Hi, I see you use Yolo v3 to do many tests. Is it possible to apply your D-RISE to the mask R-CNN?

mingqiJ avatar Jan 13 '23 20:01 mingqiJ

Hi, I see you use Yolo v3 to do many tests. Is it possible to apply your D-RISE to the mask R-CNN?

Yes, you can have a try, load mask-cnn config, it should does work.

RuoyuChen10 avatar Jan 13 '23 21:01 RuoyuChen10

Okay. Thanks for your reply. You mean maybe directly use mask-cnn it can work? I will try it.

mingqiJ avatar Jan 13 '23 22:01 mingqiJ

Okay. Thanks for your reply. You mean maybe directly use mask-cnn it can work? I will try it.

Yes, the only possible note is that Mask R-CNN will return masks, maybe a little note because methods like yolo v3 will only return boxes.

RuoyuChen10 avatar Jan 14 '23 13:01 RuoyuChen10

Hi, Is the D-RISE very slow? When I use 5000 nmask, use Mask R-CNN. It takes about 220s each object. Very slow

mingqiJ avatar Feb 09 '23 20:02 mingqiJ

Hi, Is the D-RISE very slow? When I use 5000 nmask, use Mask R-CNN. It takes about 220s each object. Very slow

Yes, in the paper, D-RISE runs in approximately 70s per image (for all detections) for YOLOv3 and 170s for Faster R-CNN on NVidia Tesla V100.

RuoyuChen10 avatar Feb 10 '23 06:02 RuoyuChen10

Yes, I also see it. So slow. Very confused about how did they finish all MS COCO valid images if they use Faster R-CNN.....

mingqiJ avatar Feb 10 '23 06:02 mingqiJ

Yes, I also see it. So slow. Very confused about how did they finish all MS COCO valid images if they use Faster R-CNN.....

When inference, each image can only choose one proposal for evaluation (Point Game).

RuoyuChen10 avatar Feb 10 '23 06:02 RuoyuChen10

You mean they only use 1 object for each image to evaluate (Point Game)?

mingqiJ avatar Feb 10 '23 06:02 mingqiJ

You mean they only use 1 object for each image to evaluate (Point Game)?

One proposal has the highest prediction score.

RuoyuChen10 avatar Feb 10 '23 07:02 RuoyuChen10