CenterNet2 icon indicating copy to clipboard operation
CenterNet2 copied to clipboard

How is the class-agnostic detection score carried to the 2nd stage?

Open qianyizhang opened this issue 3 years ago • 15 comments

can you show me which part of the code implements this? (what you claimed in paper section 4-Detector design)

the way i see it is that: you replace traditional 2 stage detector's RPN with a strong proposal generator. and I don't see how it suddenly makes the network probabilistic.

qianyizhang avatar Mar 19 '21 10:03 qianyizhang

Hi,have you figured this out ? I'm still confused about this

QZLearning avatar Mar 20 '21 09:03 QZLearning

I think the code you're looking for is in custom_roi_heads.py.

CenterNet2/projects/CenterNet2/centernet/modeling/roi_heads/custom_roi_heads.py

In particular, the function _forward_box() retrieves the proposal scores and multiplies by the class scores.

JimKlingshirn avatar Mar 24 '21 17:03 JimKlingshirn

I think the code you're looking for is in custom_roi_heads.py.

CenterNet2/projects/CenterNet2/centernet/modeling/roi_heads/custom_roi_heads.py

In particular, the function _forward_box() retrieves the proposal scores and multiplies by the class scores.

Hi! Does this mean the class-agnostic detection score is not carried to the 2nd stage at training?

bravezzzzzz avatar Apr 07 '21 08:04 bravezzzzzz

Hello, I use tensorboard and I have observed that there are stage0 metrics. What is stage0?

sh7jacobi avatar Apr 07 '21 11:04 sh7jacobi

Hi! Does this mean the class-agnostic detection score is not carried to the 2nd stage at training? @xingyizhou Can you help to clarify this question ?

chuong98 avatar Apr 12 '21 05:04 chuong98

Hello, I use tensorboard and I have observed that there are stage0 metrics. What is stage0?

Stage 0,1,2 are the three cascaded heads in Cascade RCNN

GrantorShadow avatar Jun 16 '21 10:06 GrantorShadow

I think the code you're looking for is in custom_roi_heads.py. CenterNet2/projects/CenterNet2/centernet/modeling/roi_heads/custom_roi_heads.py In particular, the function _forward_box() retrieves the proposal scores and multiplies by the class scores.

Hi! Does this mean the class-agnostic detection score is not carried to the 2nd stage at training?

https://github.com/xingyizhou/CenterNet2/search?q=MULT_PROPOSAL_SCORE

Multiply proposal score is set to true, I suppose that's how the score is carried forward in the training stage. @xingyizhou Please could you help clarify?

GrantorShadow avatar Jun 16 '21 10:06 GrantorShadow

Hello, I use tensorboard and I have observed that there are stage0 metrics. What is stage0?

Stage 0,1,2 are the three cascaded heads in Cascade RCNN So, CenterNetv2 is combined with Cascade RCNN?

sh7jacobi avatar Jun 21 '21 10:06 sh7jacobi

Hello, I use tensorboard and I have observed that there are stage0 metrics. What is stage0?

Stage 0,1,2 are the three cascaded heads in Cascade RCNN So, CenterNetv2 is combined with Cascade RCNN?

It uses Cascade RCNN heads, Please refer to the paper for further details

GrantorShadow avatar Jun 22 '21 10:06 GrantorShadow

image

zhaoxin111 avatar Jun 28 '21 09:06 zhaoxin111

I'm also confused about this. It seems like only multiplies in inference image

jehovahxu avatar Jul 21 '21 07:07 jehovahxu

I'm also confused about this. It seems like only multiplies in inference image

Seems the code only multiplies the objectness of rpn to the second stage in the inference phase, which is in contrast to the first impression of reading the paper.

jshilong avatar Jul 25 '21 13:07 jshilong

I'm also confused about this. It seems like only multiplies in inference image

Seems the code only multiplies the objectness of rpn to the second stage in the inference phase, which is in contrast to the first impression of reading the paper.

It multiplies the probabilistic of first-stage to the score of second-stage and it is the same as in the paper. But it is only used in inference and it seems like not mentioned it used in training in this paper.

jehovahxu avatar Jul 27 '21 02:07 jehovahxu

So it only multiplies the objectness score with the classification score during inference, because I also got the impression reading the paper that the multiplication would happen during the training phase? @xingyizhou can you maybe help out?

nilskk avatar Jul 30 '21 19:07 nilskk

So it only multiplies the objectness score with the classification score during inference, because I also got the impression reading the paper that the multiplication would happen during the training phase? @xingyizhou can you maybe help out?

To my understanding, the objectness score should be the exponent to the background score. Anyway it's not implemented in the code. :)

wusize avatar Mar 26 '22 15:03 wusize