TextFuseNet icon indicating copy to clipboard operation
TextFuseNet copied to clipboard

multi-path fusion in detection branch ?

Open TaekyungKi opened this issue 3 years ago • 1 comments

Hi, thank you for interesting works.

I'm confused about multi-path fusion in detection branch. In the paper, it is explained the multi-path fusion in detection branch, which fuses "word level features" and "global level features (from Semantic segmentation branch)". This is depicted in Figure.2, and is explained in section 3.1, 3.2 in the paper.

But in the code, the multi-path fusion in detection branch is not there. The class method "_forward_box" in class "StandardROIHeads" of /detectron2/modeling/roi_heads.py, does not use multi-path fuse, unlike the class method "_forward_mask" in the same root.. right? Moreover, "mutil_path_fuse_module.py" explains the argument is mask roi features..

Is there anything i missed? Thank you.

TaekyungKi avatar Mar 26 '21 05:03 TaekyungKi

@TaekyungKi The same question and the author's answer are in the issue #14.

qutrino avatar Mar 27 '21 15:03 qutrino