Semantic-Segmentation-Suite icon indicating copy to clipboard operation
Semantic-Segmentation-Suite copied to clipboard

The question in the Model BiSeNet.

Open Reagan1311 opened this issue 6 years ago • 7 comments

In the models/BiSeNet.py the line 91, according to the paper, I think the input should be end_points['pool5'], is that right? default

Reagan1311 avatar Nov 15 '18 02:11 Reagan1311

Have you tested with this modification and does it resolve the mIoU problem discribed in issue 120 ?

Peamon avatar Nov 21 '18 10:11 Peamon

Have you tested with this modification and does it resolve the mIoU problem discribed in issue 120 ?

No, It's the same result, the test mean iou is still not high: bisenet_test And what confused me most is the DeepLabV3+(currently the state of the art), it's result is also not high, mean iou is just 48%, while GCN get 55%.

Reagan1311 avatar Nov 22 '18 00:11 Reagan1311

Is the miou calculation correct (i read it and it seems to be) ? Did you try to use tf.metrics.mean_iou like Deeplab do ?

Peamon avatar Nov 22 '18 08:11 Peamon

Is the miou calculation correct (i read it and it seems to be) ? Did you try to use tf.metrics.mean_iou like Deeplab do ?

I think it is correct, and I don't change the metrics function in this code, so I guess it's some problem in the frontend backbone, and also should do training in the full-resolution image or reset the learning_rate and the batch_size.

Reagan1311 avatar Nov 22 '18 09:11 Reagan1311

@Reagan1311 I read the paper carefully, and I find that the author adds a GAP on the tail of Context Path. Then the author just combines the up-sampled output feature of global pooling and the features of the lightweight model. However, my question is how the author combines features, add ? concatenate ? or multiply and then concatenate like this repo?

HuaZheLei avatar Dec 26 '18 06:12 HuaZheLei

@Reagan1311 I read the paper carefully, and I find that the author adds a GAP on the tail of Context Path. Then the author just combines the up-sampled output feature of global pooling and the features of the lightweight model. However, my question is how the author combines features, add ? concatenate ? or multiply and then concatenate like this repo?

I understand your question, as the author didn't open the source code, and it's also not mentioned in this paper about how to combine features in the Context Path, so I think we should wait for the official code to get the answer.

Reagan1311 avatar Dec 26 '18 07:12 Reagan1311

Official release : https://github.com/ycszen/TorchSeg

Peamon avatar Dec 09 '19 09:12 Peamon