DeepLab-v3-plus-cityscapes icon indicating copy to clipboard operation
DeepLab-v3-plus-cityscapes copied to clipboard

About BatchNormalization

Open RainPot opened this issue 6 years ago • 8 comments

hi by running your project,I can reach high mIoU,but when the Batchnormlization is setting all SYNC in ResNet,the mIoU can just reach 70%,why is that?

RainPot avatar Apr 22 '19 11:04 RainPot

thanks for great code btw

RainPot avatar Apr 22 '19 11:04 RainPot

@Cynicsss How did you control the BN sync or not sync? I found the bn in resnet is original all sync already? What do you mean by ,but when the Batchnormlization is setting all SYNC in ResNet,the mIoU can just reach 70%

sonack avatar May 06 '19 14:05 sonack

@Cynicsss How did you control the BN sync or not sync? I found the bn in resnet is original all sync already? What do you mean by ,but when the Batchnormlization is setting all SYNC in ResNet,the mIoU can just reach 70%

https://github.com/CoinCheung/DeepLab-v3-plus-cityscapes/blob/e31cc7567f87c44e7ef449eec738e8bb18c3605a/models/resnet.py#L51

RainPot avatar May 06 '19 14:05 RainPot

@Cynicsss How did you control the BN sync or not sync? I found the bn in resnet is original all sync already? What do you mean by ,but when the Batchnormlization is setting all SYNC in ResNet,the mIoU can just reach 70%

https://github.com/CoinCheung/DeepLab-v3-plus-cityscapes/blob/e31cc7567f87c44e7ef449eec738e8bb18c3605a/models/resnet.py#L51

Do you know why the author need to use the original nn.BatchNorm2drather than synced bn here ?

sonack avatar May 07 '19 10:05 sonack

@Cynicsss Hi, how long did it take you to reach 70% mIoU? I tried the code, but it takes one night just training about 12000 iterations.

codermckee avatar May 18 '19 13:05 codermckee

@Cynicsss I use 3 *1080ti to train on CityScapes without any change, but just reaching 70.23% mIoU. Is there something I should change in order to reach higher mIoU? BTW, it costed me about 2.5 days to train 41000 iterations..so sad.

codermckee avatar May 22 '19 03:05 codermckee

@Cynicsss I use 3 *1080ti to train on CityScapes without any change, but just reaching 70.23% mIoU. Is there something I should change in order to reach higher mIoU? BTW, it costed me about 2.5 days to train 41000 iterations..so sad.

It takes me 4 hours to train 15000 iterations with 2 RTX2080 and finally I got 78.2 mIoU.

LetsGoFir avatar Jan 12 '20 08:01 LetsGoFir

@LetsGoFir can you please confirm if this repository is reproducible for cityscapes? I'm also using 2RTX 2080 GPUs and facing issues getting 75%+ mIoU on CS. Also any idea if there are any differences between this implementation and the official implementation?

prachigarg23 avatar Feb 13 '22 05:02 prachigarg23