HieraSeg icon indicating copy to clipboard operation
HieraSeg copied to clipboard

Reproductible results

Open simonwebertum opened this issue 1 year ago • 2 comments

Hi, very impressed by your work! I don't find exactly the same IoU when I run your configs files for training (for CityScapes, around 80% versus 81%; for LIP, around 55% versus 58%). I was wondering whether I missed something (like for example running x times and consider only the best run)? Thanks a lot!

simonwebertum avatar Jun 29 '23 16:06 simonwebertum

Can you provide the training log and system config for further analysis?

lingorX avatar Oct 04 '23 10:10 lingorX

Thanks for your reply!! I followed your config file https://github.com/lingorX/HieraSeg/blob/main/Pytorch/configs/deeplabv3plus/deeplabv3plus_r101-d8_512x1024_80k_cityscapes_hiera_triplet.py, with batch size of 8, and I enabled loss_hiera_focal. The training was done on Cityscapes Fine annotations as mentioned in your paper. Did you add coarse annotations for the training? It seems that the value of DeepLabV3+ you mention in your table is linked to Fine + Coarse annotations training https://www.cityscapes-dataset.com/benchmarks/#pixel-level-results

simonwebertum avatar Nov 02 '23 07:11 simonwebertum