aldi
aldi copied to clipboard
Evaluation is not same with the outcome in the paper
Hi,
Thank you for your research and I really like your achievement and sharing.
I evaluated the model "cityscapes_baseline_strongaug_ema_foggy_val_model_best_591_ema2model.pth" with this command "python tools/train_net.py --config configs/cityscapes/Base-RCNN-FPN-Cityscapes_strongaug_ema.yaml --eval-only"
I got the result in the screenshot (foggy AP50 is 60.258)
I though it was trained with strong augmentation and EMA so it should be similar with the AP 50 (64.3) in the table 3(a). Is the model the result with weak augmentation not strong augmentation? could you help with this?