aldi icon indicating copy to clipboard operation
aldi copied to clipboard

Evaluation is not same with the outcome in the paper

Open sshhj89 opened this issue 6 months ago • 0 comments

Hi,

Thank you for your research and I really like your achievement and sharing.

I evaluated the model "cityscapes_baseline_strongaug_ema_foggy_val_model_best_591_ema2model.pth" with this command "python tools/train_net.py --config configs/cityscapes/Base-RCNN-FPN-Cityscapes_strongaug_ema.yaml --eval-only"

I got the result in the screenshot (foggy AP50 is 60.258) Screenshot from 2024-08-21 23-56-31

I though it was trained with strong augmentation and EMA so it should be similar with the AP 50 (64.3) in the table 3(a). Is the model the result with weak augmentation not strong augmentation? could you help with this?

sshhj89 avatar Aug 22 '24 04:08 sshhj89