da-faster-rcnn-PyTorch icon indicating copy to clipboard operation
da-faster-rcnn-PyTorch copied to clipboard

cannot reprodce the results

Open Fly-dream12 opened this issue 5 years ago • 5 comments
trafficstars

I have downloaded the dataset as you uploaded and trained the baseline model and tranfer model, however, the model with domain adaption only got AP of 0.2901 while the baseline model can obtain AP of 0.4622, which is quite different from the results in this repo (Our model could arrive mAP=30.71% in target domain which is high than baseline mAP=24.26%). So what may be the reasons?

Fly-dream12 avatar Nov 06 '20 12:11 Fly-dream12

This should be reasonable, the baseline mAP = 24.26% may the source model test on the target domain.

kinredon avatar Nov 09 '20 16:11 kinredon

What is the source model, is it mean the model trained on cityscape train set?

Fly-dream12 avatar Nov 11 '20 02:11 Fly-dream12

Does it mean run the trainval_net.py and change the line 206 to s_imdb_name to train and test on the target domain?

Fly-dream12 avatar Nov 11 '20 02:11 Fly-dream12

The source model, as you said, means the model trained on the cityscape train set, and test on foggy cityscape test set.

kinredon avatar Nov 11 '20 02:11 kinredon

You should run da_trainval_net.py. cityscape with true label is source domain and cityscape-foggy with fake label is target-domain. The final model need to be test on cityscape-foggy.

tiancity-NJU avatar Apr 29 '21 03:04 tiancity-NJU