mmselfsup icon indicating copy to clipboard operation
mmselfsup copied to clipboard

Introducing mmselfsup.core in mmdet leads to unexpected results.

Open liming-ai opened this issue 3 years ago • 4 comments
trafficstars

Hi @fangyixiao18 @Jiahao000 @YuanLiuuuuuu @scnuhealthy, happy mid-Autumn Festival~

Thanks for reporting the unexpected results and we appreciate it a lot.

Checklist

  1. I have searched related issues but cannot get the expected help.
  2. The unexpected results still exist in the latest version.

Describe the Issue I tried to combine mmselfsup and mmdet to do something, however, when I added:

custom_imports = dict(imports=['mmselfsup.core'])

I found that DETR's training fails to converge, I also added this line into other methods like fcos/retinanet/mask-rcnn. In the case of fixed random seeds, their loss values and training results have huge changes. I have no clues about this and what's causing the huge discrepancy, hoping to get some help from the community.

Reproduction

  1. What command, code, or script did you run?

Add this line into any original mmdet config, you can find the loss and result changed a lot, even with fixed random seed.

custom_imports = dict(imports=['mmselfsup.core'])
  1. Did you make any modifications on the code? Did you understand what you have modified? Yes. Yes.

Bug fix If you have already identified the reason, you can provide the information here. If you are willing to create a PR to fix it, please also leave a comment here and that would be much appreciated!

liming-ai avatar Sep 10 '22 00:09 liming-ai

Which branch do you use?

YuanLiuuuuuu avatar Sep 14 '22 02:09 YuanLiuuuuuu

Hi, @YuanLiuuuuuu

Please check this issue for more information.

liming-ai avatar Sep 14 '22 07:09 liming-ai

Could you please provide all these config files, which fail to converge?

YuanLiuuuuuu avatar Sep 15 '22 08:09 YuanLiuuuuuu

Could you please provide all these config files, which fail to converge?

@YuanLiuuuuuu DETR and Deformable DETR fail to converge, other methods (fcos/mask-rcnn/retinanet) have lower performance under same machine and seed.

Just use the default mmdet configs but add custom_imports = dict(imports=['mmselfsup.core']), all models are based on torchvision ResNet-50

liming-ai avatar Sep 16 '22 02:09 liming-ai