Cannot reproduce the same mAP_L result on the Youtube-VIS 2022 validation set

[shulou1996]

Hello! I trained IDOL using default swinL config yaml file, which only changes dataset from 19 to 21 and evaluate on Youtube-VIS 2022 validation set. I got nearly the same mAP_S but different mAP_L around 44, which is much lower than your mAP_L result 48.4 in your 1st solution working paper. Is there any problem? Thank you very much.

[lirui-9527]

Hello brother! When I inferring the IDOL , I didn't get the evaluation. How did you get the evaluation value such as AP, can you share it? thank you very much!

[jaideep19]

hey how did you train 2021 dataset as we cannot find annotations file for 2021 dataset in official link. Can you provide those annotation json files

[15733171319]

Hello brother! When I inferring the IDOL , I didn't get the evaluation. How did you get the evaluation value such as AP, can you share it? thank you very much! Hello, classmates, has your problem been solved ? I also encountered the same problem, want to ask the following you

[DUT-CSJ]

Hello! I trained IDOL using default swinL config yaml file, which only changes dataset from 19 to 21 and evaluate on Youtube-VIS 2022 validation set. I got nearly the same mAP_S but different mAP_L around 44, which is much lower than your mAP_L result 48.4 in your 1st solution working paper. Is there any problem? Thank you very much.

Hello, I almost reproduce the result while having some questions about multi-scale testing. Have you tried training again subsequently?