I3D_Finetune icon indicating copy to clipboard operation
I3D_Finetune copied to clipboard

Reproduce results

Open giladsharir opened this issue 6 years ago • 7 comments

Hi, I'm trying to reproduce the results reported in the paper (and this repository) with the I3D model trained with only RGB on UCF-101 (split 1) . When I run test.py with the checkpoint provided in this repository (finetuned on UCF-101 RGB), I get a score of 89.4 . The authors of this repository report 94.7 . Do you have any idea why is there a discrepancy in the scores?

giladsharir avatar Aug 21 '18 07:08 giladsharir

Aha,I meet the same issue, particularly in Optical-Flow branch with only 83% acc.

Catchher avatar Aug 30 '18 07:08 Catchher

Hi @giladsharir and @Catchher , Thanks for trying our code and I am sorry for the inconvenience. I guess we have uploaded wrong checkpoints and we are figuring it out. Thanks for you patience.

vra avatar Aug 31 '18 03:08 vra

Thanks for ur reply, I'm looking forward to ur good news. @vra

Catchher avatar Sep 01 '18 09:09 Catchher

Hi, could you tell me whether you have uploaded the corrected checkpoints or not? Thank you~ @vra

tangshixiang avatar Sep 22 '18 12:09 tangshixiang

Hi, I'm trying to reproduce the results reported in the paper (and this repository) with the I3D model trained with only RGB on UCF-101 (split 1) . When I run test.py with the checkpoint provided in this repository (finetuned on UCF-101 RGB), I get a score of 89.4 . The authors of this repository report 94.7 . Do you have any idea why is there a discrepancy in the scores?

sumeetssaurav avatar Dec 25 '18 20:12 sumeetssaurav

I got 91% as the result, it is normal?

TaoXieSZ avatar Jan 11 '19 13:01 TaoXieSZ

Hi, I'm trying to reproduce the results reported in the paper (and this repository) with the I3D model trained with only RGB on UCF-101 (split 1) . When I run test.py with the checkpoint provided in this repository (finetuned on UCF-101 RGB), I get a score of 89.4 . The authors of this repository report 94.7 . Do you have any idea why is there a discrepancy in the scores?

have you settled the problem? I get the 91.5% scores using the shared model trained on the UCF101 RGB.

lanfeng4659 avatar Jun 06 '19 09:06 lanfeng4659