pytorch-i3d icon indicating copy to clipboard operation
pytorch-i3d copied to clipboard

Testing results of I3D model

Open TianyuLee opened this issue 6 years ago • 3 comments

Dear author: Have you tested the pytorch model in Kinetics or Charades dataset and if the results are close to the official tensorflow version? Best regards!

TianyuLee avatar Sep 27 '19 09:09 TianyuLee

Hi @piergiaj

Thanks for sharing your code! I have also a similar question on pre-trained I3D classification results on Charades dataset.

I tried to test predictions by adding a prediction layer (Sigmoid) after logits (averaged) on Charades dataset. The rgb_charades.pt model checkpoint seems to give decent (correct) predictions. However, the flow_charades.pt model always gives approximately the same (some random) value.

Could you please confirm if the uploaded model checkpoint flow_charades.pt is the correct one and has the expected performance?

Please let me know if you need more info or if I am missing anything!

vnigade avatar Sep 30 '19 12:09 vnigade

I also think that a wrong checkpoint is uploaded as flow_charades.pt. If anyone is still looking, feel free to use the following checkpoint (finetuned for 30k iterations and have ~14 mAP val) for the flow model. flow_temp_030000.pt

kkahatapitiya avatar Sep 17 '20 08:09 kkahatapitiya

Hello, Does someone has benchmarked this implementation? I could not find results anywhere and I don't know what performance I could expect from it.

Jefidev avatar Nov 04 '20 08:11 Jefidev