Free-Form-Video-Inpainting icon indicating copy to clipboard operation
Free-Form-Video-Inpainting copied to clipboard

About I3D model for VFID score.

Open kyuyeonpooh opened this issue 3 years ago • 0 comments

Hi, thanks for sharing great codes!

I have a question about the mode (training / testing) you have used for I3D networks for evaluating VFID score.

https://github.com/amjltc295/Free-Form-Video-Inpainting/blob/19bfc6fbe626385be549ea2fc6c1ba7852e48e56/src/evaluate.py#L35-L48 As shown above in I3D model initialization part for I3D feature extracting, it seems that you haven't converted the model into evaluation mode by i3d_model.eval().

When I evaluate your model without converting I3D into eval mode, I was able to reproduce the similar results in the paper. However, when I turned the model into evaluation mode (because using .eval() is common for using the model as feature extractor), I found the VFID score goes up to over 1.0.

Is there any reason why the I3D network is used as training mode? Thank you for reading! Have a nice day.

kyuyeonpooh avatar Dec 04 '20 06:12 kyuyeonpooh