IFRNet icon indicating copy to clipboard operation
IFRNet copied to clipboard

Acknowledgement and a problem

Open lotress opened this issue 1 year ago • 1 comments

Thank for your work. I integrated your model into my project (with slightly changes). My program published at https://github.com/lotress/MoePhoto. Also I'm working on some improvement including this.

The problem about 3 Vimeo90K models is they didn't trained on configuration other than 2x slomo, the result is they are insensitive about the embt input. They output almost the same predictions no matter what embt is. I can only use the GoPro models now, but they have a tiny more illusion than the Vimeo90K models, maybe they are both under trained.

lotress avatar Jun 12 '23 22:06 lotress

Thanks for your interest and feedback.

The provided IFRNet, IFRNet-L and IFRNet-S trained on Vimeo-90K have the same output frame when changing embt, since the convolution weight which multiple embt is set to 0. As for the model trained on GoPro, it suffers from less training data, whose results are not as well as models trained on Vimeo-90K.

I suggest that you can build a large multi-frame training datasets and train IFRNet referring to the training scripts on GoPro dataset. I will also do this later.

Thanks.

ltkong218 avatar Jun 26 '23 08:06 ltkong218