ECCV2022-RIFE icon indicating copy to clipboard operation
ECCV2022-RIFE copied to clipboard

纯色背景或天空位置的马赛克问题

Open NEFUJoeyChen opened this issue 3 years ago • 5 comments

请问一下作者,有出现过在天空位置出现马赛克的现象么,该如何解决?是否是warp的问题(已训练70Epoch) image

NEFUJoeyChen avatar Oct 25 '21 01:10 NEFUJoeyChen

We also observed the same issue. I think this happens when there is big lighting change between the previous and next frames. Can you also upload the two input images which are being used for the image interpolation.

rsjjdesj avatar Oct 27 '21 02:10 rsjjdesj

@rsjjdesj Thanks for your work. I saved the model for each epoch. After testing, I find that the issue does not appear in every model. Could it be caused by the loss function or optimizer?This problem may also appear in consecutive frames when there is no big illumination change. In addition, the floor tiles or grids in the picture are often distorted. Do you have a good way to optimize, thank you.

NEFUJoeyChen avatar Oct 27 '21 03:10 NEFUJoeyChen

368 369 370

NEFUJoeyChen avatar Oct 27 '21 03:10 NEFUJoeyChen

建议改用 lpips 替代 l1 loss 训练,看看会不会好一些

hzwer avatar Nov 10 '21 04:11 hzwer

可以试试最新的pytorch1.9

JasonSheng-atp avatar Nov 17 '21 06:11 JasonSheng-atp