flowframes icon indicating copy to clipboard operation
flowframes copied to clipboard

I Got Artifact Effect on Output Video

Open solodevelopment97 opened this issue 2 years ago • 13 comments

I've done what was needed in the previous thread such as changing the fix scene changes to 0.15 but still the artifact any answer to fix this ?

0001-0200-6x-RIFE-RIFE3.9-144.0023fps.zip

solodevelopment97 avatar Jun 12 '22 09:06 solodevelopment97

is it possible to get the source file?

DrPleaseRespect avatar Jun 12 '22 09:06 DrPleaseRespect

to me it looks like it's just the 3.9 model messing up. I'm not sure tho. I don't use 3.9

DrPleaseRespect avatar Jun 12 '22 09:06 DrPleaseRespect

0001-0200.zip

this the original file

solodevelopment97 avatar Jun 12 '22 09:06 solodevelopment97

I think my video has low fps and has fast movement

solodevelopment97 avatar Jun 12 '22 09:06 solodevelopment97

heyy thanks for respond, i can fix this with ai model RIFE 3.8

solodevelopment97 avatar Jun 12 '22 10:06 solodevelopment97

and changing the fix scene to 0.5

solodevelopment97 avatar Jun 12 '22 10:06 solodevelopment97

Just use Rife 2.3 General Model. Its the best model available. I honestly have no Idea what went wrong with new models and why they are included, since they produce way worse results

https://user-images.githubusercontent.com/8310378/173228465-073b42b1-299f-43fe-98c7-0d1a5055217f.mp4

neojam avatar Jun 12 '22 10:06 neojam

i try 2.3 and the result is best for me thanks for helping me

solodevelopment97 avatar Jun 12 '22 11:06 solodevelopment97

You're welcome :)

The newer RIFE models are maybe faster, but RIFE 2.3 General model produces the best results. Unfortunately not everyone knows it, since many people falsely assume that newer=better.

neojam avatar Jun 12 '22 11:06 neojam

I just tested it with rife 4.0 and it appears to be superior even to 2.3, though that requires building from scratch (which is not all that hard!), and as a bonus it's a little faster, so you might want to try that as well :)

https://user-images.githubusercontent.com/72940343/174499212-8655f6ff-7adf-4d17-9b59-91c1753945da.mp4

Super4Jet avatar Jun 19 '22 20:06 Super4Jet

Then you should test more. All models above v2.3 create worse results. For the sake of the argument here's a quick hstack of 3 videos showing v2.3 and two most recent models v4.0 and v4.1.

https://user-images.githubusercontent.com/8310378/174644902-11eecf62-e268-4266-9b78-689a47bc18ac.mp4

neojam avatar Jun 20 '22 16:06 neojam

Are you sure that the middle video comes from interpolation using the 4.0 model? At least that's what the description implies: "v2.3, v4.0, v4.1". I ask because in the middle video I can see a very noticeable flicker, while the two outer videos do not have this affliction. Apparently it is the 4.1 model that generates the flicker: https://github.com/nihui/rife-ncnn-vulkan/issues/43#issuecomment-1138195269

AIVFI avatar Jun 27 '22 19:06 AIVFI

yes, the middle is c4.0 as the description says.

P.S. hzwer said, that anime was used to train that model, so maybe that's the reason interpolation makes it look like stop-motion.

neojam avatar Jun 29 '22 16:06 neojam