Practical-RIFE icon indicating copy to clipboard operation
Practical-RIFE copied to clipboard

Add anime models

Open bropines opened this issue 3 years ago • 5 comments

Is there any way to add interpolation for animation? The current version of course knows how to make animation smoother, but with a bunch of artifacts. Yes, version 4 has become better compared to the past, but it's still better to make a separate model for animation, as they did for example in real-esrgan

bropines avatar Feb 07 '22 13:02 bropines

Your suggestion is sound, I can give it a try.

hzwer avatar Feb 11 '22 10:02 hzwer

Maybe this will help in some way https://github.com/lisiyao21/AnimeInterp

bropines avatar Feb 13 '22 21:02 bropines

yes we want a model that is specially trained for anime to create the best output for anime

mikebilly avatar Feb 15 '22 04:02 mikebilly

In fact, the v4.0 version already contains the data of anime10K. I recently tried developing the "anime" and "real world" versions separately, but found no improvement.

hzwer avatar Feb 17 '22 13:02 hzwer

Let's just say that even the 4th version with 2d animation is extremely tight. 2.3 is a little better, but still the algorithm stupidly lubricates the animation.

bropines avatar Feb 18 '22 16:02 bropines

v4.4 model is tuned for anime. We will further optimize it.

hzwer avatar Aug 24 '22 07:08 hzwer

v4.4 model is tuned for anime. We will further optimize it.

@hzwer Thanks for your devotion to animation, I'd love to see more development regarding animation content!

mikebilly avatar Aug 24 '22 12:08 mikebilly