flowframes
flowframes copied to clipboard
Feature request: Deduplication interpolation step
As for me "During extraction" is the only working solution for deduplication. I'v tried another one and another one deletes a lot of non dupe frames (on non cartoon sources). Once we use during extraction method we get frames without dupes. Please add step that will interpolate these dupes so we have all frames in frames folder (without the need to interpolate to x2). So we can reconstruct the video without x2 interpolation but with dupes replaced.
Not sure how feasible this is, until now RIFE and some of the other networks were not able to create any amount of frames to fill gaps, however RIFE now supports any interpolation factor, so I can look into this.
I thought that interpolation step had 2 substeps:
- interpolate gaps
- interpolate x2, x4... I'm wrong?
If its hard to make just interpolate gaps step then maybe make it to work like this: interpolate x2, save only even frames to hd. Its possible to make it by hand now but it will write extra non needed frames to hd (odd frames) - not good for hd.
RIFE on its own was only able to interpolate by 2x, meaning 1 frame between 2, so 4x and 8x are recursive as far as I know, But as mentioned, the newer version of it is able to interpolate by other factors.
The question here not in factors but to separate gaps interpolation from full video interpolation.
If I recall correctly there was a colab notebook which was able to do something like that. Don't remember the link though...