flowframes icon indicating copy to clipboard operation
flowframes copied to clipboard

Feature request: Deduplication interpolation step

Open ArturAlekseev opened this issue 3 years ago • 5 comments

As for me "During extraction" is the only working solution for deduplication. I'v tried another one and another one deletes a lot of non dupe frames (on non cartoon sources). Once we use during extraction method we get frames without dupes. Please add step that will interpolate these dupes so we have all frames in frames folder (without the need to interpolate to x2). So we can reconstruct the video without x2 interpolation but with dupes replaced.

ArturAlekseev avatar Dec 06 '21 22:12 ArturAlekseev

Not sure how feasible this is, until now RIFE and some of the other networks were not able to create any amount of frames to fill gaps, however RIFE now supports any interpolation factor, so I can look into this.

n00mkrad avatar Dec 07 '21 09:12 n00mkrad

I thought that interpolation step had 2 substeps:

  1. interpolate gaps
  2. interpolate x2, x4... I'm wrong?

If its hard to make just interpolate gaps step then maybe make it to work like this: interpolate x2, save only even frames to hd. Its possible to make it by hand now but it will write extra non needed frames to hd (odd frames) - not good for hd.

ArturAlekseev avatar Dec 08 '21 08:12 ArturAlekseev

RIFE on its own was only able to interpolate by 2x, meaning 1 frame between 2, so 4x and 8x are recursive as far as I know, But as mentioned, the newer version of it is able to interpolate by other factors.

Katzenwerfer avatar Dec 08 '21 17:12 Katzenwerfer

The question here not in factors but to separate gaps interpolation from full video interpolation.

ArturAlekseev avatar Dec 08 '21 20:12 ArturAlekseev

If I recall correctly there was a colab notebook which was able to do something like that. Don't remember the link though...

Katzenwerfer avatar Dec 08 '21 22:12 Katzenwerfer