REAL-Video-Enhancer icon indicating copy to clipboard operation
REAL-Video-Enhancer copied to clipboard

Will it be able to deduplicate Anime frames?

Open bukhalmae145 opened this issue 10 months ago • 7 comments

Will it be possible to deduplicate anime frames and interpolate it into full frames using the repository below? https://github.com/hyw-dev/AFI-ForwardDeduplicate

bukhalmae145 avatar Apr 23 '24 04:04 bukhalmae145

I could try to add something like that, as it is similar to gmfss. I will look into it, but gmfss support in RVE is shaky to begin with, as the CUPY dependency is too large to package with the app reasonably.

TNTwise avatar Apr 24 '24 03:04 TNTwise

I could try to add something like that, as it is similar to gmfss. I will look into it, but gmfss support in RVE is shaky to begin with, as the CUPY dependency is too large to package with the app reasonably.

It would be great if REAL-Video-Enhancer supports deduplication.

When the app extracts frames, it is 16 bits RGB png but it would be reasonable for the storage if its encoded into 8 bits RGB png, because RIFE generates 8 bits.

bukhalmae145 avatar Apr 24 '24 03:04 bukhalmae145

I thought it was 8 bit png.

TNTwise avatar Apr 24 '24 03:04 TNTwise

You could try rife cuda if you have an Nvidia card, if not I am planning to attempt to remove the need for frame extraction on most of the ncnn modules

TNTwise avatar Apr 24 '24 03:04 TNTwise

You could try rife cuda if you have an Nvidia card, if not I am planning to attempt to remove the need for frame extraction on most of the ncnn modules

What about using this: https://github.com/NevermindNilas/TheAnimeScripter/blob/main/src/dedup/dedup.py

bukhalmae145 avatar Apr 24 '24 03:04 bukhalmae145

That seems to just say if a frame is a duplicate, there is a lot of funny stuff when deduping frames, very hacky. I'll look into all different ways when I have the time

TNTwise avatar Apr 24 '24 03:04 TNTwise

That seems to just say if a frame is a duplicate, there is a lot of funny stuff when deduping frames, very hacky. I'll look into all different ways when I have the time

Thank you.

bukhalmae145 avatar Apr 24 '24 03:04 bukhalmae145