Practical-RIFE icon indicating copy to clipboard operation
Practical-RIFE copied to clipboard
verified publisher icon hzwer

Inquiry about issues with 60fps video interpolation in long videos, duration and audio sincronization

Open elcocobongo opened this issue 11 months ago • 3 comments

Dear hzwer,

First of all, I want to congratulate you on the amazing work you've done with the RIFE repository. The quality of the video interpolation is impressive and has been incredibly useful for several of my projects.

However, I've encountered some issues when working with long videos. While RIFE successfully converts videos to 60fps, I've noticed that the duration of the video doesn't remain the same, and even when I try to fix this using setpts in FFmpeg, the audio is not properly synchronized. I'm currently using Model 4.25, and I was wondering if you could recommend a different model that might handle these cases better.

Additionally, I wanted to ask if there's a way to use multiple GPUs when running RIFE. Right now, I can only use one GPU, and I'd love to take advantage of multiple GPUs to improve performance, especially when working with long videos.

I really appreciate your attention and any suggestions you might have. Thanks again for your incredible work!

Best regards,

elcocobongo avatar Jan 14 '25 06:01 elcocobongo

  1. You can first convert it to png, and then compose it into a video. I don't have much experience with codecs, perhaps you would be better off using existing GUI software. This part doesn't have much to do with the model.

  2. I don't know if there is any related inference implementation. Can anyone else help?

hzwer avatar Jan 14 '25 09:01 hzwer

Actually I figured out, I was using fps= arg, so that generates me a short duration and also, audio desyncronization. I started to use multi= and problem solved.

Now, I have two GPUs, how can use both? Or haven't you guys search about it. It would so good to can use both.

elcocobongo avatar Jan 19 '25 05:01 elcocobongo

Actually I figured out, I was using fps= arg, so that generates me a short duration and also, audio desyncronization. I started to use multi= and problem solved.

Now, I have two GPUs, how can use both? Or haven't you guys search about it. It would so good to can use both.

For Multi GPU use https://github.com/HeylonNHP/RIFE-Colab or https://github.com/AaronFeng753/Waifu2x-Extension-GUI

2994dd42d75b0 avatar Feb 12 '25 18:02 2994dd42d75b0