roop icon indicating copy to clipboard operation
roop copied to clipboard
verified publisher icon s0md3v

Draft: Replace a selective face throughout the video

Open maximq opened this issue 2 years ago • 4 comments

Added the function of searching for the selected person in the preview, changes in the speed of video processing are not noticeable the models used are w600k_r50.one, det_10g.onnx (installed together with the insightface libs)

https://github.com/s0md3v/roop/assets/43162306/11cdd1fa-fefb-4f3b-bf99-7219af1368e5

maximq avatar Jun 09 '23 12:06 maximq

it seems that there is no "det_10g.onnx" model in the test environment

maximq avatar Jun 09 '23 12:06 maximq

Unsure of the cause but 30FPS input mp4 video becomes 25FPS output mp4 video.

Launch commands: python run.py --gpu-vendor nvidia --keep-frames --keep-fps python run.py --gpu-vendor nvidia

Result:

25FPS video in reduced playback speed, like slow motion.

Anaconda3 Command Prompt shows no errors.

JPW0080 avatar Jun 09 '23 13:06 JPW0080

We cannot merge the PR in the current state, so I marked this as a draft - it will double the current codebase and we are not able to maintain that. That being said, I think you need to replace some implementations with third party libs.

Simlar to https://github.com/s0md3v/roop/pull/349

henryruhs avatar Jun 09 '23 14:06 henryruhs

It appears that anything after commit 957c5ec6ce01812d7e8a48ad4585952b59fa99bc from the next branch introduces the aforementioned 25FPS issue.

Just tried commit 2beb6c23e64f79f1237cb584f4a28a1d5ae69e17 from the next branch and the output framerate issue has been resolved.

JPW0080 avatar Jun 09 '23 17:06 JPW0080

The PR does not follow our CONTRIBUTING guidelines.

henryruhs avatar Jun 13 '23 17:06 henryruhs