sd-wav2lip-uhq icon indicating copy to clipboard operation
sd-wav2lip-uhq copied to clipboard

stuck at length of mel chunks 0% every time for too long.

Open jedisun76cn opened this issue 1 year ago • 11 comments

Using cuda for inference. Reading video frames... Number of frames available for inference: 200 (80, 402) Length of mel chunks: 122 0%| | 0/1 [00:00<?, ?it/s] 0%| | 0/8 [00:00<?, ?it/s]

7af57d026cc728a173cabfc6d7924c4

input video is 720* 1280,8 seconds,input audio file : wav file is 5 seconds. i do not know why it is so long to be stuck at mel chunks? 1800 seconds passed without any response. how can we speedup the proc? it is crazy slow! i use laptop with GPU nividia 4070 8GB vRam.

jedisun76cn avatar Oct 13 '23 04:10 jedisun76cn

Try changing the resize factor to a larger number. If that doesn't help try changing to a different Stable Diffusion checkpoint.

sjc57 avatar Oct 14 '23 15:10 sjc57

Hi, Yes, you can try resize factor but your gpu seems good enough for processing 720x1280 Try to usé -medvram when launching stable-diffusion-webui Let me know Regards

numz avatar Oct 16 '23 23:10 numz

how can i use " -medvram" ? modified the code of "webui-user.bat"?

jedisun76cn avatar Oct 16 '23 23:10 jedisun76cn

Yes, In command arg

numz avatar Oct 17 '23 00:10 numz

i try to use “set COMMANDLINE_ARGS= --medvram” ,but it does not work, and still stuck for long!

jedisun76cn avatar Oct 17 '23 00:10 jedisun76cn

Just for check, try to use resize factor x2 and Let me know the result please

numz avatar Oct 17 '23 02:10 numz

yes, last time i had set resize factor x2 and its speed can be acceptable! but the resolution of the output video file has also been halved. So is there a way to restore the resolution of the output video?

jedisun76cn avatar Oct 17 '23 18:10 jedisun76cn

You can upscale with this method : https://www.youtube.com/watch?v=3z4MKUqFEUk

But after doing It in resize factor x2 try x1 in same session

numz avatar Oct 17 '23 19:10 numz

sorry , I don't understand what you meant("But after doing It in resize factor x2 try x1 in same session"). i saw the youtube video ( https://www.youtube.com/watch?v=3z4MKUqFEUk) and i found it could be used to upscale the img not video that i output. how can i do with it? Excuse me that i am not familiar to operate with sd-ui.

jedisun76cn avatar Oct 17 '23 20:10 jedisun76cn

Sorry, i just want you make test with resize factor x2 and just after resize factor x1 to see if it still stuck.

True, but you can extract img from the final video, or you can active debug and found images in debug folder those with dst_xxxxx.png and use it in batch mode

numz avatar Oct 17 '23 22:10 numz

The same issue. and on the webUI, each time there is an error in the video processing area. But when I change to torch+cpu, it works.

x0arthur avatar Dec 14 '23 10:12 x0arthur