ComfyUI-DeepFuze icon indicating copy to clipboard operation
ComfyUI-DeepFuze copied to clipboard

I'm having a problem working with GPU in the node

Open gilushon opened this issue 1 year ago • 6 comments

Hi, this is an amazing node, so thank you for it! I did all the steps in your YouTube video to install Cuda. I'm having a problem working with GPU in the node, so it is very slow. I have I9 computer with 32 ram, and RTX 4090.

this is the log error,

Error occurred when executing DeepFuzeAdavance:

C:\ComfyUI_windows_portable\ComfyUI\output\deepfuze\enhanced_17197493769867313.mp4 could not be loaded with cv.

File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-DeepFuze\nodes.py", line 1425, in lipsyncgenerate return load_video_cv(filename,0,'Disabled',512,512,0,0,1) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-DeepFuze\nodes.py", line 543, in load_video_cv (width, height, fps, duration, total_frames, target_frame_time) = next(gen) ^^^^^^^^^ File "C:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-DeepFuze\nodes.py", line 462, in cv_frame_generator raise ValueError(f"{video} could not be loaded with cv.")

gilushon avatar Jun 30 '24 12:06 gilushon

@gilushon With 4090 it should work so fast, this error you shared it seems it's a cuDNN and CUDA installation problem. Also for some reason when you install CUDA one of the dll files in the bin folder is missing. I added information in the error section on how you can fix that and there is a CV error section as well. If none of those worked follow the YouTube video for fully uninstalling your CUDA and reinstalling it.

SamKhoze avatar Jun 30 '24 21:06 SamKhoze

Sam, Thanks for the quick reply, I did what you wrote about the fix under RERRORS, and it solved the problem.

(Missing zlibwapi.dll error: Search for NVIDIA zlibwapi.dll file, download it and copy it in C:\Program Files\NVIDIA (GPU Computing Toolkit\CUDA\v11.8\bin\zlibwapi.dll)

Now the rendering is 20 times faster. Just one more thing, (in the lip-sync node) I think the frame enhancers don't work, because you don't see any differences between them, the same goes for the enhancer, you don't see any differences between them.

gilushon avatar Jun 30 '24 22:06 gilushon

@gilushon i checked it, enhancers are working

SamKhoze avatar Jul 01 '24 16:07 SamKhoze

Wow This is the ultimate Tool !!!! very good quality, Thank you !!! yaa enhancers are working, I initially missed the DeepFuze directory inside the output directory.

gilushon avatar Jul 03 '24 22:07 gilushon

Just one suggestion, if there are already frame enhancers, maybe you could make an option to upscale using the frame enhancers where it would be possible to choose a resolution for upscaling?

gilushon avatar Jul 03 '24 23:07 gilushon

@gilushon thabk you, there are already many great upscale nodes you can upscale before passing it to lipsync if you have a powerful GPU or upscale after lipsync.

SamKhoze avatar Jul 04 '24 02:07 SamKhoze