How to output one picture in parallel on multi GPU?

Open Rardluca2025 opened this issue 1 year ago • 3 comments

Your question

I tried looking in several discussions about running graphics on multi GPU, but couldn't figure out how to do this in comfyUI. For example, is it possible to use some pytorch commands or some nodes in comfyUI? I have no idea about this and need some help. Orz.

Logs

No response

Other

No response

Aug 15 '24 08:08 Rardluca2025

Would using multiple A100sxm4s speed up the creation of images? Is it worth trying?

Aug 15 '24 08:08 Rardluca2025

Currently, the most practical method is to use multiple ComfyUI servers through systems like NetDist or SwarmUI.

https://github.com/mcmonkeyprojects/SwarmUI https://github.com/city96/ComfyUI_NetDist

Aug 15 '24 11:08 ltdrdata

comfyui doesn't have parallel inference at the moment. you can genereate multiple image at once, but it is just batch job.

refer. https://github.com/xdit-project/xDiT https://github.com/DefTruth/Awesome-SD-Inference

Aug 15 '24 12:08 bedovyy