disco-diffusion icon indicating copy to clipboard operation
disco-diffusion copied to clipboard

is it possible to use multi GPUs to speed up the inference?

Open youchangxin opened this issue 3 years ago • 7 comments
trafficstars

youchangxin avatar Jul 07 '22 14:07 youchangxin

Same question, request reply

MoYuFly avatar Jul 14 '22 02:07 MoYuFly

Currently, Disco Diffusion doesn't support this. In theory there are ways to do this.. but it hasn't been implemented. Its history of being primarily used via Google Colab (and by relatively few users running locally, often with a single consumer Nvidia GPU) made implementation of it low priority.

aletts avatar Jul 14 '22 04:07 aletts

“Allow 3D animation to run on GPU's other than GPU0”,Can I use multiple GPUs, or can I specify other GPUs?

MoYuFly avatar Jul 14 '22 08:07 MoYuFly

It's easy to make it run on a different GPU, an it's something that I do sometimes. You can search for the "cuda:0" string in disco.py and change it to your desired GPU index. Then you can e.g. run several instances of Disco Diffusion on the same system to use all the system's GPUs in parallel (working on separate jobs).

aletts avatar Jul 14 '22 15:07 aletts

It's inconvenient to access foreign Internet. I hope to realize this function as soon as possible. Thank you very much!

MoYuFly avatar Jul 15 '22 01:07 MoYuFly

It's easy to make it run on a different GPU, an it's something that I do sometimes. You can search for the "cuda:0" string in disco.py and change it to your desired GPU index. Then you can e.g. run several instances of Disco Diffusion on the same system to use all the system's GPUs in parallel (working on separate jobs).

Thank you for your suggestion, but it may not fit my job well. I am struggling with multiprocess to speed up the diffusion step.

youchangxin avatar Jul 15 '22 01:07 youchangxin

I hope to send your multi process tutorial based on this project. Thank you very much!

MoYuFly avatar Jul 15 '22 01:07 MoYuFly