stable-diffusion-webui
stable-diffusion-webui copied to clipboard
(AMD) GPU not being utilized
Is there an existing issue for this?
- [X] I have searched the existing issues and checked the recent builds/commits
What happened?
Stable diffusion is not utilizing GPU upon generating an image
Steps to reproduce the problem
- Go to ....
- Press ....
- ...
What should have happened?
it should be using GPU when I generate an image
Commit where the problem happens
it happens while generating the image
What platforms do you use to access UI ?
Windows
What browsers do you use to access the UI ?
Google Chrome
Command Line Arguments
No response
Additional information, context and logs
to launch the stable diffusion I have to edit webui-user.bat to [ set COMMANDLINE_ARGS=--skip-torch-cuda-test ] but it wont utilize GPU generate an image to generate an image I have add [ --precision full --no-half --skip-torch-cuda-test ] to COMMANDLINE_ARGS but it'll be utilizing CPU only
GPU: amd radeon R9 370
Pytorch only support Nvidia GPUs and experimentally apple m1 devices. It does also have support for a couple AMD cards on Linux utilizing ROCm, but support for that is super limited.
HOWEVER: if you're on windows, you might be able to install Microsoft's DirectML fork of pytorch with this. But it would also require code changes to make that work properly.
So, you probably will not be able to utilize your GPU with this application, at least not at this time.
AMD R9 370 is far too old. Forget about running any kind of GPU AI acceleration on it in either Windows or Linux.
@joeyballentine Any idea which GPUs are really supported then? https://github.com/ROCm/ROCm.github.io/blob/master/hardware.md shows my GPU RX560 4GB (tho I have the version with less shaders that they later sold under the same name... but even the RX460 is there so yeah...).
From Pytorch I find that: https://pytorch.org/blog/pytorch-for-amd-rocm-platform-now-available-as-python-package/ which links to a different repo https://github.com/RadeonOpenCompute/ROCm#supported-gpus which in turn links to https://docs.amd.com/ and there I can find https://docs.amd.com/bundle/Hardware_and_Software_Reference_Guide/page/Hardware_and_Software_Support.html which lists Polaris 11 as supported.
Sorry, I don't know. I'm not an AMD user