stable-diffusion-webui icon indicating copy to clipboard operation
stable-diffusion-webui copied to clipboard

(AMD) GPU not being utilized

Open 1ewig opened this issue 2 years ago • 4 comments

Is there an existing issue for this?

  • [X] I have searched the existing issues and checked the recent builds/commits

What happened?

Stable diffusion is not utilizing GPU upon generating an image

Steps to reproduce the problem

  1. Go to ....
  2. Press ....
  3. ...

What should have happened?

it should be using GPU when I generate an image

Commit where the problem happens

it happens while generating the image

What platforms do you use to access UI ?

Windows

What browsers do you use to access the UI ?

Google Chrome

Command Line Arguments

No response

Additional information, context and logs

to launch the stable diffusion I have to edit webui-user.bat to [ set COMMANDLINE_ARGS=--skip-torch-cuda-test ] but it wont utilize GPU generate an image to generate an image I have add [ --precision full --no-half --skip-torch-cuda-test ] to COMMANDLINE_ARGS but it'll be utilizing CPU only

GPU: amd radeon R9 370

1ewig avatar Jan 26 '23 15:01 1ewig

Pytorch only support Nvidia GPUs and experimentally apple m1 devices. It does also have support for a couple AMD cards on Linux utilizing ROCm, but support for that is super limited.

HOWEVER: if you're on windows, you might be able to install Microsoft's DirectML fork of pytorch with this. But it would also require code changes to make that work properly.

So, you probably will not be able to utilize your GPU with this application, at least not at this time.

joeyballentine avatar Jan 26 '23 17:01 joeyballentine

AMD R9 370 is far too old. Forget about running any kind of GPU AI acceleration on it in either Windows or Linux.

MrLavender avatar Jan 27 '23 00:01 MrLavender

@joeyballentine Any idea which GPUs are really supported then? https://github.com/ROCm/ROCm.github.io/blob/master/hardware.md shows my GPU RX560 4GB (tho I have the version with less shaders that they later sold under the same name... but even the RX460 is there so yeah...).

From Pytorch I find that: https://pytorch.org/blog/pytorch-for-amd-rocm-platform-now-available-as-python-package/ which links to a different repo https://github.com/RadeonOpenCompute/ROCm#supported-gpus which in turn links to https://docs.amd.com/ and there I can find https://docs.amd.com/bundle/Hardware_and_Software_Reference_Guide/page/Hardware_and_Software_Support.html which lists Polaris 11 as supported.

schrmh avatar Mar 20 '23 19:03 schrmh

Sorry, I don't know. I'm not an AMD user

joeyballentine avatar Mar 20 '23 19:03 joeyballentine