bark icon indicating copy to clipboard operation
bark copied to clipboard

Can it use integrated GPU?

Open kun-create opened this issue 1 year ago • 8 comments

I've AMD integrated GPU 4GB, but it's still showing "No GPU being used. Careful, inference might be extremely slow!"

Does this program not use integrated GPU?

kun-create avatar Apr 25 '23 09:04 kun-create

It's looking for Nvidia and CUDA installed. I have multiple GPU's with 6GB but this is not enough to load the model :(

Advitica avatar Apr 25 '23 12:04 Advitica

have you tried using small versions of model (specified in preload_models?) not sure about amd support, right now only cuda and cpu are supported

gkucsko avatar Apr 25 '23 14:04 gkucsko

T Neverwinter 18 minutes ago (edited) update to cuda 11.8, no gpu found? torch 2.0.0 no ++117/118 solved based on this: https://github.com/AUTOMATIC1111/stable-diffusion-webui/discussions/8691 command: pip3 install clean-fid numba numpy torch==2.0.0+cu118 torchvision --force-reinstall --extra-index-url https://download.pytorch.org/whl/cu118

I didnt fix the gpu as my generation times are still astronomical, however it seems to install the appropriate versions?

Tom-Neverwinter avatar Apr 25 '23 20:04 Tom-Neverwinter

are the issues here related? is everyone on AMD or is this mixed with cuda issues?

gkucsko avatar Apr 26 '23 01:04 gkucsko

AMD CPU with Nvidia GPU. seems to be an AMD CPU issue. https://pastebin.com/wRVCpcep

I dont see more correlation than that at this time sadly

Tom-Neverwinter avatar Apr 26 '23 02:04 Tom-Neverwinter

So it will not work until I use the Nvidia Graphics card!

kun-create avatar Apr 26 '23 09:04 kun-create

it should work on cpu, albeit slower of course..

gkucsko avatar Apr 26 '23 13:04 gkucsko

how to run on cpu? it doesn't seem to have a option to pass device on init of the model!

limapedro avatar Apr 26 '23 15:04 limapedro

preload_models has arguments to disable gpu, but either way it should happen automatically if you don't have a supported gpu

gkucsko avatar Apr 26 '23 22:04 gkucsko

Closing for now since I can’t reproduce the issue

gkucsko avatar Apr 27 '23 13:04 gkucsko