audio-webui icon indicating copy to clipboard operation
audio-webui copied to clipboard

[FEATURE REQUEST] AMD acceleration support

Open sammcj opened this issue 2 years ago • 4 comments

Is your feature request related to a problem? Please describe. It would be awesome if AMD GPUs/APUs were supported.

Describe the solution you'd like I believe for other ML projects such as LocalAI etc... CLBLAS is used.

Describe alternatives you've considered Winning the lotto so I can afford an nvidia card.

Additional context Add any other context or screenshots about the feature request here.

sammcj avatar Aug 02 '23 09:08 sammcj

It's a bit complicated. windows/linux + nvidia -> regular pytorch cuda windows + amd/intel/nvidia -> pytorch-directml linux + amd -> pytorch rocml

And I'm not even sure if they are fully compatible, I'll need people to test.

gitmylo avatar Aug 02 '23 13:08 gitmylo

Ahh I see, interesting. I'm happy to test it with my setup:

  • AMD Ryzen 7600 (combined CPU/GPU)
  • Docker on Fedora 38

sammcj avatar Aug 02 '23 23:08 sammcj

I am willing to test: Windows 11 / Manjaro Linux + AMD 5900X + AMD 6900 XT GPU.

Using PyTorch ROCM under Manjaro works OK with SD and Automatic's Web UI so I hope this will be portable enough.

AdamLeyshon avatar Aug 15 '23 20:08 AdamLeyshon

Can confirm AudioLDM/AudioLDM2/AudioCraft are working well on RX 6800XT with ROCM 5.6.1 and Linux Mint. Needed to uninstall the default installed cu11 Torch libraries and reinstall rocm ones. Haven't tried RVC yet.

helikopterodaktyl avatar Dec 27 '23 11:12 helikopterodaktyl