transformerlab-app icon indicating copy to clipboard operation
transformerlab-app copied to clipboard
verified publisher icon transformerlab

Add support for AMD ROCM (GPU)

Open sandeshwar opened this issue 10 months ago • 8 comments

Hi,

It seems that currently this repo only supports CUDA and MLX. Is there a way we can use it with AMD GPUs? If not, is there a plan to do so?

Thanks, Sandy

sandeshwar avatar Feb 07 '25 15:02 sandeshwar

Adding support for AMD GPUs is definitely something we are planning, but right now is on hold because we don't have hardware to test. We've had a number of people ask about this on discord, so maybe at some point we can get some help!

dadmobile avatar Feb 08 '25 23:02 dadmobile

Thanks.

I would be happy to lend my system if that helps, as a contribution from my side. Below is the spec.

  • AMD Radeon 7900 xtx
  • AMD Ryzen 9 7950x
  • 192 GB RAM
  • Ubuntu 24.04

sandeshwar avatar Feb 15 '25 16:02 sandeshwar

any news? Or anyone has a good tutorial for do that?

charmandercha avatar Apr 01 '25 23:04 charmandercha

Just waiting on some hardware right now and then we are planning to start working on this in earnest!

dadmobile avatar Apr 02 '25 15:04 dadmobile

We're tracking things here: #426

We have things working with Linux but have hit some roadblocks with WSL if anyone has experience on navigating those issues mentioned at the end with respect to WSL, please let us know!

deep1401 avatar May 16 '25 15:05 deep1401

Duplicate of #426

deep1401 avatar May 16 '25 15:05 deep1401

Adding an update here too that we were able to solve the WSL issues. We're waiting on getting things merged after proper testing and then we'll ship out support

deep1401 avatar May 20 '25 20:05 deep1401

Hello everyone! We now support AMD GPUs - install instructions here :) Please provide some feedback and we'd be happy to keep improving on this!

deep1401 avatar May 23 '25 20:05 deep1401