refact icon indicating copy to clipboard operation
refact copied to clipboard

Published 20 hours ago • verified publisher icon smallcloudai

Amd gpu supports

Open MetaiR opened this issue 2 years ago • 6 comments

hi, is there any plan to support amd gpus or even any alternatives? amd gpus have excellent vram capacity and power with reasonable price

MetaiR avatar Jul 01 '23 17:07 MetaiR

Makes sense!

olegklimov avatar Jul 06 '23 04:07 olegklimov

I believe it's should be straightforward just have to install rocm hips library and using pytorch index url pointing to rocm5.x . I have a smaller fedora docker for rocm pytorch, because the official amd pytorch one is bloated AF. Almost 35GB . Mine as a base is 🫠only ~10GB.hopefully i will have time in the week coming to put together a draft PR for the Dockerfile change

takov751 avatar Dec 11 '23 09:12 takov751

Should be fairly easy with HIP

niansa avatar Dec 28 '23 18:12 niansa

We have this PR:

https://github.com/smallcloudai/refact/pull/252

that we'll test somehow (don't have any AMD GPUs), or at least we'll set up an auto docker build and someone will test it :D

olegklimov avatar Dec 31 '23 18:12 olegklimov

We have this PR:

https://github.com/smallcloudai/refact/pull/252

that we'll test somehow (don't have any AMD GPUs), or at least we'll set up an auto docker build and someone will test it :D

In the coming days i will definitely test it. 👍👍 i have both motivation and low end amdgpu hardware 🙃

takov751 avatar Dec 31 '23 18:12 takov751