smallcloudai
Amd gpu supports
hi, is there any plan to support amd gpus or even any alternatives? amd gpus have excellent vram capacity and power with reasonable price
I believe it's should be straightforward just have to install rocm hips library and using pytorch index url pointing to rocm5.x . I have a smaller fedora docker for rocm pytorch, because the official amd pytorch one is bloated AF. Almost 35GB . Mine as a base is 🫠only ~10GB.hopefully i will have time in the week coming to put together a draft PR for the Dockerfile change
We have this PR:
https://github.com/smallcloudai/refact/pull/252
that we'll test somehow (don't have any AMD GPUs), or at least we'll set up an auto docker build and someone will test it :D
We have this PR:
https://github.com/smallcloudai/refact/pull/252
that we'll test somehow (don't have any AMD GPUs), or at least we'll set up an auto docker build and someone will test it :D
In the coming days i will definitely test it. 👍👍 i have both motivation and low end amdgpu hardware 🙃