jan epic: support AMD (vulkan, rocm, etc)

epic: support AMD (vulkan, rocm, etc)

Open tikikun opened this issue 1 year ago • 10 comments

Problem There is no build for AMD now on windows GPU

Success Criteria Good performance for AMD GPU user on windows

Dec 08 '23 08:12 tikikun

https://rocm.docs.amd.com/projects/install-on-windows/en/latest/reference/system-requirements.html

Dec 26 '23 05:12 tikikun

list of supported amd gpus

Dec 26 '23 05:12 tikikun

will be great to have linux support too, as rocm works in Linux

Jan 11 '24 09:01 jalberto

Increasingly highly requested by users

Jan 11 '24 12:01 freelerobot

it seems that there is no ROCm installation for GPU AMD Radeon RX6600M :-( ; so I am not able to run jan.ai on GPU :-(

Jan 13 '24 11:01 Christianb233

@tikikun you're tackling this issue already? How are we approaching it? Wanna do a quick share during standup

Jan 16 '24 13:01 freelerobot

hi @0xSage we have built the amd image already but have no gpu to test

Jan 16 '24 14:01 tikikun

Happy to volunteer if testers are needed. I can test with RDNA3 & 2.

Jan 31 '24 06:01 Soddentrough

@hiento09 to take this on during @hiro-v leave

Feb 16 '24 03:02 freelerobot

I am happy to test in a RX 7600

Feb 16 '24 08:02 jalberto

Once this is merged to dev: https://github.com/janhq/jan/pull/2056 We will let you know the build number so that you can help. Thanks @jalberto

We will likely start to experiment with rocm but it's a nice to have

Feb 20 '24 01:02 hiro-v

Experimental feature: 0.4.7

Feb 22 '24 03:02 louis-jan

Feb 27 '24 03:02 Van-QA