rocBLAS icon indicating copy to clipboard operation
rocBLAS copied to clipboard

Published 20 hours ago • verified publisher icon ROCm

gfx90c

Open hkfuertes opened this issue 11 months ago • 1 comments

Hello, Im trying to run ollama through the gpu but I get this error:

rocBLAS error: Cannot read /opt/rocm/lib/rocblas/library/TensileLibrary.dat: Illegal seek for GPU arch : gfx90c

Is my card not supported? Thank you in advance.

PS: Ryzen 7 APU (5800H) Mini PC

hkfuertes avatar Mar 07 '24 16:03 hkfuertes

Hi @hkfuertes,

Unfortunately your APU (gfx90c) is not currently supported in ROCm. You can take a look at the supported GPUs in the ROCM 6.0.2 Documentation.

Some people have had some success using the environment variable export HSA_OVERRIDE_GFX_VERSION=9.0.0 on similar devices, although running your card with this isn't officially supported.

I hope this helps, let me know if you have further questisons. Daine

daineAMD avatar Mar 07 '24 19:03 daineAMD

Hello, oooh, thank you! I tested it and ollama gives me answers... I need to test if this is faster than CPU, but is a start :)

Thank you for the help, and I understand that this usecase is more suitable for a discrete graphic card.

hkfuertes avatar Mar 07 '24 22:03 hkfuertes