TabbyML
Tabby trying to access an outdated ROCm version.
Im using the most recent version of tabby rocm docker image. With a rx 5700. I am using:
HSA_OVERRIDE_GFX_VERSION: 10.1.0. This allows it to work with ollama.
I then symlinked with ln -s /opt/rocm/lib/rocblas/library/TensileLibrary_lazy_gfx{1030,1010}.dat which allows it to work with ollama.
When trying to compose up, I get the error:
tabby-rocm-1 | tabby-rocm-1 | rocBLAS error: Cannot read /opt/rocm-5.7.1/lib/rocblas/library/TensileLibrary.dat: Illegal seek for GPU arch : gfx1010 tabby-rocm-1 | List of available TensileLibrary Files : tabby-rocm-1 | "/opt/rocm-5.7.1/lib/rocblas/library/TensileLibrary_lazy_gfx1101.dat" tabby-rocm-1 | "/opt/rocm-5.7.1/lib/rocblas/library/TensileLibrary_lazy_gfx941.dat" tabby-rocm-1 | "/opt/rocm-5.7.1/lib/rocblas/library/TensileLibrary_lazy_gfx906.dat" tabby-rocm-1 | "/opt/rocm-5.7.1/lib/rocblas/library/TensileLibrary_lazy_gfx1102.dat" tabby-rocm-1 | "/opt/rocm-5.7.1/lib/rocblas/library/TensileLibrary_lazy_gfx908.dat" tabby-rocm-1 | "/opt/rocm-5.7.1/lib/rocblas/library/TensileLibrary_lazy_gfx1100.dat" tabby-rocm-1 | "/opt/rocm-5.7.1/lib/rocblas/library/TensileLibrary_lazy_gfx940.dat" tabby-rocm-1 | "/opt/rocm-5.7.1/lib/rocblas/library/TensileLibrary_lazy_gfx803.dat" tabby-rocm-1 | "/opt/rocm-5.7.1/lib/rocblas/library/TensileLibrary_lazy_gfx900.dat" tabby-rocm-1 | "/opt/rocm-5.7.1/lib/rocblas/library/TensileLibrary_lazy_gfx942.dat" tabby-rocm-1 | "/opt/rocm-5.7.1/lib/rocblas/library/TensileLibrary_lazy_gfx90a.dat" tabby-rocm-1 | "/opt/rocm-5.7.1/lib/rocblas/library/TensileLibrary_lazy_gfx1030.dat" tabby-rocm-1 exited with code 139
The problem is that /opt/rocm-5.7.1 is not installed. The ls of /opt/ is:
amdgpu containerd rocm rocm-6.1.3 stacks
Im guessing it should be using rocm-6.1.3?
This might be a stupid error on my part so any help is appreciated.
