Roger Roger

> `time=2024-10-02T18:34:53.919+05:30 level=INFO source=common.go:49 msg="Dynamic LLM libraries" runners="[cpu cpu_avx cpu_avx2]"` I think it's not using your GPU. I noticed it when I loaded a bigger model (maybe try llama3.1?) and...

If you want to try as well you can apply this patch and compile ollama with `ROCM_PATH=/usr CLBlast_DIR=/usr/lib64/cmake/CLBlast AMDGPU_TARGETS="gfx1100" go generate './...'` (replace the gpu target with your version). ```diff...

I don't know if it's progress but I'm getting a different error now. Given that everything seems to work with a different librocblas.so I've decided to hack a bit on...

With the new Go server building the project was much smoother than before. It compiled correctly and tries to use my GPU but sadly fails. When trying to run gemma2:27b...

I've reported the underlying rocblas issue to the Gentoo bug-tracker (https://bugs.gentoo.org/944820). With the patch everything works on #7499 so as far as Ollama is concerned this issue can be closed...

> It might be something related to updating the UI in the background... which is a normal and supported thing to do so I don't know how it could be...