BurnyLlama
BurnyLlama
Yeah, I upgraded my toolchain and the issues showed up. Should probably have said that before!
I have the same issue when using dpms to turn off my monitor screen after a while...
Right! I never tried to build `v0.14.0` myself. I will see if I have time to try that later. If so, I will come back with the results.
I realized I didn't compile for ROCm before, only for Vulkan. When I try to compile with `--features=rocm`: ``` error: failed to run custom build command for `llama-cpp-server v0.14.0 (/tmp/tabby-src/crates/llama-cpp-server)`...
A bit of a hacky solution that at least gets Tabby to compile: ```sh sudo mkdir /opt/rocm sudo ln -sv /usr/lib/llvm/18 /opt/rocm/llvm ``` However, besides seeming slower to generate responses...