aritra saha
aritra saha
Yes this is not for now but can be considered after this release.
https://github.com/Jeffser/Alpaca/pull/305
I think rocm need to be loaded separately. https://github.com/ollama/ollama/releases/download/v0.2.8/ollama-linux-amd64-rocm.tgz this contains the rocm driver. this is a real issue that need to be fixed.
> How can I install ROCm on my Silverblue machine? I tried to run "rpm-ostree install rocm" but I get a "packages not found" error. Ask https://discussion.fedoraproject.org/ for help they...
As far as i know the backend ollama use rocm instead of vulkan from front end this not too easy to implement this
Yes I don't lnow much about llama.cpp But ollama use rocm I this is really a issue that rocm is not installed on many systems
Yes if this get merged i hope it will bring vulkan to thos one also. For the time being I dont thing we can do much
> Has anyone managed to get it to work with their AMD GPU (I'm using Fedora Workstation 40)? I have a 6950XT, but it's using my CPU and RAM rn....
I find this works pretty well so it can be closed.
Yes`odt2txt` does this and i find now a days in many users use libreoffice which default to use odf.