guru
guru copied to clipboard
Allow ollama-0.5.7 to use NVIDIA cards
This includes 2 fixes:
- Add user
ollamato groupvideo. - Make /usr/lib/ollama/runners/cuda_v{11,12}/ollama_llama_server executable
The commit message should follow the standard of <category>/<package>: summary and have the tag "Signed-off-by". See https://wiki.gentoo.org/wiki/Project:GURU/Information_for_Contributors
Looks like this has been taken care of in newer versions.