Daniel Hiltgen
Daniel Hiltgen
This is unexpected behavior. I'm not sure what's causing it though. What version did you download? Did you download `ollama-darwin` or `Ollama-darwin.zip` Can you run `ls -lh` showing the files,...
We have multiple issues tracking Vulkan support - lets use #2033
The GTX 950 is a Compute Capability 5.2 card, which is not currently supported by our build configuration of the CUDA libs. We just merged a change to correctly detect...
0.1.19 is now out and should resolve the crash by falling back to CPU. We'll track enabling CUDA support on these older GPUs with #1865 If you're still seeing crashes...
Relevant excerpt from the log: (v0.1.18) ``` Jan 10 10:46:43 pop-os ollama[2092143]: 2024/01/10 10:46:43 gpu.go:84: CUDA Compute Capability detected: 8.6 ``` ``` Jan 10 10:46:44 pop-os ollama[2092143]: CUDA error 999...
I don't think we've made any changes in [0.1.21](https://github.com/jmorganca/ollama/releases/tag/v0.1.21) that will impact this defect, but let us know if you see any change in behavior. Also you can force it...
@pierreuuuuu we're close to having support for 5.0+ cards - keep an eye on #2116
``` /** * This indicates that an unknown internal error has occurred. */ cudaErrorUnknown = 999, ``` @sonovice from your log, it doesn't look like you're in a WSL2 setup....
Based on [this comment](https://github.com/ollama/ollama/issues/1991#issuecomment-1902710497) it sounds like this may be the result of mismatched driver and cuda libraries. If you're seeing this CUDA error 999 crash, please check your driver/library...
If folks are still seeing this, please comment and I'll re-open.