WARNING: No NVIDIA GPU detected. Ollama will run in CPU-only mode.
i use wsl2,and GPU information is as follows. when i install ollama,it WARNING: No NVIDIA GPU detected. Ollama will run in CPU-only mode. +---------------------------------------------------------------------------------------+ | NVIDIA-SMI 546.33 Driver Version: 546.33 CUDA Version: 12.3 | |-----------------------------------------+----------------------+----------------------+ | GPU Name TCC/WDDM | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+======================+======================| | 0 NVIDIA GeForce RTX 4060 Ti WDDM | 00000000:03:00.0 On | N/A | | 0% 29C P8 7W / 180W | 581MiB / 16380MiB | 0% Default | | | | N/A | +-----------------------------------------+----------------------+----------------------+
I tried to use ollama as wsl2 but I had the same problem. So I ran the olama with docker and it worked well. Here's the official ollama article for your reference. https://ollama.ai/blog/ollama-is-now-available-as-an-official-docker-image
@xzkxzk12301230 if you're still facing this problem, can you share the server log? It may also be helpful to run with OLLAMA_DEBUG=1 set to increase the verbosity of the logs.
https://github.com/ollama/ollama/blob/main/docs/troubleshooting.md#how-to-troubleshoot-issues