text-generation-webui icon indicating copy to clipboard operation
text-generation-webui copied to clipboard

"Found no NVIDIA driver on your system"

Open CrazyKrow opened this issue 2 years ago • 2 comments

Describe the bug

I'm trying to install the webui on wsl but no luck. I get the error "RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx" I tried reinstalling multiple times and I always get cuda errors. I'm using wsl 1 on windows 10. My install on windows works fine, its only when I try to do it with wsl that is the problem.

Is there an existing issue for this?

  • [X] I have searched the existing issues

Reproduction

I followed the installation steps on README.md, I used "conda install pytorch torchvision torchaudio pytorch-cuda=11.7 -c pytorch -c nvidia" instead of "pip3 install torch torchvision torchaudio" because it would let me install otherwise.

Screenshot

No response

Logs

python server.py
Loading llama-7b-hf...
Loading checkpoint shards: 100%|████████████████████████████████████████████████████████| 33/33 [00:16<00:00,  1.98it/s]
Traceback (most recent call last):
  File "/home/crazykrow/text-generation-webui/server.py", line 241, in <module>
    shared.model, shared.tokenizer = load_model(shared.model_name)
  File "/home/crazykrow/text-generation-webui/modules/models.py", line 56, in load_model
    model = model.cuda()
  File "/home/crazykrow/miniconda3/envs/textgen/lib/python3.10/site-packages/torch/nn/modules/module.py", line 905, in cuda
    return self._apply(lambda t: t.cuda(device))
  File "/home/crazykrow/miniconda3/envs/textgen/lib/python3.10/site-packages/torch/nn/modules/module.py", line 797, in _apply
    module._apply(fn)
  File "/home/crazykrow/miniconda3/envs/textgen/lib/python3.10/site-packages/torch/nn/modules/module.py", line 797, in _apply
    module._apply(fn)
  File "/home/crazykrow/miniconda3/envs/textgen/lib/python3.10/site-packages/torch/nn/modules/module.py", line 820, in _apply
    param_applied = fn(param)
  File "/home/crazykrow/miniconda3/envs/textgen/lib/python3.10/site-packages/torch/nn/modules/module.py", line 905, in <lambda>
    return self._apply(lambda t: t.cuda(device))
  File "/home/crazykrow/miniconda3/envs/textgen/lib/python3.10/site-packages/torch/cuda/__init__.py", line 247, in _lazy_init
    torch._C._cuda_init()
RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx

System Info

Windows 10, WSL v1, 3090Ti, 32GB ram

CrazyKrow avatar Mar 20 '23 18:03 CrazyKrow

This is a WSL specific issue. Workaround here: https://github.com/oobabooga/text-generation-webui/issues/440#issuecomment-1475506032

jllllll avatar Mar 20 '23 19:03 jllllll

There's a more permanent fix HERE:

It's very hacky but works and doesn't have to be redone every invocation or restart.

LTSarc avatar Mar 21 '23 05:03 LTSarc

This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.

github-actions[bot] avatar Apr 20 '23 23:04 github-actions[bot]

Just found this same issue when using pytorch.

Thanks @jllllll for the solution!

richardrl avatar May 08 '23 01:05 richardrl

I'm experiencing the same issue and I'm on MacBook

Ashbarr13 avatar Jun 09 '24 01:06 Ashbarr13

I'm experiencing the same issue and I'm on distrobox (Fedora)

MLSci avatar Jun 22 '24 10:06 MLSci