Installing / updating ComfyUI on Linux with ROCM - installs Nvidia packages

Open guinhill opened this issue 1 year ago • 0 comments

Package

ComfyUI

When did the issue occur?

Updating the Package

What GPU / hardware type are you using?

AMD Radeon RX 7900 XT

What happened?

When installing or Updating ComfyUI with an AMD Graphics-card , it switches to CUDA instead of ROCM, and then fails at launch with the error

RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from

I fix this from the console by going in to the venv of Comfy and running the following commands:

_cd stabilitymatrix/Packages/ComfyUI/ && source ./venv/bin/activate

pip install torch==2.3.1+rocm6.0 torchvision==0.18.1+rocm6.0 torchaudio==2.3.1+rocm6.0 --index-url https://download.pytorch.org/whl/rocm6.0_

After this fix comfyui runs as expected.

( I have tried newer versions of torch pip install torch==2.4.1+rocm6.0 torchvision==0.19.1+rocm6.0 torchaudio==2.4.1+rocm6.0 --index-url https://download.pytorch.org/whl/rocm6.0

Or even nightly pip3 install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/rocm6.2/

But this isn´t reliable, often resulting in the error: File /stabilitymatrix/Packages/ComfyUI/venv/lib/python3.10/site-packages/torch/cuda/init.py", line 640, in _raw_device_count_amdsmi except amdsmi.AmdSmiException as e: NameError: name 'amdsmi' is not defined )

Console output

Updating ComfyUI

Requirement already satisfied: pip in ./venv/lib/python3.10/site-packages (24.2) Requirement already satisfied: wheel in ./venv/lib/python3.10/site-packages (0.44.0) Looking in indexes: https://pypi.org/simple, https://download.pytorch.org/whl/rocm5.7 Requirement already satisfied: torch in ./venv/lib/python3.10/site-packages (2.3.1+rocm6.0) Collecting torch Using cached torch-2.4.1-cp310-cp310-manylinux1_x86_64.whl.metadata (26 kB) Requirement already satisfied: torchvision in ./venv/lib/python3.10/site-packages (0.18.1+rocm6.0) Collecting torchvision Using cached torchvision-0.19.1-cp310-cp310-manylinux1_x86_64.whl.metadata (6.0 kB) Requirement already satisfied: numpy==1.26.4 in ./venv/lib/python3.10/site-packages (1.26.4) Requirement already satisfied: mpmath==1.3.0 in ./venv/lib/python3.10/site-packages (1.3.0) Requirement already satisfied: torchsde in ./venv/lib/python3.10/site-packages (0.2.6) Requirement already satisfied: torchaudio in ./venv/lib/python3.10/site-packages (2.3.1+rocm6.0) Collecting torchaudio Using cached torchaudio-2.4.1-cp310-cp310-manylinux1_x86_64.whl.metadata (6.4 kB) Requirement already satisfied: einops in ./venv/lib/python3.10/site-packages (0.8.0) Requirement already satisfied: transformers>=4.28.1 in ./venv/lib/python3.10/site-packages (4.44.2) Requirement already satisfied: tokenizers>=0.13.3 in ./venv/lib/python3.10/site-packages (0.19.1) Collecting tokenizers>=0.13.3 Using cached tokenizers-0.20.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB) Requirement already satisfied: sentencepiece in ./venv/lib/python3.10/site-packages (0.2.0) Requirement already satisfied: safetensors>=0.4.2 in ./venv/lib/python3.10/site-packages (0.4.5) Requirement already satisfied: aiohttp in ./venv/lib/python3.10/site-packages (3.10.5) Requirement already satisfied: pyyaml in ./venv/lib/python3.10/site-packages (6.0.2) Requirement already satisfied: Pillow in ./venv/lib/python3.10/site-packages (10.4.0) Requirement already satisfied: scipy in ./venv/lib/python3.10/site-packages (1.14.1) Requirement already satisfied: tqdm in ./venv/lib/python3.10/site-packages (4.66.5) Requirement already satisfied: psutil in ./venv/lib/python3.10/site-packages (6.0.0) Requirement already satisfied: kornia>=0.7.1 in ./venv/lib/python3.10/site-packages (0.7.3) Requirement already satisfied: spandrel in ./venv/lib/python3.10/site-packages (0.3.4) Requirement already satisfied: soundfile in ./venv/lib/python3.10/site-packages (0.12.1) Requirement already satisfied: filelock in ./venv/lib/python3.10/site-packages (from torch) (3.15.4) Requirement already satisfied: typing-extensions>=4.8.0 in ./venv/lib/python3.10/site-packages (from torch) (4.12.2) Requirement already satisfied: sympy in ./venv/lib/python3.10/site-packages (from torch) (1.13.1) Requirement already satisfied: networkx in ./venv/lib/python3.10/site-packages (from torch) (3.3) Requirement already satisfied: jinja2 in ./venv/lib/python3.10/site-packages (from torch) (3.1.4) Requirement already satisfied: fsspec in ./venv/lib/python3.10/site-packages (from torch) (2024.5.0) Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.1.105 in ./venv/lib/python3.10/site-packages (from torch) (12.1.105) Requirement already satisfied: nvidia-cuda-runtime-cu12==12.1.105 in ./venv/lib/python3.10/site-packages (from torch) (12.1.105) Requirement already satisfied: nvidia-cuda-cupti-cu12==12.1.105 in ./venv/lib/python3.10/site-packages (from torch) (12.1.105) Requirement already satisfied: nvidia-cudnn-cu12==9.1.0.70 in ./venv/lib/python3.10/site-packages (from torch) (9.1.0.70) Requirement already satisfied: nvidia-cublas-cu12==12.1.3.1 in ./venv/lib/python3.10/site-packages (from torch) (12.1.3.1) Requirement already satisfied: nvidia-cufft-cu12==11.0.2.54 in ./venv/lib/python3.10/site-packages (from torch) (11.0.2.54) Requirement already satisfied: nvidia-curand-cu12==10.3.2.106 in ./venv/lib/python3.10/site-packages (from torch) (10.3.2.106) Requirement already satisfied: nvidia-cusolver-cu12==11.4.5.107 in ./venv/lib/python3.10/site-packages (from torch) (11.4.5.107) Requirement already satisfied: nvidia-cusparse-cu12==12.1.0.106 in ./venv/lib/python3.10/site-packages (from torch) (12.1.0.106) Requirement already satisfied: nvidia-nccl-cu12==2.20.5 in ./venv/lib/python3.10/site-packages (from torch) (2.20.5) Requirement already satisfied: nvidia-nvtx-cu12==12.1.105 in ./venv/lib/python3.10/site-packages (from torch) (12.1.105) Requirement already satisfied: triton==3.0.0 in ./venv/lib/python3.10/site-packages (from torch) (3.0.0) Requirement already satisfied: nvidia-nvjitlink-cu12 in ./venv/lib/python3.10/site-packages (from nvidia-cusolver-cu12==11.4.5.107->torch) (12.6.20) Requirement already satisfied: trampoline>=0.1.2 in ./venv/lib/python3.10/site-packages (from torchsde) (0.1.2) Requirement already satisfied: huggingface-hub<1.0,>=0.23.2 in ./venv/lib/python3.10/site-packages (from transformers>=4.28.1) (0.24.5) Requirement already satisfied: packaging>=20.0 in ./venv/lib/python3.10/site-packages (from transformers>=4.28.1) (24.1) Requirement already satisfied: regex!=2019.12.17 in ./venv/lib/python3.10/site-packages (from transformers>=4.28.1) (2024.7.24) Requirement already satisfied: requests in ./venv/lib/python3.10/site-packages (from transformers>=4.28.1) (2.31.0) Requirement already satisfied: aiohappyeyeballs>=2.3.0 in ./venv/lib/python3.10/site-packages (from aiohttp) (2.3.5) Requirement already satisfied: aiosignal>=1.1.2 in ./venv/lib/python3.10/site-packages (from aiohttp) (1.3.1) Requirement already satisfied: attrs>=17.3.0 in ./venv/lib/python3.10/site-packages (from aiohttp) (24.2.0) Requirement already satisfied: frozenlist>=1.1.1 in ./venv/lib/python3.10/site-packages (from aiohttp) (1.4.1) Requirement already satisfied: multidict<7.0,>=4.5 in ./venv/lib/python3.10/site-packages (from aiohttp) (6.0.5) Requirement already satisfied: yarl<2.0,>=1.0 in ./venv/lib/python3.10/site-packages (from aiohttp) (1.9.4) Requirement already satisfied: async-timeout<5.0,>=4.0 in ./venv/lib/python3.10/site-packages (from aiohttp) (4.0.3) Requirement already satisfied: kornia-rs>=0.1.0 in ./venv/lib/python3.10/site-packages (from kornia>=0.7.1) (0.1.5) Requirement already satisfied: cffi>=1.0 in ./venv/lib/python3.10/site-packages (from soundfile) (1.17.0) Requirement already satisfied: pycparser in ./venv/lib/python3.10/site-packages (from cffi>=1.0->soundfile) (2.22) Requirement already satisfied: idna>=2.0 in ./venv/lib/python3.10/site-packages (from yarl<2.0,>=1.0->aiohttp) (3.7) Requirement already satisfied: MarkupSafe>=2.0 in ./venv/lib/python3.10/site-packages (from jinja2->torch) (2.1.5) Requirement already satisfied: charset-normalizer<4,>=2 in ./venv/lib/python3.10/site-packages (from requests->transformers>=4.28.1) (3.3.2) Requirement already satisfied: urllib3<3,>=1.21.1 in ./venv/lib/python3.10/site-packages (from requests->transformers>=4.28.1) (1.26.19) Requirement already satisfied: certifi>=2017.4.17 in ./venv/lib/python3.10/site-packages (from requests->transformers>=4.28.1) (2024.7.4) Using cached torch-2.4.1-cp310-cp310-manylinux1_x86_64.whl (797.1 MB) Using cached torchvision-0.19.1-cp310-cp310-manylinux1_x86_64.whl (7.0 MB) Using cached torchaudio-2.4.1-cp310-cp310-manylinux1_x86_64.whl (3.4 MB) Installing collected packages: torch, torchvision, torchaudio Attempting uninstall: torch Found existing installation: torch 2.3.1+rocm6.0 Uninstalling torch-2.3.1+rocm6.0: Successfully uninstalled torch-2.3.1+rocm6.0 Attempting uninstall: torchvision Found existing installation: torchvision 0.18.1+rocm6.0 Uninstalling torchvision-0.18.1+rocm6.0: Successfully uninstalled torchvision-0.18.1+rocm6.0 Attempting uninstall: torchaudio Found existing installation: torchaudio 2.3.1+rocm6.0 Uninstalling torchaudio-2.3.1+rocm6.0: Successfully uninstalled torchaudio-2.3.1+rocm6.0 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. image-reward 1.5 requires fairscale==0.4.13, but you have fairscale 0.4.0 which is incompatible. Successfully installed torch-2.4.1 torchaudio-2.4.1 torchvision-0.19.1 Updated ComfyUI

When Starting ComfyUI

[START] Security scan [DONE] Security scan

ComfyUI-Manager: installing dependencies done.

** ComfyUI startup time: 2024-09-14 11:04:49.219909 ** Platform: Linux ** Python version: 3.10.11 (main, May 7 2023, 19:26:31) [Clang 16.0.3 ] ** Python executable: /home/username/stabilitymatrix/Packages/ComfyUI/venv/bin/python3 ** ComfyUI Path: /home/username/stabilitymatrix/Packages/ComfyUI ** Log path: /home/username/stabilitymatrix/Packages/ComfyUI/comfyui.log [MaraScott] Initialization

Prestartup times for custom nodes: 0.0 seconds: /home/username/stabilitymatrix/Packages/ComfyUI/custom_nodes/rgthree-comfy 0.0 seconds: /home/username/stabilitymatrix/Packages/ComfyUI/custom_nodes/ComfyUI_MaraScott_Nodes 0.0 seconds: /home/username/stabilitymatrix/Packages/ComfyUI/custom_nodes/ComfyUI-Easy-Use 0.7 seconds: /home/username/stabilitymatrix/Packages/ComfyUI/custom_nodes/ComfyUI-Manager

Traceback (most recent call last): File "/home/username/stabilitymatrix/Packages/ComfyUI/main.py", line 90, in import execution File "/home/username/stabilitymatrix/Packages/ComfyUI/execution.py", line 13, in import nodes File "/home/username/stabilitymatrix/Packages/ComfyUI/nodes.py", line 21, in import comfy.diffusers_load File "/home/username/stabilitymatrix/Packages/ComfyUI/comfy/diffusers_load.py", line 3, in import comfy.sd File "/home/username/stabilitymatrix/Packages/ComfyUI/comfy/sd.py", line 5, in from comfy import model_management File "/home/username/stabilitymatrix/Packages/ComfyUI/comfy/model_management.py", line 143, in total_vram = get_total_memory(get_torch_device()) / (1024 * 1024) File "/home/username/stabilitymatrix/Packages/ComfyUI/comfy/model_management.py", line 112, in get_torch_device return torch.device(torch.cuda.current_device()) File "/home/username/stabilitymatrix/Packages/ComfyUI/venv/lib/python3.10/site-packages/torch/cuda/init.py", line 878, in current_device _lazy_init() File "/home/username/stabilitymatrix/Packages/ComfyUI/venv/lib/python3.10/site-packages/torch/cuda/init.py", line 314, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx

Version

v2.11.8

What Operating System are you using?

Linux

Sep 14 '24 09:09 guinhill