ComfyUI icon indicating copy to clipboard operation
ComfyUI copied to clipboard

allocation on device error

Open nagyuva opened this issue 1 year ago • 1 comments

Your question

ComfyUI Error Report

Error Details

  • Node Type: XlabsSampler
  • Exception Type: torch.OutOfMemoryError
  • Exception Message: Allocation on device

Stack Trace

  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 323, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
                                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 198, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 169, in _map_node_over_list
    process_inputs(input_dict, i)

  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 158, in process_inputs
    results.append(getattr(obj, func)(**inputs))
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\nodes.py", line 458, in sampling
    x = denoise_controlnet(
        ^^^^^^^^^^^^^^^^^^^

  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\sampling.py", line 282, in denoise_controlnet
    block_res_samples = container.controlnet(
                        ^^^^^^^^^^^^^^^^^^^^^

  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\xflux\src\flux\controlnet.py", line 213, in forward
    img, txt = block(img=img, txt=txt, vec=vec, pe=pe)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\xflux\src\flux\modules\layers.py", line 297, in forward
    return self.processor(self, img, txt, vec, pe)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\xflux\src\flux\modules\layers.py", line 248, in __call__
    attn1 = attention(q, k, v, pe=pe)
            ^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\xflux\src\flux\math.py", line 9, in attention
    x = torch.nn.functional.scaled_dot_product_attention(q, k, v)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

System Information

  • ComfyUI Version: v0.2.2-22-g81778a7
  • Arguments: ComfyUI\main.py --windows-standalone-build
  • OS: nt
  • Python Version: 3.11.9 (tags/v3.11.9:de54cf5, Apr 2 2024, 10:12:12) [MSC v.1938 64 bit (AMD64)]
  • Embedded Python: true
  • PyTorch Version: 2.4.0+cu121

Devices

  • Name: cuda:0 Quadro RTX 5000 : cudaMallocAsync
    • Type: cuda
    • VRAM Total: 16105799680
    • VRAM Free: 13376794016
    • Torch VRAM Total: 1644167168
    • Torch VRAM Free: 116706720

Logs

2024-09-11 11:12:56,872 - root - INFO - Total VRAM 15360 MB, total RAM 130775 MB
2024-09-11 11:12:56,873 - root - INFO - pytorch version: 2.4.0+cu121
2024-09-11 11:13:01,934 - root - INFO - xformers version: 0.0.27.post2
2024-09-11 11:13:01,982 - root - INFO - Set vram state to: NORMAL_VRAM
2024-09-11 11:13:01,983 - root - INFO - Device: cuda:0 Quadro RTX 5000 : cudaMallocAsync
2024-09-11 11:13:02,788 - root - INFO - Using xformers cross attention
2024-09-11 11:13:06,812 - root - INFO - [Prompt Server] web root: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\web
2024-09-11 11:13:24,307 - root - INFO - Total VRAM 15360 MB, total RAM 130775 MB
2024-09-11 11:13:24,307 - root - INFO - pytorch version: 2.4.0+cu121
2024-09-11 11:13:24,310 - root - INFO - xformers version: 0.0.27.post2
2024-09-11 11:13:24,313 - root - INFO - Set vram state to: NORMAL_VRAM
2024-09-11 11:13:24,314 - root - INFO - Device: cuda:0 Quadro RTX 5000 : cudaMallocAsync
2024-09-11 11:13:25,106 - albumentations.check_version - INFO - A new version of Albumentations is available: 1.4.14 (you have 1.4.13). Upgrade using: pip install -U albumentations. To disable automatic update checks, set the environment variable NO_ALBUMENTATIONS_UPDATE to 1.
2024-09-11 11:13:27,634 - root - INFO - --------------
2024-09-11 11:13:27,634 - root - INFO - [91m ### Mixlab Nodes: [93mLoaded
2024-09-11 11:13:27,638 - root - INFO - ChatGPT.available True
2024-09-11 11:13:27,640 - root - INFO - edit_mask.available True
2024-09-11 11:13:30,197 - root - INFO - ClipInterrogator.available True
2024-09-11 11:13:31,135 - root - INFO - PromptGenerate.available True
2024-09-11 11:13:31,136 - root - INFO - ChinesePrompt.available True
2024-09-11 11:13:31,140 - root - INFO - RembgNode_.available True
2024-09-11 11:13:32,829 - root - INFO - TripoSR.available
2024-09-11 11:13:32,832 - root - INFO - MiniCPMNode.available
2024-09-11 11:13:32,836 - root - INFO - [93m -------------- [0m
2024-09-11 11:13:49,656 - root - INFO - 
Import times for custom nodes:
2024-09-11 11:13:49,657 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\websocket_image_save.py
2024-09-11 11:13:49,661 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-VideoHelperSuite
2024-09-11 11:13:49,663 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus
2024-09-11 11:13:49,664 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\efficiency-nodes-comfyui
2024-09-11 11:13:49,669 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\extended-saveimage-comfyui
2024-09-11 11:13:49,671 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_segment_anything
2024-09-11 11:13:49,675 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\sdxl_prompt_styler
2024-09-11 11:13:49,676 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui_controlnet_aux
2024-09-11 11:13:49,679 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\cg-use-everywhere
2024-09-11 11:13:49,681 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\masquerade-nodes-comfyui
2024-09-11 11:13:49,682 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-BRIA_AI-RMBG
2024-09-11 11:13:49,686 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_JPS-Nodes
2024-09-11 11:13:49,692 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Eagle-PNGInfo
2024-09-11 11:13:49,693 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\wlsh_nodes
2024-09-11 11:13:49,694 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Universal-Styler
2024-09-11 11:13:49,695 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_InstantID
2024-09-11 11:13:49,697 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-eesahesNodes
2024-09-11 11:13:49,698 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyLiterals
2024-09-11 11:13:49,703 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-various
2024-09-11 11:13:49,708 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_essentials
2024-09-11 11:13:49,711 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfy_PoP
2024-09-11 11:13:49,712 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_UltimateSDUpscale
2024-09-11 11:13:49,713 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\DJZ-Nodes
2024-09-11 11:13:49,714 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-WD14-Tagger
2024-09-11 11:13:49,715 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyMath
2024-09-11 11:13:49,720 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfy-image-saver
2024-09-11 11:13:49,725 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\virtuoso-nodes
2024-09-11 11:13:49,728 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Impact-Pack
2024-09-11 11:13:49,729 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-KJNodes
2024-09-11 11:13:49,731 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui
2024-09-11 11:13:49,732 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\Derfuu_ComfyUI_ModdedNodes
2024-09-11 11:13:49,736 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-GGUF
2024-09-11 11:13:49,741 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Chibi-Nodes
2024-09-11 11:13:49,744 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet
2024-09-11 11:13:49,745 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-MimicMotionWrapper
2024-09-11 11:13:49,746 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_ProPainter_Nodes
2024-09-11 11:13:49,747 - root - INFO -    0.0 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Custom-Scripts
2024-09-11 11:13:49,748 - root - INFO -    0.1 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Frame-Interpolation
2024-09-11 11:13:49,753 - root - INFO -    0.1 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-IC-Light
2024-09-11 11:13:49,754 - root - INFO -    0.1 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-SuperBeasts
2024-09-11 11:13:49,755 - root - INFO -    0.1 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-LivePortraitKJ
2024-09-11 11:13:49,756 - root - INFO -    0.1 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\rgthree-comfy
2024-09-11 11:13:49,757 - root - INFO -    0.1 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\OneButtonPrompt
2024-09-11 11:13:49,759 - root - INFO -    0.1 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved
2024-09-11 11:13:49,760 - root - INFO -    0.1 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_Comfyroll_CustomNodes
2024-09-11 11:13:49,761 - root - INFO -    0.1 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_bitsandbytes_NF4
2024-09-11 11:13:49,762 - root - INFO -    0.2 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Crystools
2024-09-11 11:13:49,763 - root - INFO -    0.2 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-ControlNeXt-SVD
2024-09-11 11:13:49,768 - root - INFO -    0.2 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-portrait-master
2024-09-11 11:13:49,775 - root - INFO -    0.3 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-reactor-node
2024-09-11 11:13:49,779 - root - INFO -    0.4 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\save-image-extended-comfyui
2024-09-11 11:13:49,780 - root - INFO -    0.4 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_Searge_LLM
2024-09-11 11:13:49,786 - root - INFO -    0.5 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-AdvancedLivePortrait
2024-09-11 11:13:49,788 - root - INFO -    0.5 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_LayerStyle
2024-09-11 11:13:49,788 - root - INFO -    0.6 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfy_mtb
2024-09-11 11:13:49,790 - root - INFO -    0.8 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-SAM2
2024-09-11 11:13:49,790 - root - INFO -    0.8 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Manager
2024-09-11 11:13:49,792 - root - INFO -    0.8 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Easy-Use
2024-09-11 11:13:49,793 - root - INFO -    0.9 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-BrushNet
2024-09-11 11:13:49,794 - root - INFO -    1.1 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-liveportrait
2024-09-11 11:13:49,795 - root - INFO -    1.1 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-SUPIR
2024-09-11 11:13:49,802 - root - INFO -    2.7 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\was-node-suite-comfyui
2024-09-11 11:13:49,805 - root - INFO -    2.8 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-art-venture
2024-09-11 11:13:49,807 - root - INFO -    3.7 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-YoloWorld-EfficientSAM
2024-09-11 11:13:49,808 - root - INFO -    4.5 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Allor
2024-09-11 11:13:49,809 - root - INFO -    4.7 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\bilbox-comfyui
2024-09-11 11:13:49,810 - root - INFO -    5.4 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_Custom_Nodes_AlekPet
2024-09-11 11:13:49,811 - root - INFO -    6.4 seconds: C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-mixlab-nodes
2024-09-11 11:13:49,816 - root - INFO - 
2024-09-11 11:13:49,898 - root - INFO - 

2024-09-11 11:13:49,899 - root - INFO - 

Starting server
2024-09-11 11:13:49,903 - root - INFO - [93mTo see the GUI go to: http://10.10.11.93:8188 or http://127.0.0.1:8188
2024-09-11 11:13:49,905 - root - INFO - [93mTo see the GUI go to: https://10.10.11.93:8189 or https://127.0.0.1:8189[0m
2024-09-11 11:14:56,712 - asyncio - ERROR - Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle: <Handle _ProactorBasePipeTransport._call_connection_lost(None)>
Traceback (most recent call last):
  File "asyncio\events.py", line 84, in _run
  File "asyncio\proactor_events.py", line 165, in _call_connection_lost
ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host
2024-09-11 11:14:56,740 - asyncio - ERROR - Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle: <Handle _ProactorBasePipeTransport._call_connection_lost(None)>
Traceback (most recent call last):
  File "asyncio\events.py", line 84, in _run
  File "asyncio\proactor_events.py", line 165, in _call_connection_lost
ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host
2024-09-11 11:17:50,719 - root - INFO - got prompt
2024-09-11 11:17:50,741 - root - ERROR - Failed to validate prompt for output 23:
2024-09-11 11:17:50,741 - root - ERROR - * VAELoader 8:
2024-09-11 11:17:50,745 - root - ERROR -   - Value not in list: vae_name: 'ae.safetensors' not in ['FLUX1\\ae.safetensors', 'ae.sft', 'sdxl_vae.safetensors', 'vae-ft-mse-840000-ema-pruned.safetensors']
2024-09-11 11:17:50,748 - root - ERROR - Output will be ignored
2024-09-11 11:17:51,200 - root - INFO - Prompt executed in 0.45 seconds
2024-09-11 11:18:16,662 - root - INFO - got prompt
2024-09-11 11:18:16,823 - root - INFO - Using xformers attention in VAE
2024-09-11 11:18:16,824 - root - INFO - Using xformers attention in VAE
2024-09-11 11:18:19,859 - root - INFO - model weight dtype torch.float8_e4m3fn, manual cast: torch.float16
2024-09-11 11:18:19,875 - root - INFO - model_type FLUX
2024-09-11 11:21:24,360 - root - WARNING - clip missing: ['text_projection.weight']
2024-09-11 11:21:47,671 - root - INFO - Requested to load FluxClipModel_
2024-09-11 11:21:47,671 - root - INFO - Loading 1 new model
2024-09-11 11:21:50,915 - root - INFO - loaded completely 0.0 4777.53759765625 True
2024-09-11 11:22:01,307 - root - INFO - Requested to load Flux
2024-09-11 11:22:01,307 - root - INFO - Loading 1 new model
2024-09-11 11:23:06,655 - root - INFO - loaded partially 9919.20509033203 9915.583068847656 77
2024-09-11 11:23:08,108 - root - INFO - Unloading models for lowram load.
2024-09-11 11:23:08,145 - root - INFO - 0 models unloaded.
2024-09-11 11:23:11,754 - root - ERROR - !!! Exception during processing !!! Allocation on device 
2024-09-11 11:23:11,822 - root - ERROR - Traceback (most recent call last):
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 323, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
                                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 198, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 169, in _map_node_over_list
    process_inputs(input_dict, i)
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 158, in process_inputs
    results.append(getattr(obj, func)(**inputs))
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\nodes.py", line 458, in sampling
    x = denoise_controlnet(
        ^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\sampling.py", line 282, in denoise_controlnet
    block_res_samples = container.controlnet(
                        ^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\xflux\src\flux\controlnet.py", line 213, in forward
    img, txt = block(img=img, txt=txt, vec=vec, pe=pe)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\xflux\src\flux\modules\layers.py", line 297, in forward
    return self.processor(self, img, txt, vec, pe)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\xflux\src\flux\modules\layers.py", line 248, in __call__
    attn1 = attention(q, k, v, pe=pe)
            ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\xflux\src\flux\math.py", line 9, in attention
    x = torch.nn.functional.scaled_dot_product_attention(q, k, v)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
torch.OutOfMemoryError: Allocation on device 

2024-09-11 11:23:11,827 - root - ERROR - Got an OOM, unloading all loaded models.
2024-09-11 11:23:13,602 - root - INFO - Prompt executed in 296.92 seconds
2024-09-11 11:50:30,102 - root - INFO - got prompt
2024-09-11 11:50:30,198 - root - INFO - Requested to load Flux
2024-09-11 11:50:30,198 - root - INFO - Loading 1 new model
2024-09-11 11:51:35,123 - root - INFO - loaded partially 11337.904888916015 11337.8525390625 1
2024-09-11 11:51:35,196 - root - INFO - Unloading models for lowram load.
2024-09-11 11:51:35,206 - root - INFO - 0 models unloaded.
2024-09-11 11:51:36,769 - root - ERROR - !!! Exception during processing !!! Allocation on device 
2024-09-11 11:51:36,772 - root - ERROR - Traceback (most recent call last):
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 323, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
                                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 198, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 169, in _map_node_over_list
    process_inputs(input_dict, i)
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\execution.py", line 158, in process_inputs
    results.append(getattr(obj, func)(**inputs))
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\nodes.py", line 458, in sampling
    x = denoise_controlnet(
        ^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\sampling.py", line 282, in denoise_controlnet
    block_res_samples = container.controlnet(
                        ^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\xflux\src\flux\controlnet.py", line 213, in forward
    img, txt = block(img=img, txt=txt, vec=vec, pe=pe)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1553, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1562, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\xflux\src\flux\modules\layers.py", line 297, in forward
    return self.processor(self, img, txt, vec, pe)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\xflux\src\flux\modules\layers.py", line 248, in __call__
    attn1 = attention(q, k, v, pe=pe)
            ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\custom_nodes\x-flux-comfyui\xflux\src\flux\math.py", line 9, in attention
    x = torch.nn.functional.scaled_dot_product_attention(q, k, v)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
torch.OutOfMemoryError: Allocation on device 

2024-09-11 11:51:36,776 - root - ERROR - Got an OOM, unloading all loaded models.
2024-09-11 11:51:37,209 - root - INFO - Prompt executed in 67.08 seconds

Attached Workflow

Please make sure that workflow does not contain any sensitive information such as API keys or passwords.

{"last_node_id":51,"last_link_id":119,"nodes":[{"id":39,"type":"PreviewImage","pos":{"0":444,"1":-130},"size":{"0":210,"1":246},"flags":{"collapsed":false},"order":11,"mode":0,"inputs":[{"name":"images","type":"IMAGE","link":113}],"outputs":[],"properties":{"Node name for S&R":"PreviewImage"}},{"id":48,"type":"CannyEdgePreprocessor","pos":{"0":102,"1":-227},"size":{"0":315,"1":106},"flags":{},"order":8,"mode":0,"inputs":[{"name":"image","type":"IMAGE","link":112}],"outputs":[{"name":"IMAGE","type":"IMAGE","links":[113,114,115],"slot_index":0,"shape":3}],"properties":{"Node name for S&R":"CannyEdgePreprocessor"},"widgets_values":[100,200,1024]},{"id":19,"type":"CLIPTextEncodeFlux","pos":{"0":203,"1":167},"size":{"0":400,"1":200},"flags":{},"order":7,"mode":0,"inputs":[{"name":"clip","type":"CLIP","link":27,"slot_index":0}],"outputs":[{"name":"CONDITIONING","type":"CONDITIONING","links":[26],"slot_index":0,"shape":3}],"properties":{"Node name for S&R":"CLIPTextEncodeFlux"},"widgets_values":["bad photo","bad photo",4,true,true]},{"id":3,"type":"XlabsSampler","pos":{"0":948,"1":149},"size":{"0":342.5999755859375,"1":282},"flags":{},"order":14,"mode":0,"inputs":[{"name":"model","type":"MODEL","link":119,"slot_index":0},{"name":"conditioning","type":"CONDITIONING","link":18},{"name":"neg_conditioning","type":"CONDITIONING","link":26},{"name":"latent_image","type":"LATENT","link":66},{"name":"controlnet_condition","type":"ControlNetCondition","link":28}],"outputs":[{"name":"latent","type":"LATENT","links":[6],"shape":3}],"properties":{"Node name for S&R":"XlabsSampler"},"widgets_values":[324242532549,"fixed",25,1,3.5,0,1]},{"id":23,"type":"SaveImage","pos":{"0":1433,"1":-194},"size":{"0":433.7451171875,"1":469.8033447265625},"flags":{},"order":16,"mode":0,"inputs":[{"name":"images","type":"IMAGE","link":101}],"outputs":[],"properties":{"Node name for S&R":"SaveImage"},"widgets_values":["canny_res"]},{"id":14,"type":"ApplyFluxControlNet","pos":{"0":546,"1":-264},"size":{"0":393,"1":98},"flags":{},"order":12,"mode":0,"inputs":[{"name":"controlnet","type":"FluxControlNet","link":44},{"name":"image","type":"IMAGE","link":114,"slot_index":1},{"name":"controlnet_condition","type":"ControlNetCondition","link":null}],"outputs":[{"name":"controlnet_condition","type":"ControlNetCondition","links":[28],"slot_index":0,"shape":3}],"properties":{"Node name for S&R":"ApplyFluxControlNet"},"widgets_values":[0.7000000000000001]},{"id":5,"type":"CLIPTextEncodeFlux","pos":{"0":763,"1":-45},"size":{"0":286.951416015625,"1":103.62841796875},"flags":{},"order":10,"mode":0,"inputs":[{"name":"clip","type":"CLIP","link":2,"slot_index":0},{"name":"clip_l","type":"STRING","link":116,"widget":{"name":"clip_l"}},{"name":"t5xxl","type":"STRING","link":117,"widget":{"name":"t5xxl"}}],"outputs":[{"name":"CONDITIONING","type":"CONDITIONING","links":[18],"slot_index":0,"shape":3}],"properties":{"Node name for S&R":"CLIPTextEncodeFlux"},"widgets_values":["Portrait of THAMANNAH, full hd, cinematic, abandoned factory, mystery, dangereous, studio light on face, light gray army outfit, stocking, boot,","Portrait of THAMANNAH, full hd, cinematic, abandoned factory, mystery, dangereous, studio light on face, light gray army outfit, stocking, boot,",4,true,true]},{"id":4,"type":"DualCLIPLoader","pos":{"0":104,"1":-79},"size":{"0":315,"1":106},"flags":{},"order":0,"mode":0,"inputs":[],"outputs":[{"name":"CLIP","type":"CLIP","links":[2,27],"slot_index":0,"shape":3}],"properties":{"Node name for S&R":"DualCLIPLoader"},"widgets_values":["clip_l.safetensors","t5xxl_fp8_e4m3fn.safetensors","flux"]},{"id":16,"type":"LoadImage","pos":{"0":-253,"1":-229},"size":{"0":315,"1":314},"flags":{},"order":1,"mode":0,"inputs":[],"outputs":[{"name":"IMAGE","type":"IMAGE","links":[112],"slot_index":0,"shape":3},{"name":"MASK","type":"MASK","links":null,"shape":3}],"properties":{"Node name for S&R":"LoadImage"},"widgets_values":["ComfyUI_00148_.png","image"]},{"id":13,"type":"LoadFluxControlNet","pos":{"0":121,"1":-375},"size":{"0":316.83343505859375,"1":86.47058868408203},"flags":{},"order":2,"mode":0,"inputs":[],"outputs":[{"name":"ControlNet","type":"FluxControlNet","links":[44],"slot_index":0,"shape":3}],"properties":{"Node name for S&R":"LoadFluxControlNet"},"widgets_values":["flux-dev-fp8","flux-canny-controlnet.safetensors"]},{"id":32,"type":"UNETLoader","pos":{"0":502,"1":452},"size":{"0":315,"1":82},"flags":{},"order":3,"mode":0,"inputs":[],"outputs":[{"name":"MODEL","type":"MODEL","links":[118],"slot_index":0,"shape":3}],"properties":{"Node name for S&R":"UNETLoader"},"widgets_values":["flux1-dev.safetensors","fp8_e4m3fn"]},{"id":6,"type":"EmptyLatentImage","pos":{"0":1166,"1":569},"size":{"0":315,"1":106},"flags":{},"order":4,"mode":0,"inputs":[],"outputs":[{"name":"LATENT","type":"LATENT","links":[66],"slot_index":0,"shape":3}],"properties":{"Node name for S&R":"EmptyLatentImage"},"widgets_values":[832,1216,1]},{"id":46,"type":"SaveImage","pos":{"0":621,"1":146},"size":{"0":315,"1":270},"flags":{},"order":13,"mode":2,"inputs":[{"name":"images","type":"IMAGE","link":115}],"outputs":[],"properties":{"Node name for S&R":"SaveImage"},"widgets_values":["canny_process"]},{"id":49,"type":"PrimitiveNode","pos":{"0":964,"1":-287},"size":{"0":414.8598937988281,"1":147.0726776123047},"flags":{},"order":5,"mode":0,"inputs":[],"outputs":[{"name":"STRING","type":"STRING","links":[116,117],"slot_index":0,"widget":{"name":"clip_l"}}],"title":"Prompt","properties":{"Run widget replace on values":"on"},"widgets_values":["Portrait of THAMANNAH, full hd, cinematic, abandoned factory, mystery, dangereous, studio light on face, light gray army outfit, stocking, boot,"]},{"id":8,"type":"VAELoader","pos":{"0":1092,"1":-99},"size":{"0":315,"1":58},"flags":{},"order":6,"mode":0,"inputs":[],"outputs":[{"name":"VAE","type":"VAE","links":[7],"slot_index":0,"shape":3}],"properties":{"Node name for S&R":"VAELoader"},"widgets_values":["FLUX1\\ae.safetensors"]},{"id":7,"type":"VAEDecode","pos":{"0":1173,"1":21},"size":{"0":210,"1":46},"flags":{},"order":15,"mode":0,"inputs":[{"name":"samples","type":"LATENT","link":6,"slot_index":0},{"name":"vae","type":"VAE","link":7}],"outputs":[{"name":"IMAGE","type":"IMAGE","links":[101],"slot_index":0,"shape":3}],"properties":{"Node name for S&R":"VAEDecode"}},{"id":51,"type":"LoraLoaderModelOnly","pos":{"0":742,"1":549},"size":{"0":315,"1":82},"flags":{},"order":9,"mode":0,"inputs":[{"name":"model","type":"MODEL","link":118}],"outputs":[{"name":"MODEL","type":"MODEL","links":[119],"shape":3,"slot_index":0}],"properties":{"Node name for S&R":"LoraLoaderModelOnly"},"widgets_values":["thamannah_flux.lora.safetensors",1]}],"links":[[2,4,0,5,0,"CLIP"],[6,3,0,7,0,"LATENT"],[7,8,0,7,1,"VAE"],[18,5,0,3,1,"CONDITIONING"],[26,19,0,3,2,"CONDITIONING"],[27,4,0,19,0,"CLIP"],[28,14,0,3,4,"ControlNetCondition"],[44,13,0,14,0,"FluxControlNet"],[66,6,0,3,3,"LATENT"],[101,7,0,23,0,"IMAGE"],[112,16,0,48,0,"IMAGE"],[113,48,0,39,0,"IMAGE"],[114,48,0,14,1,"IMAGE"],[115,48,0,46,0,"IMAGE"],[116,49,0,5,1,"STRING"],[117,49,0,5,2,"STRING"],[118,32,0,51,0,"MODEL"],[119,51,0,3,0,"MODEL"]],"groups":[],"config":{},"extra":{"ds":{"scale":0.9646149645000012,"offset":[-239.3462518593615,124.84777782397107]}},"version":0.4}

Additional Context

(Please add any additional context or steps to reproduce the error here)

Logs

No response

Other

No response

nagyuva avatar Sep 11 '24 06:09 nagyuva

Try using this workflow for the xlabs controlnet: https://comfyanonymous.github.io/ComfyUI_examples/flux/#flux-controlnets

comfyanonymous avatar Sep 11 '24 07:09 comfyanonymous

This issue is being marked stale because it has not had any activity for 30 days. Reply below within 7 days if your issue still isn't solved, and it will be left open. Otherwise, the issue will be closed automatically.

github-actions[bot] avatar Oct 11 '24 11:10 github-actions[bot]

If using flux, try not to select default for weight_dtype of the LoadDiffusionModel node. But I also encountered this bug when I did not apply flux.

walterFeng avatar Nov 03 '24 16:11 walterFeng