ComfyUI-Upscaler-Tensorrt
ComfyUI-Upscaler-Tensorrt copied to clipboard
[Errno 2] No such file or directory: '/mnt/Backup_2.73TB/AI/ComfyUI/models/tensorrt/upscaler/4x_foolhardy_Remacri_fp16_1x3x256x256_1x3x512x512_1x3x1280x1280_10.9.0.34.trt'
Installed Comfyui-upscaler-tensorrt from COmfyui, and i have the upscale models that are recommended on the github page, but when i try to use them, i get this error - [Errno 2] No such file or directory: '/mnt/Backup_2.73TB/AI/ComfyUI/models/tensorrt/upscaler/4x_foolhardy_Remacri_fp16_1x3x256x256_1x3x512x512_1x3x1280x1280_10.9.0.34.trt'
It seems the example workflow works fine, but if i try to upscale my hidream gguf images generated by ksampler, then it gives me this error
Do we have to rename these upscale models?
hmm are you using the latest version of the node? It should build the required engine automatically if not found
i'm using the one that is in comfyui the nightly version 2025-04-30
Try installing the latest version manually, i'm not sure what version you're using, post the full error log I just tested, and it works as expected
[ComfyUI-Upscaler-Tensorrt|INFO] - Downloading https://huggingface.co/yuvraj108c/ComfyUI-Upscaler-Onnx/resolve/main/4x-UltraSharp.onnx
/workspace/ComfyUI/models/onnx/4x-UltraSharp.onnx: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 68.3M/68.3M [00:00<00:00, 106MiB/s]
[ComfyUI-Upscaler-Tensorrt|INFO] - Building TensorRT engine for /workspace/ComfyUI/models/onnx/4x-UltraSharp.onnx: /workspace/ComfyUI/models/tensorrt/upscaler/4x-UltraSharp_fp16_1x3x256x256_1x3x512x512_1x3x1280x1280_10.10.0.31.trt
Building engine: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 6/6 [01:26<00:00, 14.35s/it]
[ComfyUI-Upscaler-Tensorrt|INFO] - Time taken to build: 94.9502546787262 seconds
[ComfyUI-Upscaler-Tensorrt|INFO] - Loading TensorRT engine: /workspace/ComfyUI/models/tensorrt/upscaler/4x-UltraSharp_fp16_1x3x256x256_1x3x512x512_1x3x1280x1280_10.10.0.31.trt
[ComfyUI-Upscaler-Tensorrt|INFO] - Upscaling 1 images from H:768, W:768 to H:3072, W:3072 | Final resolution: H:3072, W:3072 | resize_to: none
[ComfyUI-Upscaler-Tensorrt|INFO] - Output shape: torch.Size([1, 3072, 3072, 3])
same error
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 4194304000 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 4194304000 bytes.)█████████████████████████████████████████████████▋| 1826/1835 [05:30<00:09, 1.03s/it]
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 4194304000 bytes.)
[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 4194304000 bytes.)
Building engine: 100%|███████████████████████████████████████████████████████████████████| 6/6 [05:31<00:00, 55.32s/it]
[E] IBuilder::buildSerializedNetwork: Error Code 10: Internal Error (Could not find any implementation for node /model/model.5/Resize.)
[!] Invalid Engine. Please ensure the engine was built correctly
Failed to build engine: Invalid Engine. Please ensure the engine was built correctly
[ComfyUI-Upscaler-Tensorrt|INFO] - Time taken to build: 335.90387415885925 seconds
[ComfyUI-Upscaler-Tensorrt|INFO] - Loading TensorRT engine: I:\ComfyUI_windows_portable\ComfyUI\models\tensorrt\upscaler\4xNomos2_otf_esrgan_fp16_1x3x256x256_1x3x512x512_1x3x1280x1280_10.9.0.34.trt
!!! Exception during processing !!! [Errno 2] No such file or directory: 'I:\ComfyUI_windows_portable\ComfyUI\models\tensorrt\upscaler\4xNomos2_otf_esrgan_fp16_1x3x256x256_1x3x512x512_1x3x1280x1280_10.9.0.34.trt'
Traceback (most recent call last):
File "I:\ComfyUI_windows_portable\ComfyUI\execution.py", line 345, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "I:\ComfyUI_windows_portable\ComfyUI\execution.py", line 220, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "I:\ComfyUI_windows_portable\ComfyUI\execution.py", line 192, in map_node_over_list
process_inputs(input_dict, i)
File "I:\ComfyUI_windows_portable\ComfyUI\execution.py", line 181, in process_inputs
results.append(getattr(obj, func)(**inputs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "I:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Upscaler-Tensorrt_init.py", line 142, in load_upscaler_tensorrt_model
engine.load()
File "I:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Upscaler-Tensorrt\trt_utilities.py", line 226, in load
self.engine = engine_from_bytes(bytes_from_path(self.engine_path))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "
@yoges283 what gpu are you using?
I had the same issue with a 4060, but worked when creating the engine outside of ComfyUI -
(this is for the portable version, ran with ..\..\..\python_embeded\python.exe -s .\scripts\export_trt_portable.py in the folder for the extension)
import torch
import time
import os, sys
sys.path.append(os.path.dirname(__file__))
from trt_utilities import Engine
import tensorrt
def export_trt(trt_path=None, onnx_path=None, use_fp16=True):
if trt_path is None:
trt_path = input("Enter the path to save the TensorRT engine (e.g ./realesrgan.engine): ")
if onnx_path is None:
onnx_path = input("Enter the path to the ONNX model (e.g ./realesrgan.onnx): ")
engine = Engine(trt_path)
torch.cuda.empty_cache()
s = time.time()
ret = engine.build(
onnx_path,
use_fp16,
enable_preview=True,
input_profile=[
{"input": [(1,3,256,256), (1,3,512,512), (1,3,1280,1280)]}, # any sizes from 256x256 to 1280x1280
],
)
e = time.time()
print(f"Time taken to build: {(e-s)} seconds")
return ret
export_trt(trt_path="../../models/tensorrt/upscaler/4x_foolhardy_Remacri.engine",
onnx_path="../../models/onnx/4x_foolhardy_Remacri.onnx", use_fp16=True)
this worked, and then it worked in ComfyUI too (which created the engine again as my specified filename was not correct). Very confusing...
Edit: I noticed the engine built within ComfyUI was extremely slow (~5.5x slower than the core .pth upscale) and had a different file size than the engine I built outside of ComfyUI (in ComfyUI: 36823kb, outside ComfyUI: 37019kb), after replacing the slow file with the one built outside it was ~2.5x faster. No idea why this happened! Edit2: The slowdown seems like a VRAM issue.
[ComfyUI-Upscaler-Tensorrt|INFO] - Building TensorRT engine for C:\Users\Administrator\Desktop\ComfyUI-aki-v1.7\ComfyUI\models\onnx\4x-UltraSharp.onnx: C:\Users\Administrator\Desktop\ComfyUI-aki-v1.7\ComfyUI\models\tensorrt\upscaler\4x-UltraSharp_fp16_1x3x256x256_1x3x512x512_1x3x1280x1280_10.5.0.trt [E] IBuilder::buildSerializedNetwork: Error Code 9: API Usage Error (Target GPU SM 70 is not supported by this TensorRT release.) [!] Invalid Engine. Please ensure the engine was built correctly Failed to build engine: Invalid Engine. Please ensure the engine was built correctly
@tsing0520 what gpu are you using? It seems volta gpus (v100) does not work