ComfyUI-Upscaler-Tensorrt icon indicating copy to clipboard operation
ComfyUI-Upscaler-Tensorrt copied to clipboard

[Errno 2] No such file or directory: '/mnt/Backup_2.73TB/AI/ComfyUI/models/tensorrt/upscaler/4x_foolhardy_Remacri_fp16_1x3x256x256_1x3x512x512_1x3x1280x1280_10.9.0.34.trt'

Open zono50 opened this issue 6 months ago • 6 comments
trafficstars

Installed Comfyui-upscaler-tensorrt from COmfyui, and i have the upscale models that are recommended on the github page, but when i try to use them, i get this error - [Errno 2] No such file or directory: '/mnt/Backup_2.73TB/AI/ComfyUI/models/tensorrt/upscaler/4x_foolhardy_Remacri_fp16_1x3x256x256_1x3x512x512_1x3x1280x1280_10.9.0.34.trt'

It seems the example workflow works fine, but if i try to upscale my hidream gguf images generated by ksampler, then it gives me this error

Do we have to rename these upscale models?

zono50 avatar May 01 '25 13:05 zono50

hmm are you using the latest version of the node? It should build the required engine automatically if not found

yuvraj108c avatar May 01 '25 13:05 yuvraj108c

i'm using the one that is in comfyui the nightly version 2025-04-30

zono50 avatar May 01 '25 15:05 zono50

Try installing the latest version manually, i'm not sure what version you're using, post the full error log I just tested, and it works as expected

[ComfyUI-Upscaler-Tensorrt|INFO] - Downloading https://huggingface.co/yuvraj108c/ComfyUI-Upscaler-Onnx/resolve/main/4x-UltraSharp.onnx
/workspace/ComfyUI/models/onnx/4x-UltraSharp.onnx: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 68.3M/68.3M [00:00<00:00, 106MiB/s]
[ComfyUI-Upscaler-Tensorrt|INFO] - Building TensorRT engine for /workspace/ComfyUI/models/onnx/4x-UltraSharp.onnx: /workspace/ComfyUI/models/tensorrt/upscaler/4x-UltraSharp_fp16_1x3x256x256_1x3x512x512_1x3x1280x1280_10.10.0.31.trt
Building engine: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 6/6 [01:26<00:00, 14.35s/it]
[ComfyUI-Upscaler-Tensorrt|INFO] - Time taken to build: 94.9502546787262 seconds                                                                                                                                           
[ComfyUI-Upscaler-Tensorrt|INFO] - Loading TensorRT engine: /workspace/ComfyUI/models/tensorrt/upscaler/4x-UltraSharp_fp16_1x3x256x256_1x3x512x512_1x3x1280x1280_10.10.0.31.trt                                            
[ComfyUI-Upscaler-Tensorrt|INFO] - Upscaling 1 images from H:768, W:768 to H:3072, W:3072 | Final resolution: H:3072, W:3072 | resize_to: none                                                                             
[ComfyUI-Upscaler-Tensorrt|INFO] - Output shape: torch.Size([1, 3072, 3072, 3])  

yuvraj108c avatar May 02 '25 06:05 yuvraj108c

same error

[E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3395289088 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 3356491776 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 4194304000 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 4194304000 bytes.)█████████████████████████████████████████████████▋| 1826/1835 [05:30<00:09, 1.03s/it] [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 4194304000 bytes.) [E] [virtualMemoryBuffer.cpp::nvinfer1::StdVirtualMemoryBufferImpl::resizePhysical::154] Error Code 2: OutOfMemory (Requested size was 4194304000 bytes.) Building engine: 100%|███████████████████████████████████████████████████████████████████| 6/6 [05:31<00:00, 55.32s/it] [E] IBuilder::buildSerializedNetwork: Error Code 10: Internal Error (Could not find any implementation for node /model/model.5/Resize.) [!] Invalid Engine. Please ensure the engine was built correctly Failed to build engine: Invalid Engine. Please ensure the engine was built correctly [ComfyUI-Upscaler-Tensorrt|INFO] - Time taken to build: 335.90387415885925 seconds [ComfyUI-Upscaler-Tensorrt|INFO] - Loading TensorRT engine: I:\ComfyUI_windows_portable\ComfyUI\models\tensorrt\upscaler\4xNomos2_otf_esrgan_fp16_1x3x256x256_1x3x512x512_1x3x1280x1280_10.9.0.34.trt !!! Exception during processing !!! [Errno 2] No such file or directory: 'I:\ComfyUI_windows_portable\ComfyUI\models\tensorrt\upscaler\4xNomos2_otf_esrgan_fp16_1x3x256x256_1x3x512x512_1x3x1280x1280_10.9.0.34.trt' Traceback (most recent call last): File "I:\ComfyUI_windows_portable\ComfyUI\execution.py", line 345, in execute output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "I:\ComfyUI_windows_portable\ComfyUI\execution.py", line 220, in get_output_data return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "I:\ComfyUI_windows_portable\ComfyUI\execution.py", line 192, in map_node_over_list process_inputs(input_dict, i) File "I:\ComfyUI_windows_portable\ComfyUI\execution.py", line 181, in process_inputs results.append(getattr(obj, func)(**inputs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "I:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Upscaler-Tensorrt_init.py", line 142, in load_upscaler_tensorrt_model engine.load() File "I:\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Upscaler-Tensorrt\trt_utilities.py", line 226, in load self.engine = engine_from_bytes(bytes_from_path(self.engine_path)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "", line 3, in bytes_from_path File "I:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\polygraphy\backend\base\loader.py", line 40, in call return self.call_impl(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "I:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\polygraphy\util\util.py", line 750, in wrapped return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "I:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\polygraphy\backend\common\loader.py", line 42, in call_impl return util.load_file(self._path, description="bytes") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "I:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\polygraphy\util\util.py", line 550, in load_file with open(src, mode) as f: ^^^^^^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: 'I:\ComfyUI_windows_portable\ComfyUI\models\tensorrt\upscaler\4xNomos2_otf_esrgan_fp16_1x3x256x256_1x3x512x512_1x3x1280x1280_10.9.0.34.trt'

yoges283 avatar May 04 '25 05:05 yoges283

@yoges283 what gpu are you using?

yuvraj108c avatar May 07 '25 05:05 yuvraj108c

I had the same issue with a 4060, but worked when creating the engine outside of ComfyUI -

(this is for the portable version, ran with ..\..\..\python_embeded\python.exe -s .\scripts\export_trt_portable.py in the folder for the extension)

import torch
import time
import os, sys
sys.path.append(os.path.dirname(__file__))
from trt_utilities import Engine
import tensorrt

def export_trt(trt_path=None, onnx_path=None, use_fp16=True):
    if trt_path is None:
        trt_path = input("Enter the path to save the TensorRT engine (e.g ./realesrgan.engine): ")
    if onnx_path is None:
        onnx_path = input("Enter the path to the ONNX model (e.g ./realesrgan.onnx): ")

    engine = Engine(trt_path)

    torch.cuda.empty_cache()

    s = time.time()
    ret = engine.build(
        onnx_path,
        use_fp16,
        enable_preview=True,
        input_profile=[
            {"input": [(1,3,256,256), (1,3,512,512), (1,3,1280,1280)]}, # any sizes from 256x256 to 1280x1280
        ],
    )
    e = time.time()
    print(f"Time taken to build: {(e-s)} seconds")

    return ret

export_trt(trt_path="../../models/tensorrt/upscaler/4x_foolhardy_Remacri.engine",
onnx_path="../../models/onnx/4x_foolhardy_Remacri.onnx", use_fp16=True)

this worked, and then it worked in ComfyUI too (which created the engine again as my specified filename was not correct). Very confusing...

Edit: I noticed the engine built within ComfyUI was extremely slow (~5.5x slower than the core .pth upscale) and had a different file size than the engine I built outside of ComfyUI (in ComfyUI: 36823kb, outside ComfyUI: 37019kb), after replacing the slow file with the one built outside it was ~2.5x faster. No idea why this happened! Edit2: The slowdown seems like a VRAM issue.

henrikvilhelmberglund avatar May 07 '25 16:05 henrikvilhelmberglund

[ComfyUI-Upscaler-Tensorrt|INFO] - Building TensorRT engine for C:\Users\Administrator\Desktop\ComfyUI-aki-v1.7\ComfyUI\models\onnx\4x-UltraSharp.onnx: C:\Users\Administrator\Desktop\ComfyUI-aki-v1.7\ComfyUI\models\tensorrt\upscaler\4x-UltraSharp_fp16_1x3x256x256_1x3x512x512_1x3x1280x1280_10.5.0.trt [E] IBuilder::buildSerializedNetwork: Error Code 9: API Usage Error (Target GPU SM 70 is not supported by this TensorRT release.) [!] Invalid Engine. Please ensure the engine was built correctly Failed to build engine: Invalid Engine. Please ensure the engine was built correctly

tsing0520 avatar Jul 11 '25 03:07 tsing0520

@tsing0520 what gpu are you using? It seems volta gpus (v100) does not work

yuvraj108c avatar Jul 13 '25 08:07 yuvraj108c