ComfyUI-3D-Pack icon indicating copy to clipboard operation
ComfyUI-3D-Pack copied to clipboard

Error while perform example workflow of CharacterGen:CharacterGen_InstantMesh.json

Open JimWang151 opened this issue 1 year ago • 1 comments

The multi-view can be run smoothly as below: image

But when runing the InstantMesh Reconstruction Model node ,the error message like this:

[Comfy3D] [Load_CharacterGen_MVDiffusion_Model] loaded model ckpt from D:\ComfyUI_Windows_portable\ComfyUI\custom_nodes\ComfyUI-3D-Pack\Checkpoints\CharacterGen 100%|██████████████████████████████████████████████████████████████████████████████████| 40/40 [04:30<00:00, 6.77s/it] 2024-10-07 15:56:18.8988851 [E:onnxruntime:Default, provider_bridge_ort.cc:1978 onnxruntime::TryGetProviderInfo_TensorRT] D:\a_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1637 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "D:\ComfyUI_Windows_portable\python_embeded\Lib\site-packages\onnxruntime\capi\onnxruntime_providers_tensorrt.dll"

*************** EP Error *************** EP Error D:\a_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:490 onnxruntime::python::RegisterTensorRTPluginsAsCustomOps Please install TensorRT libraries as mentioned in the GPU requirements page, make sure they're in the PATH or LD_LIBRARY_PATH, and that your GPU is supported. when using ['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider'] Falling back to ['CUDAExecutionProvider', 'CPUExecutionProvider'] and retrying.


2024-10-07 15:56:21.2322045 [E:onnxruntime:Default, provider_bridge_ort.cc:1978 onnxruntime::TryGetProviderInfo_TensorRT] D:\a_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1637 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "D:\ComfyUI_Windows_portable\python_embeded\Lib\site-packages\onnxruntime\capi\onnxruntime_providers_tensorrt.dll"

*************** EP Error *************** EP Error D:\a_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:490 onnxruntime::python::RegisterTensorRTPluginsAsCustomOps Please install TensorRT libraries as mentioned in the GPU requirements page, make sure they're in the PATH or LD_LIBRARY_PATH, and that your GPU is supported. when using ['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider'] Falling back to ['CUDAExecutionProvider', 'CPUExecutionProvider'] and retrying.


2024-10-07 15:56:22.8107869 [E:onnxruntime:Default, provider_bridge_ort.cc:1978 onnxruntime::TryGetProviderInfo_TensorRT] D:\a_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1637 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "D:\ComfyUI_Windows_portable\python_embeded\Lib\site-packages\onnxruntime\capi\onnxruntime_providers_tensorrt.dll"

*************** EP Error *************** EP Error D:\a_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:490 onnxruntime::python::RegisterTensorRTPluginsAsCustomOps Please install TensorRT libraries as mentioned in the GPU requirements page, make sure they're in the PATH or LD_LIBRARY_PATH, and that your GPU is supported. when using ['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider'] Falling back to ['CUDAExecutionProvider', 'CPUExecutionProvider'] and retrying.


2024-10-07 15:56:24.3039914 [E:onnxruntime:Default, provider_bridge_ort.cc:1978 onnxruntime::TryGetProviderInfo_TensorRT] D:\a_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1637 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "D:\ComfyUI_Windows_portable\python_embeded\Lib\site-packages\onnxruntime\capi\onnxruntime_providers_tensorrt.dll"

*************** EP Error *************** EP Error D:\a_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:490 onnxruntime::python::RegisterTensorRTPluginsAsCustomOps Please install TensorRT libraries as mentioned in the GPU requirements page, make sure they're in the PATH or LD_LIBRARY_PATH, and that your GPU is supported. when using ['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider'] Falling back to ['CUDAExecutionProvider', 'CPUExecutionProvider'] and retrying.


!!! Exception during processing !!! instance mode - pos must have shape [>0, >0, 4] Exception raised from rasterize_fwd_cuda at D:\ComfyUI_Windows_portable\python_embeded\Lib\site-packages\nvdiffrast\torch\torch_rasterize.cpp:62 (most recent call first): 00007FFF41CA462900007FFF41CA4580 c10.dll!c10::Error::Error [ @ ] 00007FFF41CA416A00007FFF41CA4110 c10.dll!c10::detail::torchCheckFail [ @ ] 00007FFF67341B5500007FFF673044D0 nvdiffrast_plugin.pyd!PyInit_nvdiffrast_plugin [ @ ] 00007FFF6730EE1300007FFF673044D0 nvdiffrast_plugin.pyd!PyInit_nvdiffrast_plugin [ @ ] 00007FFF6730DFE200007FFF673044D0 nvdiffrast_plugin.pyd!PyInit_nvdiffrast_plugin [ @ ] 00007FFF673278FF00007FFF673044D0 nvdiffrast_plugin.pyd!PyInit_nvdiffrast_plugin [ @ ] 00007FFF6730506F00007FFF673044D0 nvdiffrast_plugin.pyd!PyInit_nvdiffrast_plugin [ @ ] 00007FFF67333E4E00007FFF673044D0 nvdiffrast_plugin.pyd!PyInit_nvdiffrast_plugin [ @ ] 00007FFF647882BE00007FFF64788060 python311.dll!PyObject_MakeTpCall [ @ ] 00007FFF6478BDDF00007FFF6478BB50 python311.dll!PyObject_Vectorcall [ @ ] 00007FFF6478D42300007FFF6478CC20 python311.dll!PyEval_EvalFrameDefault [ @ ] 00007FFF6478AE6400007FFF6478ACC0 python311.dll!PyFunction_Vectorcall [ @ ] 00007FFF6483507300007FFF64835018 python311.dll!PyObject_Call [ @ ] 00007FFE42C5134100007FFE42C3DE40 torch_python.dll!THPPointer<_frame>::THPPointer<_frame> [ @ ] 00007FFF647B75F500007FFF647B7540 python311.dll!PyArg_Parse_SizeT [ @ ] 00007FFF648350C400007FFF64835018 python311.dll!PyObject_Call [ @ ] 00007FFF64834D4000007FFF648348EC python311.dll!PyObject_CallObject [ @ ] 00007FFF64791F7F00007FFF6478CC20 python311.dll!PyEval_EvalFrameDefault [ @ ] 00007FFF6478AE6400007FFF6478ACC0 python311.dll!PyFunction_Vectorcall [ @ ] 00007FFF64834C6A00007FFF648348EC python311.dll!PyObject_CallObject [ @ ] 00007FFF64791F7F00007FFF6478CC20 python311.dll!PyEval_EvalFrameDefault [ @ ] 00007FFF6478AE6400007FFF6478ACC0 python311.dll!PyFunction_Vectorcall [ @ ] 00007FFF647D5C2500007FFF647D3DC4 python311.dll!PyIter_Send [ @ ] 00007FFF64834C6A00007FFF648348EC python311.dll!PyObject_CallObject [ @ ] 00007FFF64791F7F00007FFF6478CC20 python311.dll!PyEval_EvalFrameDefault [ @ ] 00007FFF647D5AA500007FFF647D3DC4 python311.dll!PyIter_Send [ @ ] 00007FFF64834CF300007FFF648348EC python311.dll!PyObject_CallObject [ @ ] 00007FFF64791F7F00007FFF6478CC20 python311.dll!PyEval_EvalFrameDefault [ @ ] 00007FFF6478AE6400007FFF6478ACC0 python311.dll!PyFunction_Vectorcall [ @ ] 00007FFF64834CF300007FFF648348EC python311.dll!PyObject_CallObject [ @ ] 00007FFF64791F7F00007FFF6478CC20 python311.dll!PyEval_EvalFrameDefault [ @ ] 00007FFF6478AE6400007FFF6478ACC0 python311.dll!PyFunction_Vectorcall [ @ ] 00007FFF647D5C7F00007FFF647D3DC4 python311.dll!PyIter_Send [ @ ] 00007FFF6483507300007FFF64835018 python311.dll!PyObject_Call [ @ ] 00007FFF647F2AA000007FFF647F26EC python311.dll!PyInterpreterState_Delete [ @ ] 00007FFF647F2A0600007FFF647F26EC python311.dll!PyInterpreterState_Delete [ @ ] 00007FFFD002933300007FFFD0029290 ucrtbase.dll!recalloc [ @ ] 00007FFFD013257D00007FFFD0132560 KERNEL32.DLL!BaseThreadInitThunk [ @ ] 00007FFFD244AF2800007FFFD244AF00 ntdll.dll!RtlUserThreadStart [ @ ]

Traceback (most recent call last): File "D:\ComfyUI_Windows_portable\ComfyUI\execution.py", line 317, in execute output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\ComfyUI_Windows_portable\ComfyUI\execution.py", line 192, in get_output_data return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\ComfyUI_Windows_portable\ComfyUI\execution.py", line 169, in _map_node_over_list process_inputs(input_dict, i) File "D:\ComfyUI_Windows_portable\ComfyUI\execution.py", line 158, in process_inputs results.append(getattr(obj, func)(**inputs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\ComfyUI_Windows_portable\python_embeded\Lib\site-packages\torch\utils_contextlib.py", line 116, in decorate_context return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "D:\ComfyUI_Windows_portable\ComfyUI\custom_nodes\ComfyUI-3D-Pack\nodes.py", line 2490, in run_LRM mesh_out = lrm_model.extract_mesh( ^^^^^^^^^^^^^^^^^^^^^^^ File "D:\ComfyUI_Windows_portable\ComfyUI\custom_nodes\ComfyUI-3D-Pack\Gen_3D_Modules\InstantMesh\models\lrm.py", line 198, in extract_mesh uvs, mesh_tex_idx, gb_pos, tex_hard_mask = xatlas_uvmap( ^^^^^^^^^^^^^ File "D:\ComfyUI_Windows_portable\ComfyUI\custom_nodes\ComfyUI-3D-Pack\Gen_3D_Modules\InstantMesh\utils\mesh_util.py", line 176, in xatlas_uvmap rast, _ = dr.rasterize(ctx, uv_clip4, mesh_tex_idx.int(), (resolution, resolution)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\ComfyUI_Windows_portable\python_embeded\Lib\site-packages\nvdiffrast\torch\ops.py", line 310, in rasterize return _rasterize_func.apply(glctx, pos, tri, resolution, ranges, grad_db, -1) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\ComfyUI_Windows_portable\python_embeded\Lib\site-packages\torch\autograd\function.py", line 574, in apply return super().apply(*args, **kwargs) # type: ignore[misc] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\ComfyUI_Windows_portable\python_embeded\Lib\site-packages\nvdiffrast\torch\ops.py", line 248, in forward out, out_db = _get_plugin().rasterize_fwd_cuda(raster_ctx.cpp_wrapper, pos, tri, resolution, ranges, peeling_idx) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ RuntimeError: instance mode - pos must have shape [>0, >0, 4] Exception raised from rasterize_fwd_cuda at D:\ComfyUI_Windows_portable\python_embeded\Lib\site-packages\nvdiffrast\torch\torch_rasterize.cpp:62 (most recent call first): 00007FFF41CA462900007FFF41CA4580 c10.dll!c10::Error::Error [ @ ] 00007FFF41CA416A00007FFF41CA4110 c10.dll!c10::detail::torchCheckFail [ @ ] 00007FFF67341B5500007FFF673044D0 nvdiffrast_plugin.pyd!PyInit_nvdiffrast_plugin [ @ ] 00007FFF6730EE1300007FFF673044D0 nvdiffrast_plugin.pyd!PyInit_nvdiffrast_plugin [ @ ] 00007FFF6730DFE200007FFF673044D0 nvdiffrast_plugin.pyd!PyInit_nvdiffrast_plugin [ @ ] 00007FFF673278FF00007FFF673044D0 nvdiffrast_plugin.pyd!PyInit_nvdiffrast_plugin [ @ ] 00007FFF6730506F00007FFF673044D0 nvdiffrast_plugin.pyd!PyInit_nvdiffrast_plugin [ @ ] 00007FFF67333E4E00007FFF673044D0 nvdiffrast_plugin.pyd!PyInit_nvdiffrast_plugin [ @ ] 00007FFF647882BE00007FFF64788060 python311.dll!PyObject_MakeTpCall [ @ ] 00007FFF6478BDDF00007FFF6478BB50 python311.dll!PyObject_Vectorcall [ @ ] 00007FFF6478D42300007FFF6478CC20 python311.dll!PyEval_EvalFrameDefault [ @ ] 00007FFF6478AE6400007FFF6478ACC0 python311.dll!PyFunction_Vectorcall [ @ ] 00007FFF6483507300007FFF64835018 python311.dll!PyObject_Call [ @ ] 00007FFE42C5134100007FFE42C3DE40 torch_python.dll!THPPointer<_frame>::THPPointer<_frame> [ @ ] 00007FFF647B75F500007FFF647B7540 python311.dll!PyArg_Parse_SizeT [ @ ] 00007FFF648350C400007FFF64835018 python311.dll!PyObject_Call [ @ ] 00007FFF64834D4000007FFF648348EC python311.dll!PyObject_CallObject [ @ ] 00007FFF64791F7F00007FFF6478CC20 python311.dll!PyEval_EvalFrameDefault [ @ ] 00007FFF6478AE6400007FFF6478ACC0 python311.dll!PyFunction_Vectorcall [ @ ] 00007FFF64834C6A00007FFF648348EC python311.dll!PyObject_CallObject [ @ ] 00007FFF64791F7F00007FFF6478CC20 python311.dll!PyEval_EvalFrameDefault [ @ ] 00007FFF6478AE6400007FFF6478ACC0 python311.dll!PyFunction_Vectorcall [ @ ] 00007FFF647D5C2500007FFF647D3DC4 python311.dll!PyIter_Send [ @ ] 00007FFF64834C6A00007FFF648348EC python311.dll!PyObject_CallObject [ @ ] 00007FFF64791F7F00007FFF6478CC20 python311.dll!PyEval_EvalFrameDefault [ @ ] 00007FFF647D5AA500007FFF647D3DC4 python311.dll!PyIter_Send [ @ ] 00007FFF64834CF300007FFF648348EC python311.dll!PyObject_CallObject [ @ ] 00007FFF64791F7F00007FFF6478CC20 python311.dll!PyEval_EvalFrameDefault [ @ ] 00007FFF6478AE6400007FFF6478ACC0 python311.dll!PyFunction_Vectorcall [ @ ] 00007FFF64834CF300007FFF648348EC python311.dll!PyObject_CallObject [ @ ] 00007FFF64791F7F00007FFF6478CC20 python311.dll!PyEval_EvalFrameDefault [ @ ] 00007FFF6478AE6400007FFF6478ACC0 python311.dll!PyFunction_Vectorcall [ @ ] 00007FFF647D5C7F00007FFF647D3DC4 python311.dll!PyIter_Send [ @ ] 00007FFF6483507300007FFF64835018 python311.dll!PyObject_Call [ @ ] 00007FFF647F2AA000007FFF647F26EC python311.dll!PyInterpreterState_Delete [ @ ] 00007FFF647F2A0600007FFF647F26EC python311.dll!PyInterpreterState_Delete [ @ ] 00007FFFD002933300007FFFD0029290 ucrtbase.dll!recalloc [ @ ] 00007FFFD013257D00007FFFD0132560 KERNEL32.DLL!BaseThreadInitThunk [ @ ] 00007FFFD244AF2800007FFFD244AF00 ntdll.dll!RtlUserThreadStart [ @ ]

Prompt executed in 429.09 seconds

image

Thanks for your care.

JimWang151 avatar Oct 07 '24 07:10 JimWang151

Hi @JimWang151 I just checked it, and I can run the workflow without error. Can I ask what kind GPU you are using, also I'm not sure why the error message mentioned onnxruntime. Moreover, please check if you installed Visual Studio Build Tools 2022/2019 with Workloads: Desktop development with C++ (There are a few JIT torch cpp extension that builds in runtime)

MrForExample avatar Oct 17 '24 21:10 MrForExample