onediff
onediff copied to clipboard
siliconflow
webui中使用regional-prompter插件时编译模型报错
在webui中使用regional-prompter插件，编译模型时会报错。 插件地址：https://github.com/hako-mikan/sd-webui-regional-prompter 插件有2种模式，分别是 Attention 和 Latent 其中Latent模式可以使用onediff加速 Attention模式在加载模型时会报错，错误内容如下
(venv) [root@VM-0-64-centos stable-diffusion-webui]# sh webui.sh -f --no-half-vae --skip-install --listen --port 7863 --disable-safe-unpickle --skip-version-check --controlnet-annotator-models-path /aigc_dev/stable-diffusion-webui/models/ --enable-insecure-extension-access
################################################################ Install script for stable-diffusion + Web UI Tested on Debian 11 (Bullseye) ################################################################
################################################################ Running on root user ################################################################
################################################################ Repo already cloned, using it as install directory ################################################################
################################################################ python venv already activate or run without venv: /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/venv ################################################################
################################################################
Launching launch.py...
################################################################
Cannot locate TCMalloc (improves CPU memory usage)
Python 3.10.9 (main, Mar 1 2023, 18:23:06) [GCC 11.2.0]
Version: v1.7.0
Commit hash: cf2772fab0af5573da775e7437e6acdca424f26e
Launching Web UI with arguments: -f --no-half-vae --skip-install --listen --port 7863 --disable-safe-unpickle --skip-version-check --controlnet-annotator-models-path /aigc_dev/stable-diffusion-webui/models/ --enable-insecure-extension-access
No module 'xformers'. Proceeding without it.
Style database not found: /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/styles.csv
[-] ADetailer: Failed to load model 'face_yolov8n.pt' from huggingface
[-] ADetailer initialized. version: 24.3.0, num models: 14
WARNING [2024-04-29 13:49:23] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/manager.py:119 - Pydantic version 1.10.13 is too low, please upgrade to 2.5.2 or higher.
WARNING [2024-04-29 13:49:24] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/dyn_mock_mod.py:187 - Failed to update obj_entity in place. Exception: Not support <function CondFunc.new.
To create a public link, set share=True in launch().
Startup time: 47.0s (prepare environment: 3.7s, import torch: 6.6s, import gradio: 2.2s, setup paths: 3.2s, initialize shared: 5.4s, other imports: 1.7s, setup codeformer: 0.3s, list SD models: 0.2s, load scripts: 21.5s, create ui: 1.7s, gradio launch: 0.3s).
Creating model from config: /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/repositories/generative-models/configs/inference/sd_xl_base.yaml
Applying attention optimization: Doggettx... done.
Model loaded in 4.7s (load weights from disk: 2.0s, create model: 0.4s, apply weights to model: 1.2s, calculate empty prompt: 0.9s).
1;1;1 0.2 Horizontal
Token indices sequence length is longer than the specified maximum sequence length for this model (439 > 77). Running this sequence through the model will result in indexing errors
Token indices sequence length is longer than the specified maximum sequence length for this model (439 > 77). Running this sequence through the model will result in indexing errors
Regional Prompter Active, Pos tokens : [1, 3], Neg tokens : [444]
0%| | 0/5 [00:00<?, ?it/s]WARNING [2024-04-29 13:50:11] /aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/dyn_mock_mod.py:187 - Failed to update obj_entity in place. Exception: Not support <function CondFunc.new.
*** [[ 64, 128, 128], *** [ 64, 128, 128], *** [ 64, 128, 128], *** ..., *** [ 64, 128, 128], *** [ 64, 128, 128], *** [255, 255, 255]],
*** [[ 64, 128, 128], *** [ 64, 128, 128], *** [ 64, 128, 128], *** ..., *** [ 64, 128, 128], *** [ 64, 128, 128], *** [255, 255, 255]],
*** ...,
*** [[ 64, 128, 128], *** [ 64, 128, 128], *** [ 64, 128, 128], *** ..., *** [ 64, 128, 128], *** [ 64, 128, 128], *** [255, 255, 255]],
*** [[ 64, 128, 128], *** [ 64, 128, 128], *** [ 64, 128, 128], *** ..., *** [ 64, 128, 128], *** [ 64, 128, 128], *** [255, 255, 255]],
*** [[255, 255, 255], *** [255, 255, 255], *** [255, 255, 255], *** ..., *** [255, 255, 255], *** [255, 255, 255], *** [255, 255, 255]]], dtype=uint8), 'mask': array([[[0, 0, 0], *** [0, 0, 0], *** [0, 0, 0], *** ..., *** [0, 0, 0], *** [0, 0, 0], *** [0, 0, 0]],
*** [[0, 0, 0], *** [0, 0, 0], *** [0, 0, 0], *** ..., *** [0, 0, 0], *** [0, 0, 0], *** [0, 0, 0]],
*** [[0, 0, 0], *** [0, 0, 0], *** [0, 0, 0], *** ..., *** [0, 0, 0], *** [0, 0, 0], *** [0, 0, 0]],
*** ...,
*** [[0, 0, 0], *** [0, 0, 0], *** [0, 0, 0], *** ..., *** [0, 0, 0], *** [0, 0, 0], *** [0, 0, 0]],
*** [[0, 0, 0], *** [0, 0, 0], *** [0, 0, 0], *** ..., *** [0, 0, 0], *** [0, 0, 0], *** [0, 0, 0]],
*** [[0, 0, 0], *** [0, 0, 0], *** [0, 0, 0], *** ..., *** [0, 0, 0], *** [0, 0, 0], *** [0, 0, 0]]], dtype=uint8)}, '0', '0', False, False, False, 'positive', 'comma', 0, False, False, 'start', '', 1, '', [], 0, '', [], 0, '', [], True, False, False, False, 0, False, '\n
\n If you need Enterprise Level Support for your system or business, please send an email to \n [email protected].\n
\n Tell us about your use case, deployment scale, and requirements.\n
\n GitHub Issue:\n https://github.com/siliconflow/onediff/issues\n
\nDuring handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 215, in init
self.__dict__[k] = torch2oflow(attr)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'function'>: 'function' object has no attribute '<locals>'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
result = dispatcher(first_param, *args, **kwargs)
File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
return dispatch(args[0].__class__)(*args, **kw)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 238, in _
of_mod = of_mod_cls()
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 218, in init
raise NotImplementedError(f"Unsupported type: {type(attr)}")
NotImplementedError: Unsupported type: <class 'function'>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
result = dispatcher(first_param, *args, **kwargs)
File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
return dispatch(args[0].__class__)(*args, **kw)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 238, in _
of_mod = of_mod_cls()
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 209, in init
self._modules[n] = torch2oflow(m)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
result = dispatcher(first_param, *args, **kwargs)
File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
return dispatch(args[0].__class__)(*args, **kw)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 352, in _
submod = torch2oflow(original_submod, verbose)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
result = dispatcher(first_param, *args, **kwargs)
File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
return dispatch(args[0].__class__)(*args, **kw)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 238, in _
of_mod = of_mod_cls()
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 209, in init
self._modules[n] = torch2oflow(m)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
result = dispatcher(first_param, *args, **kwargs)
File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
return dispatch(args[0].__class__)(*args, **kw)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 362, in _
submod = torch2oflow(original_submod, verbose)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
result = dispatcher(first_param, *args, **kwargs)
File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
return dispatch(args[0].__class__)(*args, **kw)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 352, in _
submod = torch2oflow(original_submod, verbose)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
result = dispatcher(first_param, *args, **kwargs)
File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
return dispatch(args[0].__class__)(*args, **kw)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 238, in _
of_mod = of_mod_cls()
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 209, in init
self._modules[n] = torch2oflow(m)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/utils.py", line 21, in wrapper
return func(self, *args, **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/utils/graph_management_utils.py", line 91, in wrapper
ret = func(self, *args, **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 97, in forward
dpl_graph = self.get_graph()
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 63, in get_graph
self._deployable_module_model.oneflow_module,
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/dual_module.py", line 30, in oneflow_module
self._oneflow_module = torch2oflow(self._torch_module)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.UNetModel'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
result = dispatcher(first_param, *args, **kwargs)
File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
return dispatch(args[0].__class__)(*args, **kw)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 467, in _
return transform_mgr.transform_func(func)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/manager.py", line 102, in transform_func
return self._transform_entity(func)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/manager.py", line 59, in _transform_entity
result = self.mocker.mock_entity(entity)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/importer.py", line 94, in mock_entity
return self.load_entity_with_mock(entity)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/import_tools/importer.py", line 132, in load_entity_with_mock
mock_pkg = getattr(mock_pkg, name)
AttributeError: 'function' object has no attribute '<locals>'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 215, in init
self.__dict__[k] = torch2oflow(attr)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'function'>: 'function' object has no attribute '<locals>'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
result = dispatcher(first_param, *args, **kwargs)
File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
return dispatch(args[0].__class__)(*args, **kw)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 238, in _
of_mod = of_mod_cls()
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 218, in init
raise NotImplementedError(f"Unsupported type: {type(attr)}")
NotImplementedError: Unsupported type: <class 'function'>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
result = dispatcher(first_param, *args, **kwargs)
File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
return dispatch(args[0].__class__)(*args, **kw)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 238, in _
of_mod = of_mod_cls()
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 209, in init
self._modules[n] = torch2oflow(m)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
result = dispatcher(first_param, *args, **kwargs)
File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
return dispatch(args[0].__class__)(*args, **kw)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 352, in _
submod = torch2oflow(original_submod, verbose)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
result = dispatcher(first_param, *args, **kwargs)
File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
return dispatch(args[0].__class__)(*args, **kw)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 238, in _
of_mod = of_mod_cls()
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 209, in init
self._modules[n] = torch2oflow(m)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
result = dispatcher(first_param, *args, **kwargs)
File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
return dispatch(args[0].__class__)(*args, **kw)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 362, in _
submod = torch2oflow(original_submod, verbose)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
result = dispatcher(first_param, *args, **kwargs)
File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
return dispatch(args[0].__class__)(*args, **kw)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 352, in _
submod = torch2oflow(original_submod, verbose)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 38, in wrapper
result = dispatcher(first_param, *args, **kwargs)
File "/root/anaconda3/lib/python3.10/functools.py", line 889, in wrapper
return dispatch(args[0].__class__)(*args, **kw)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 238, in _
of_mod = of_mod_cls()
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 209, in init
self._modules[n] = torch2oflow(m)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/call_queue.py", line 57, in f
res = list(func(*args, **kwargs))
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/call_queue.py", line 36, in f
res = func(*args, **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/txt2img.py", line 52, in txt2img
processed = modules.scripts.scripts_txt2img.run(p, *args)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/scripts.py", line 700, in run
processed = script.run(p, *script_args)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/extensions/onediff_sd_webui_extensions/scripts/onediff.py", line 216, in run
proc = process_images(p)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/processing.py", line 734, in process_images
res = process_images_inner(p)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/extensions/sd-webui-controlnet/scripts/batch_hijack.py", line 59, in processing_process_images_hijack
return getattr(processing, '__controlnet_original_process_images_inner')(p, *args, **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/processing.py", line 868, in process_images_inner
samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts) # 跳转到1139
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/processing.py", line 1142, in sample
samples = self.sampler.sample(self, x, conditioning, unconditional_conditioning, image_conditioning=self.txt2img_image_conditioning(x))
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_samplers_kdiffusion.py", line 235, in sample
samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_samplers_common.py", line 261, in launch_sampling
return func()
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_samplers_kdiffusion.py", line 235, in <lambda>
samples = self.launch_sampling(steps, lambda: self.func(self.model_wrap_cfg, x, extra_args=self.sampler_extra_args, disable=False, callback=self.callback_state, **extra_params_kwargs))
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/repositories/k-diffusion/k_diffusion/sampling.py", line 553, in sample_dpmpp_sde
denoised = model(x, sigmas[i] * s_in, **extra_args)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_samplers_cfg_denoiser.py", line 188, in forward
x_out[a:b] = self.inner_model(x_in[a:b], sigma_in[a:b], cond=make_condition_dict(c_crossattn, image_cond_in[a:b]))
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/repositories/k-diffusion/k_diffusion/external.py", line 112, in forward
eps = self.get_eps(input * c_in, self.sigma_to_t(sigma), **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/repositories/k-diffusion/k_diffusion/external.py", line 138, in get_eps
return self.inner_model.apply_model(*args, **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_models_xl.py", line 37, in apply_model
return self.model(x, t, cond)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_hijack_utils.py", line 17, in <lambda>
setattr(resolved_obj, func_path[-1], lambda *args, **kwargs: self(*args, **kwargs))
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/modules/sd_hijack_utils.py", line 28, in __call__
return self.__orig_func(*args, **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/repositories/generative-models/sgm/modules/diffusionmodules/wrappers.py", line 28, in forward
return self.diffusion_model(
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1538, in _call_impl
result = forward_call(*args, **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/utils/online_quantization_utils.py", line 48, in wrapper
output = func(self, *args, **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/utils/args_tree_util.py", line 50, in wrapper
output = func(self, *mapped_args, **mapped_kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/utils.py", line 27, in wrapper
return func(self, *args, **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/utils/graph_management_utils.py", line 91, in wrapper
ret = func(self, *args, **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 97, in forward
dpl_graph = self.get_graph()
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 63, in get_graph
self._deployable_module_model.oneflow_module,
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/dual_module.py", line 30, in oneflow_module
self._oneflow_module = torch2oflow(self._torch_module)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.UNetModel'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/utils/graph_management_utils.py", line 91, in wrapper
ret = func(self, *args, **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 97, in forward
dpl_graph = self.get_graph()
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 63, in get_graph
self._deployable_module_model.oneflow_module,
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/dual_module.py", line 30, in oneflow_module
self._oneflow_module = torch2oflow(self._torch_module)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.UNetModel'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
mpiler/utils/graph_management_utils.py", line 91, in wrapper ret = func(self, *args, **kwargs) File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 97, in forward dpl_graph = self.get_graph() File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 63, in get_graph self._deployable_module_model.oneflow_module, File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/dual_module.py", line 30, in oneflow_module self._oneflow_module = torch2oflow(self._torch_module) File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}") NotImplementedError: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.UNetModel'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
return func(self, *args, **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/utils/graph_management_utils.py", line 91, in wrapper
ret = func(self, *args, **kwargs)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 97, in forward
dpl_graph = self.get_graph()
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/deployable_module.py", line 63, in get_graph
self._deployable_module_model.oneflow_module,
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/oneflow/dual_module.py", line 30, in oneflow_module
self._oneflow_module = torch2oflow(self._torch_module)
File "/aigc_dev/jiajianglong/project/12.webui/stable-diffusion-webui/bak/onediff/src/onediff/infer_compiler/transform/builtin_transform.py", line 40, in wrapper
raise NotImplementedError(f"Transform failed of {type(first_param)}: {e}")
NotImplementedError: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.UNetModel'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.diffusionmodules.openaimodel.TimestepEmbedSequential'>: Transform failed of <class 'sgm.modules.attention.SpatialTransformer'>: Transform failed of <class 'torch.nn.modules.container.ModuleList'>: Transform failed of <class 'sgm.modules.attention.BasicTransformerBlock'>: Transform failed of <class 'sgm.modules.attention.CrossAttention'>: Unsupported type: <class 'function'>
