Does not work with PAG
Describe the bug
When I enabled OneDiff in my PAG workflow, my sampling speed went down dramatically—from around five iterations per second to around 15 seconds per iteration—and an error is printed between each step.
Your environment
macOS 14.5
OneDiff git commit id
4b35dc2a8d53c3122862b51cc69c66f59738b407
OneFlow version info if you have installed oneflow
(venv) (floppy onediff/ 0 5174)$ python -m oneflow --doctor libibverbs not available, ibv_fork_init skipped path: ['/home/ff/ComfyUI/venv/lib/python3.10/site-packages/oneflow'] version: 0.9.1.dev20240720+cu118 git_commit: dcaba7d cmake_build_type: Release rdma: True mlir: True enterprise: False
How To Reproduce
Steps to reproduce the behavior(or script): Insert a PerturbedAttentionGuidance node (part of core ComfyUI for a minute now iirc) between the checkpoint loader and the sampler along with the Model Speedup node. The order of the PerturbedAttentionGuidance and Model Speedup nodes relative to each other does not seem to matter.
The complete error message
16%|█████████████████████████████▊
| 4/25 [00:56<04:50, 13.82s/it]WARNING [2024-07-20 21:21:49] /home/ff/ComfyUI/venv/lib/python3.10/site-packages/onediff/infer_compiler/backends/oneflow/args_tree_util.py:59 - Input structure key bbd11e to a8294e has changed. Resetting the deployable module graph. This may slow down the process.
Could you please provide a detailed reproduction of the workflow? Such as json or images that can be imported