onediff icon indicating copy to clipboard operation
onediff copied to clipboard

Does not work with PAG

Open thefoxfarmer opened this issue 1 year ago • 1 comments

Describe the bug

When I enabled OneDiff in my PAG workflow, my sampling speed went down dramatically—from around five iterations per second to around 15 seconds per iteration—and an error is printed between each step.

Your environment

macOS 14.5

OneDiff git commit id

4b35dc2a8d53c3122862b51cc69c66f59738b407

OneFlow version info if you have installed oneflow

(venv) (floppy onediff/ 0 5174)$ python -m oneflow --doctor libibverbs not available, ibv_fork_init skipped path: ['/home/ff/ComfyUI/venv/lib/python3.10/site-packages/oneflow'] version: 0.9.1.dev20240720+cu118 git_commit: dcaba7d cmake_build_type: Release rdma: True mlir: True enterprise: False

How To Reproduce

Steps to reproduce the behavior(or script): Insert a PerturbedAttentionGuidance node (part of core ComfyUI for a minute now iirc) between the checkpoint loader and the sampler along with the Model Speedup node. The order of the PerturbedAttentionGuidance and Model Speedup nodes relative to each other does not seem to matter.

The complete error message

 16%|█████████████████████████████▊
| 4/25 [00:56<04:50, 13.82s/it]WARNING [2024-07-20 21:21:49] /home/ff/ComfyUI/venv/lib/python3.10/site-packages/onediff/infer_compiler/backends/oneflow/args_tree_util.py:59 - Input structure key bbd11e to a8294e has changed. Resetting the deployable module graph. This may slow down the process.

thefoxfarmer avatar Jul 21 '24 04:07 thefoxfarmer

Could you please provide a detailed reproduction of the workflow? Such as json or images that can be imported

lijunliangTG avatar Jul 22 '24 02:07 lijunliangTG