MagicDance icon indicating copy to clipboard operation
MagicDance copied to clipboard

Line 1112 ~ 1114 in model_lib/ControlNet/cldm/cldm.py

Open eastchun opened this issue 1 year ago • 0 comments

When running the inference_tiktok_dataset.sh script, pose_control_model (i.e., ControlNet) is running unnecessarily (in line 1112 ~ 1114 in cldm.py) for computing model_uncod.

When uc==False, ControlNetReferenceOnly --> ControlNet (pose_control_model) --> ControlledUnetModelAttnPose (OK)

When uc==True, ContorlNet (pose_control_model) (???) --> ControlledUnetModelAttnPose

For computing unconditional model output (model_uncond), ControlledUnetModelPoseAttn doesn't use pose_control output from the pose_control_model, and I don't understand why pose_control_model is running in advance with no purpose.

eastchun avatar Aug 25 '24 15:08 eastchun