ComfyUI-CogVideoXWrapper icon indicating copy to clipboard operation
ComfyUI-CogVideoXWrapper copied to clipboard

Will CogVideoX 1.5 5b I2V ever support Tora?

Open ghost opened this issue 1 year ago • 2 comments

Thank you for all your work making CogVideoX 1.5 5b easy to use - it's much appreciated! I was wondering what the blockers are to getting Tora support 😊

ghost avatar Nov 21 '24 13:11 ghost

I've spent more than a day on the issue as I really like Tora, sadly it does not seem possible without re-training or training some sort of adapter for it. Reason is that Tora trajectories are created with same size patch_embeds than the 1.0 models use, but 1.5 uses very different patch_embeds and they just aren't compatible. For the same reason 1.0 controlnets won't work with 1.5.

kijai avatar Nov 21 '24 13:11 kijai

That is frustrating - thank you for all your work on it!

ghost avatar Nov 21 '24 15:11 ghost