AnimateDiff icon indicating copy to clipboard operation
AnimateDiff copied to clipboard

Feature Request: T2I Adapter Support

Open JustCann opened this issue 1 year ago • 5 comments

Hello,

I may be doing this incorrectly, but when I attempt to use T2I Adapters in CN the extension creates an animated gif but keeps the model frozen in place as if I was doing img2img. Is using T2I Adapters supported or am I doing something incorrectly?

Thanks!!

JustCann avatar Jan 25 '24 04:01 JustCann

Lower your strength and percents. It is almost like tile. It will fix it in place with minimal movement if your CN is too strong.

vicitooo avatar Jan 25 '24 09:01 vicitooo

Interesting... I had multiple going on, so the weight should be less than 1? I will try some more tests. Is running multiple CN a problem also?

JustCann avatar Jan 25 '24 13:01 JustCann

No, you can run as many CN as you want. The more CN and the higher the weights, the more stable the image is. It is a fine balance between stability and motion.

vicitooo avatar Jan 25 '24 17:01 vicitooo

I did what you recommended, this time I only used t2IAdapter depth and the same issue still occurred, no movement as compared to other CN.

JustCann avatar Jan 25 '24 18:01 JustCann

I am just coming to the conclusion that T2I is just not possible with AnimateDiff. If I wanted a still image, I would make one, the caveat is the generation time. :(

JustCann avatar Jun 15 '24 15:06 JustCann