magic-animate icon indicating copy to clipboard operation
magic-animate copied to clipboard

LCM sampler

Open Priestru opened this issue 1 year ago • 6 comments

https://github.com/magic-research/magic-animate/assets/108554892/590e4986-1859-4008-be58-9e82e97bf70f

This thing is 8 steps, guidance 4 with LCM trained checkpoint. Seems almost like usual generation with 25 steps. It should work a bit better if we use LCM sampler I guess. So how do we change sampler?

Priestru avatar Dec 05 '23 18:12 Priestru

Awesome, which LCM trained checkpoint did you use if you don't mind sharing?

NolenBrolen avatar Dec 06 '23 13:12 NolenBrolen

Awesome, which LCM trained checkpoint did you use if you don't mind sharing?

On civit.ai you can filter SD 1.5 LCM models and pick one. It's currently down so i can't give you a link.

Priestru avatar Dec 06 '23 17:12 Priestru

How did you change the SD 1.5 model? Do I have to create the entire pipeline out of it? Please tell me how you did it. Thanks

CyberTimon avatar Dec 06 '23 17:12 CyberTimon

On civit.ai you can filter SD 1.5 LCM models and pick one. It's currently down so i can't give you a link.

I found a dreamshaper_v7+LCM model on Huggingface, and also tried some other LCM 1.5 checkpoints, but when I run it with just 4-6 steps it doesn't look like the LCM is working very much, and the output looks terrible. Did you also update any of the files in Unet/text_encoder/tokeninzer/scheduler folders?

NolenBrolen avatar Dec 06 '23 20:12 NolenBrolen

how to use LCM? Pls

qijunf avatar Dec 21 '23 07:12 qijunf

@Priestru would be amazing if you could share how you used the LCM model! Just replacing the standard does not work..

Don-Chad avatar Dec 30 '23 14:12 Don-Chad