stable-diffusion-webui icon indicating copy to clipboard operation
stable-diffusion-webui copied to clipboard

Published 20 hours ago • verified publisher icon AUTOMATIC1111

Advanced Seed Blending/Travel (more than 2 seeds)

Open amotile opened this issue 2 years ago • 5 comments

Is your feature request related to a problem? Please describe. I'm working on an animation tool and I'm looking at adding seed travel to it. Currently it's possible to blend from seedA -> seedB. But I think I'm going to want to to do a bit more advanced blending. a simple example would be.

  • blend from seedA -> seedB but only half way. and then blend towards seedC until we're 100% seedC.
  • But we never fully reached seedB

Describe the solution you'd like I think a system similar to the prompt blending would work here. example of some seed blends: Simple A -> B, equivalent to what's possible now. 1111:0.2|2222:0.8

A+B -> C {1111|2222}:0.2|3333:0.8

A+B+C with arbitrary weight 1111:2|2222:4|3333:10

UI could maybe be an additional textfield when "extra" is displayed.

Describe alternatives you've considered Hack it in myself. But before I embark on that I figured it would be good to collect some thoughts around it.

Additional context Hopefully this system would allow you to take any prompts you like and blend them together in whatever combination you like. It is however possible that this would not be as useful as I hope.

amotile avatar Oct 04 '22 08:10 amotile

I have a rough prototype working locally now. In this video one can see how the first loop I do the traditional Seed->Seed. But on the second loop I divert to a third seed before reaching the end of the first travel.

https://www.youtube.com/watch?v=ToGs7lmncuI

amotile avatar Oct 06 '22 22:10 amotile

@amotile looking great

ClashSAN avatar Oct 08 '22 10:10 ClashSAN

Turns out I managed to get this to work as a custom script. With some elbow grease it's possible to do quite a bit of hijacking of the code.

https://github.com/amotile/stable-diffusion-backend/blob/master/src/process/implementations/automatic1111_scripts/advanced_seed_blending.py

amotile avatar Oct 08 '22 12:10 amotile

@amotile hi. I don't know if the script is as plug and play, the main repo, or something to compliment https://github.com/amotile/stable-diffusion-backend I would like to add this to custom scripts wiki section. I would like to know your thoughts.

ClashSAN avatar Oct 30 '22 11:10 ClashSAN

It should be plug and play as far as I know. Both this one and the other script in that folder.

amotile avatar Oct 30 '22 18:10 amotile