deforum-art
[Feature Request]: Add Ebsynth to Deforum
Is there an existing issue for this?
- [X] I have searched the existing issues and checked the recent builds/commits
What would your feature do ?
Deforum is a very nice way to make movement-syncing animations. With additions we already have, such as the Hybrid mode, prompt and all parameter keyframing it would be an awesome addition.
Example implementation for the webui: https://github.com/s9roll7/ebsynth_utility.
Proposed workflow
- Go to the tab named Ebsynth
- Setup all the params for Ebsynth
- Setup the rest of animation parameters
- Press 'Generate'
- Enjoy the movement-synchronized animation!
Additional information
No response
Are you going to help adding it?
Surely
now I just gotta find time haha, I think this weekend I should be free for taking a look into this
Took some time to look into this and I am a bit confused on what we are trying to do exactly. How would this exist ideally? I see that this works like a retexturing tool overall, however I am a bit unsure where in the pipeline it sits. As currently the example implementation requires you to run the ebsynth at step 6 manually. Do we want to automate this step? We can probably do this with https://github.com/jamriska/ebsynth version, however this is a cpp project, and would require a bit of messing with to allow us to interact with it via terminal or otherwise
So from my understanding we would need to have a few drawn frames for the original to work, but for the img-2-img version it looks like those are getting generated. Do we want to have both options?
https://github.com/s9roll7/ebsynth_utility/blob/main/imgs/clipseg.png Stage 6 is talked about more clearly on the bottom right
Or am I misunderstanding this and we are supposed to run this after, in which case we can do this as a post process that we generate all the parts for, then run the .exe