ebsynth
ebsynth copied to clipboard
Image sequence
What parameters do I need to use in the CLI to use this with an image sequence? The precompiled tool on ebsynth.com is great but I'd like to use the CLI version with cuda
Also interested in this
Yes, please enlighten us, I could really use this for art!
I, too, would greatly appreciate this.
Hello all! It is a complicated question.
ebsynth.com is a much more complex framework for video stylization (It is not 100% true, but let's say that ebsynth.com uses this repo to do frame-by-frame stylization + it does some other tricks to make video consistent in time)
What you can do is to check this paper: https://dcgi.fel.cvut.cz/home/sykorad/Jamriska19-SIG.pdf, Figure 3 will give you some notion about what guide images you need to use to do the video stylization - so you can do some experiments. But it would be probably very hard to get similar quality results as ebsynth.com.
Thanks a lot for the paper. And yes, generating these without help is surely not viable.
Does anyone come out with a solution? @OndrejTexler can you provide us the windows executable code, so we can create the CLI solution?
@balmacefa To the best of my knowledge, there is no open-source/CLI implementation I can share with you currently available
Does anyone come out with a solution? @OndrejTexler can you provide us the windows executable code, so we can create the CLI solution?
The readme gives some guide image examples. The grayscale and mesh deformation aren't too hard (in another thread, Ondrej said the mesh doesn't need to be exact, but if you do want something more precise it shouldn't be hard to set this up with some modifiers in Blender). For the image segmentation, you can use OpenCV: https://docs.opencv.org/master/d3/db4/tutorial_py_watershed.html
Of course, the generated image segmentation might be too messy for your needs. In that case, Blender's camera tracking should let you pin custom shapes and colors over the important bits, and you can blur them to be subtler later.
I wrote this tutorial it has some little flickers but it is quite similar to the interface result https://4232.cf/staying-fluent-with-ebsynth-de-flicker/