ebsynth icon indicating copy to clipboard operation
ebsynth copied to clipboard

Image sequence

Open jounih opened this issue 5 years ago • 9 comments

What parameters do I need to use in the CLI to use this with an image sequence? The precompiled tool on ebsynth.com is great but I'd like to use the CLI version with cuda

jounih avatar Jul 11 '19 18:07 jounih

Also interested in this

babon avatar Jul 14 '19 17:07 babon

Yes, please enlighten us, I could really use this for art!

lazerozen avatar Jul 18 '19 07:07 lazerozen

I, too, would greatly appreciate this.

aparmar2000 avatar Aug 08 '19 02:08 aparmar2000

Hello all! It is a complicated question.

ebsynth.com is a much more complex framework for video stylization (It is not 100% true, but let's say that ebsynth.com uses this repo to do frame-by-frame stylization + it does some other tricks to make video consistent in time)

What you can do is to check this paper: https://dcgi.fel.cvut.cz/home/sykorad/Jamriska19-SIG.pdf, Figure 3 will give you some notion about what guide images you need to use to do the video stylization - so you can do some experiments. But it would be probably very hard to get similar quality results as ebsynth.com.

OndrejTexler avatar Sep 13 '19 21:09 OndrejTexler

Thanks a lot for the paper. And yes, generating these without help is surely not viable.

lazerozen avatar Sep 14 '19 14:09 lazerozen

Does anyone come out with a solution? @OndrejTexler can you provide us the windows executable code, so we can create the CLI solution?

balmacefa avatar Sep 24 '19 00:09 balmacefa

@balmacefa To the best of my knowledge, there is no open-source/CLI implementation I can share with you currently available

OndrejTexler avatar Sep 24 '19 17:09 OndrejTexler

Does anyone come out with a solution? @OndrejTexler can you provide us the windows executable code, so we can create the CLI solution?

The readme gives some guide image examples. The grayscale and mesh deformation aren't too hard (in another thread, Ondrej said the mesh doesn't need to be exact, but if you do want something more precise it shouldn't be hard to set this up with some modifiers in Blender). For the image segmentation, you can use OpenCV: https://docs.opencv.org/master/d3/db4/tutorial_py_watershed.html

Of course, the generated image segmentation might be too messy for your needs. In that case, Blender's camera tracking should let you pin custom shapes and colors over the important bits, and you can blur them to be subtler later.

revereche avatar Dec 12 '19 10:12 revereche

I wrote this tutorial it has some little flickers but it is quite similar to the interface result https://4232.cf/staying-fluent-with-ebsynth-de-flicker/

b4zz4 avatar Dec 03 '20 13:12 b4zz4