SadTalker icon indicating copy to clipboard operation
SadTalker copied to clipboard

Control head move and blink eyes?

Open merecesarchviz opened this issue 3 years ago • 2 comments

it is possible to adjust this parameters?

because if we select remove head motion the character will not blink the eyes also! will be nice let the eyes blink

and about the head moving sometimes is to much! will be nice can control this

merecesarchviz avatar Apr 16 '23 16:04 merecesarchviz

Hi, we find eye blink/head motion coefficients will make an unstable paste back in full mode, so we remove them currently.

We will try to retrain the model for better performance.

vinthony avatar Apr 17 '23 02:04 vinthony

I came here wondering the same thing. Sometimes with a character looking directly at the viewer it's possible to get an animation in full mode that includes blinking and doesn't move the head too much causing the picture to kind of having that tearing effect like it sometimes does, but when you disable the movement then the blinking also goes away.

SadTalker is pretty awesome, and glad to hear you're improving the model even further.

james-s-tayler avatar Apr 21 '23 05:04 james-s-tayler

Hi, what does the blinking video expected to be? Should it be for the same image as the input image or any blinking video will do?

aruncambay avatar May 09 '23 10:05 aruncambay

Hi, what does the blinking video expected to be? Should it be for the same image as the input image or any blinking video will do?

any blinking video will do

Inferencer avatar May 09 '23 12:05 Inferencer

Thanks. I am getting an error while uploading the blinking video and trying to figure out what the reason could be. Should the duration of the blinking video match with that of the audio?

aruncambay avatar May 12 '23 05:05 aruncambay

Thanks. I am getting an error while uploading the blinking video and trying to figure out what the reason could be. Should the duration of the blinking video match with that of the audio?

it should loop the blinking vid if shorter than audio, what error are you getting?

Inferencer avatar May 12 '23 10:05 Inferencer

Hi, thanks for the reply, appreciate it! I am using the implementation on Replicate -- https://replicate.com/cjwbw/sadtalker and it says -'Path' object has no attribute 'split' when I try to upload any blinking video. Without that, it works fine. But, that's not useful for the application I am creating since it looks very unnatural without the blinking.

"

aruncambay avatar May 15 '23 02:05 aruncambay