AniPortrait icon indicating copy to clipboard operation
AniPortrait copied to clipboard

Audio2video any hints on lip sync

Open fralik opened this issue 1 year ago • 3 comments

I am using audio2video script with a song, i.e. audio contains music and voice. The produced video doesn't have any lip movement. On the face mesh I can see small lip movement, but not on the image. Any hints on improving this?

Could it be because of default pose_temp?

fralik avatar Mar 30 '24 10:03 fralik

pose_temp only provides head pose. And large amplitude mouth movements would result in improved lip synchronization in the generated video.

Zejun-Yang avatar Apr 01 '24 08:04 Zejun-Yang