LivePortrait icon indicating copy to clipboard operation
LivePortrait copied to clipboard

Use JoyVASA to support audio-driven video generation

Open warmshao opened this issue 1 year ago • 3 comments

JoYVASA + LivePortrait can achieve audio-driven portrait animation, and it is quite interesting. haha

https://github.com/user-attachments/assets/dafb13ea-dff7-4574-98c4-92250f3468c9

I have incorporated it into FasterLivePortrait. Enjoy!

warmshao avatar Dec 15 '24 16:12 warmshao

https://github.com/user-attachments/assets/66021244-016f-45fb-adac-5f7f6e2d53fc

New version of JoyVASA, better lip sync

warmshao avatar Jan 13 '25 16:01 warmshao

s9.jpeg-s9.jpeg-865042464-1-192.wav.pkl-org-audio-ff.mp4 New version of JoyVASA, better lip sync

@warmshao The nose is a little strange 😂

cleardusk avatar Jan 13 '25 16:01 cleardusk

s9.jpeg-s9.jpeg-865042464-1-192.wav.pkl-org-audio-ff.mp4 New version of JoyVASA, better lip sync

@warmshao The nose is a little strange 😂

haha, only animate the lip region,i will try to animate exp region to see whether it will be better😂😂

warmshao avatar Jan 14 '25 00:01 warmshao