vpuppr icon indicating copy to clipboard operation
vpuppr copied to clipboard

Lip sync support

Open you-win opened this issue 4 years ago • 2 comments

Add lip sync support. This will likely need to be done as a GDNative library for performance reasons. Rust will probably be the implementation language.

uLipSync (MIT) can be used as a reference even though it's a Unity library.

godot-audio-processing Can be used as a reference for feeding data from Godot and maybe interpreting the lip synced data?

NOTE: There's no license for godot-audio-processing, but I did ask on Discord if I could use the repo as a reference Capture

personal fork of uLipSync

personal fork of godot-audio-processing

you-win avatar Dec 05 '21 06:12 you-win

@you-win

Would you be interested Text to Speech LipSync?

GeorgeS2019 avatar Jan 12 '22 07:01 GeorgeS2019

@GeorgeS2019 looks like #90 will be handling your request, as your request is more about TTS than lip syncing. This issue is tracking only lip sync support.

On that note, #88 implements basic lip sync support. I will need to add phoneme (viseme?) detection in a later PR.

you-win avatar Jan 12 '22 14:01 you-win