mpfb2 icon indicating copy to clipboard operation
mpfb2 copied to clipboard

Shape keys for facial animation

Open IvailoBurov opened this issue 1 year ago • 3 comments

There are currently no shape keys available for mouth animation as in Makehuman. They are also missing for the eyes. The only way to do this is to use bones from the standard rig, but in this case the mixamo animations cannot be applied. This means that the exported model is not subject to facial animation, especially when using the Mixamo rig.

IvailoBurov avatar Jan 05 '24 10:01 IvailoBurov

There are two parts to this.

For getting a mixamo-compatible rig with facial bones, there is #127. This is on the todo list.

For shapekey-based animation with, for example, visemes, I would need help. The part that is missing is a set of targets for the shapes that are desired. I'm not good enough of an artist to design these. The shapekey data from MHX cannot be used for license reasons, so it would need to be redone (The MHX data files are GPL2 whereas MPFB promises all assets are CC0).

joepal1976 avatar Jan 05 '24 13:01 joepal1976

Ready Player Me models come with built-in visemes. They look correct and key shapes are used. https://readyplayer.me There are ready-made models for download in fbx format.

IvailoBurov avatar Jan 05 '24 15:01 IvailoBurov

If we can make the targets, there's a branch of Rhubarb lip-sync that's working with Blender 4 using actions. MPFB will blow other human animation plugins out of the water. Particularly if there's also a mixamo rig with a rigify face. Game over even for paid generators, I think. I don't use paid generators, so can't say for sure.

Vidyut avatar May 07 '24 11:05 Vidyut