FaceVerse icon indicating copy to clipboard operation
FaceVerse copied to clipboard

how to mapping the PCA shape components to Apple 51 blendshapes?

Open lucasjinreal opened this issue 2 years ago • 7 comments

Does there any instructions on how to convert?

lucasjinreal avatar Apr 08 '22 02:04 lucasjinreal

I tried to build this conversion. But our model reconstructed from the East Asian faces is quite different with Apple's face model in the nose, eyes, etc. There is still some problems in this conversion. I will continue to try to solve this problem.

LizhenWangT avatar Apr 08 '22 02:04 LizhenWangT

@LizhenWangT that is promising! Are u trying using Apple's standared face model to fit FaceVerse's version? It seems once we have a dividable 52 shapes, and it's semantic meaning, we can mimick apple's behavior.

lucasjinreal avatar Apr 08 '22 02:04 lucasjinreal

Yes, that's just what I want to do. I'm trying to create the 52 FaceVerse shapes which are in the same expression with Apple's standard 52 blendshapes.

LizhenWangT avatar Apr 08 '22 05:04 LizhenWangT

@LizhenWangT I am hoping for your impressive result!

lucasjinreal avatar Apr 08 '22 06:04 lucasjinreal

@jinfagang This has been solved in version 2!

LizhenWangT avatar May 13 '22 12:05 LizhenWangT

@LizhenWangT Thanks your work, could you provide the related code about converting PCA shape components to Apple 51 blendshapes?

ForrestPi avatar May 31 '22 15:05 ForrestPi

@LizhenWangT Thanks your work, could you provide the related code about converting PCA shape components to Apple 51 blendshapes?

You can refer to this issue. It's more like a manul job rahter than coding.

LizhenWangT avatar May 31 '22 15:05 LizhenWangT