face-emo icon indicating copy to clipboard operation
face-emo copied to clipboard

Plugin will prevent the VRC Face Tracking Template from working properly.

Open Keropoi opened this issue 9 months ago • 12 comments

I found that when a project with EMO plugin, the Face Tracking controller layer won't working. As soon as I removed EMO from the project, Face Tracking just works again...

Keropoi avatar May 08 '24 11:05 Keropoi

Thank you for your report, I am currently looking into how face tracking layer and FaceEmo can work together. It would be helpful if you could tell me in which cases face tracking does not work (existing implementation tools, hand-made layers, etc.)

suzuryg avatar May 09 '24 03:05 suzuryg

If there was a way to toggle all animations off from FaceEmo to allow for Face Tracking to be function that would be awesome.

staringrail avatar Jun 12 '24 16:06 staringrail

Even in the current version of FaceEmo, all animations can be disabled by doing the following.

(1) Add CN_FORCE_BYPASS_ENABLE (synced bool) to Expression Parameters ExParam

(2) Add CN_FORCE_BYPASS_ENABLE toggle to Expression Menu ExMenu

suzuryg avatar Jun 12 '24 16:06 suzuryg

Even in the current version of FaceEmo, all animations can be disabled by doing the following.

(1) Add CN_FORCE_BYPASS_ENABLE (synced bool) to Expression Parameters ExParam

(2) Add CN_FORCE_BYPASS_ENABLE toggle to Expression Menu ExMenu

I've tried this method but it can't disable animations.

Keropoi avatar Jun 17 '24 16:06 Keropoi

Please confirm that the state of the DEFAULT FACE layer transitions to BYPASS when the toggle is enabled in Expressoin Menu. (The attached image shows how it looks in Gesture Manager.) bypass

suzuryg avatar Jun 21 '24 05:06 suzuryg

image image image Heres are my current settings, but I didn't see the BYPASS state in DEFAULT FACE layer(In play mode with Gusture Manager)

Keropoi avatar Jun 22 '24 18:06 Keropoi

Please update FaceEmo to the latest version (1.5.5) and apply it to your avatar again to create BYPASS state.

suzuryg avatar Jun 23 '24 06:06 suzuryg

Appreciate for your great help! As I disabled all the animations via CN_FORCE_BYPASS_ENABLE toggle.My face tracking works!! But I found an confusing point as well: If I don't use the EMO plugin, the original guesture facial animation won't conflict with my face tracking, the blender shape used by face tracking and guesture facial animation will simply added. 20240623161902_1 20240623162026_1

While I using the EMO, after I disabled all animations via CN_FORCE_BYPASS_ENABLE toggle, then try use the original guesture facial animation, Some blend shapes used by it will stucked, meanwhile my face tracking still work and cause my facial wired. 20240623162026_1

image image (GestureExpressionDisabled toggle all original guesture facial animations )

Keropoi avatar Jun 23 '24 08:06 Keropoi

If the original avatar's gesture expression assumes WriteDefaults ON, the blendshape used for the expression may stuck if WriteDefaults on the FX layer is mixed between ON and OFF. Make sure FaceEmo setting is set to "Unify WD".

wd

suzuryg avatar Jun 23 '24 08:06 suzuryg

image It's Unify WD by default

Keropoi avatar Jun 24 '24 18:06 Keropoi

Sorry, I can't figure out how to get that face tracking package to work properly.

Another way to use face tracking and FaceEmo together is to register blend shapes for face tracking in the "Excluded Blend Shapes" section, so you could try that as well.

ex

suzuryg avatar Jun 25 '24 07:06 suzuryg

This worked for me. Thank you.

staringrail avatar Jul 10 '24 04:07 staringrail