Emiliana

I see, if they have RGB too, it should work!

The VMC protocol only transmits blendshapes and bones. OpenSeeFace's face tracking data is transmitted using custom UDP packets. It's probably easiest to understand from the parser: https://github.com/emilianavt/OpenSeeFace/blob/master/Unity/OpenSee.cs#L137 There is also...

If you are not familiar with python, the trickier part might be figuring out the decoding for the model's output. The current code for that is a bit dense and...

Thank you for the report. I'll look into it.

There does definitely seem something off, but like you noted, it's the code is a bit tricky and trying to adjust it in a simple way breaks things. I'll get...

Adding VMC protocol support to OpenSeeFace's face tracker itself would be difficult, because it requires the full skeleton from a 3D model, which in turn would require IK to animate...

If you have `/VMC/Ext/Bone/Pos` information, you just set the rotations and positions you receive to every bone's rotation and position value. For sending, you take each bone's rotation and position...

> For me it seems, that the bone values are based on the model. > So can i really just apply the tracking results for each bone? It depends on...

> Do mean the official VMC software? The protocol is called "VMC protocol", so I assumed the box labelled just "VMC" was referring to the software.

> According to the https://protocol.vmc.info/english#glossary it seems we don't need IK for VMC protocol support at all in OpenSeeFace, if we only implement it as an 'VMC Assistent'. You can...