[Python] - Face Aligment || Face Normalization

[makingpippop]

Hi,

I'm using Mediapipe's FaceLandmarker to create rotoscoping masks around some face features, which work really great, now but I'm wondering how I could stabilize the footage/stream while analyzing it.

Best case, I'm looking for a way to do something something like this but It could also be a simpler stabilization:

I thought of using the transformation matrix available when setting output_facial_transformation_matrixes=True in the FaceLandmarkerOptions, but I can't seem to get my head around it. I understand that it is a 4x4 matrix as described here But I don't understand how or if I can use this matrix to 'cancel' out any movement making my subject as stable as possible.

Is there someone that could point me in a direction that could help me achieve what I'm looking for? Thanks a lot for your time!

[therealron]

Any updates on this?