open-vt icon indicating copy to clipboard operation
open-vt copied to clipboard

Implement Parameter Smoothing

Open erodozer opened this issue 2 months ago • 2 comments

Tracking with OpenSeeFace has notable jitter. VTS appears to have some degree of smoothing beyond simple frame interpolation in order to mitigate any noise in the tracking parameters between updates. Try to figure out an equivalent solution that is ideal for OSF data so that the jitter isn't as bad. Other tracking sources do not appear to suffer from the same problem, so it's clearly an issue rooted in how we're processing within just the OSF tracker.

erodozer avatar Nov 03 '25 05:11 erodozer

After messing around in VTS I realize that the jitter is handled by use of the smoothing parameter setting which currently is not implemented.

New goal is to implement noise filtering on parameter inputs.

Changing the ticket description

erodozer avatar Nov 12 '25 14:11 erodozer

Added one euro filtering in e6bf13acc818afc9ba4a55e201f1f5b93ec2ddbe but it's not having as significant of an impact on the motion as I hoped. Might need some tweaking, or there's something else happening that is affecting interpolation and making the model shake when using a camera that I don't see when using VTS

erodozer avatar Nov 14 '25 23:11 erodozer