3D model jittering

[ahmedrasheed3995]

The model runs perfectly but I noticed there is a lot of jittering in the output. Is there any way to remove the jittering?

[Arthur151]

Thanks for your attension. If you can obtain the tracking results of each person, you can take advantage of OneEuro Filter to smooth the mesh.

[ahmedrasheed3995]

Thanks a lot for the reply, I'll try that. Meanwhile I tried applying savgol filter on estimated beta and pose values and it gave better results but only for single person. About tracking ,can you suggest which parameter I should track since there is no bounding box for persons. Thanks.

[Arthur151]

For ROMP, each estimated body center location is pointed to each person. The body center is supposed to be the center of torso (L/R shoulders and L/R hips). You can associate the estimated body center with the tracking results from other tracking-by-detection methods.

[ahmedrasheed3995]

Thanks a lot, will try that.

[Gowan1998]

Hallo @Arthur151, thanks for the great project! I also have the problem with jittering. Can you tell me how to call OneEuroFilter class in test.py ? Do I need to pass outputs['verts'] to OneEuroFilter ?

Best regards

[Arthur151]

Good question. If we want to optimize the temporal smoothness, we have to know the tracking results of multiple people. While currently released code lacks this part. We are developing this model. I will make sure it get released as soon as possible.

[Gowan1998]

@Arthur151 perfect. I look forward to seeing more of this great project

[Arthur151]

We have released the training code.