EasyMocap icon indicating copy to clipboard operation
EasyMocap copied to clipboard

question about smpl issue (smpl twisted in some frames)

Open leilaUEA opened this issue 3 years ago • 5 comments

I have used a 3 camera dataset as an input, the smpl model in most of the frames are fine, in some frames it get twisted, does it happen because of openpose problem and occolusion?I wonder if we have two camera on each side (i.e. 5 cameras instead of 3) that would solve the issue?

here is smpl reprojection of continuous frames, the left arm openpose key points are miscalculated in the second camera for few frames

000438 000439 000440 000441 000442 000443 000444 000445 000446 000447 000448

000438 000439 000440 000441 000442 000443 000444 000445 000446 000447 000448

leilaUEA avatar Dec 10 '21 14:12 leilaUEA

first camera: 000438_rendered 000439_rendered 000440_rendered 000441_rendered 000442_rendered 000443_rendered 000444_rendered 000445_rendered 000446_rendered 000447_rendered 000448_rendered

leilaUEA avatar Dec 10 '21 14:12 leilaUEA

second camera 000438_rendered 000439_rendered 000440_rendered 000441_rendered 000442_rendered 000443_rendered 000444_rendered 000445_rendered 000446_rendered 000447_rendered 000448_rendered

leilaUEA avatar Dec 10 '21 15:12 leilaUEA

third camera 000438_rendered 000439_rendered 000440_rendered 000441_rendered 000442_rendered 000443_rendered 000444_rendered 000445_rendered 000446_rendered 000447_rendered 000448_rendered

leilaUEA avatar Dec 10 '21 15:12 leilaUEA

It seems that the optimization falls into local optimal and generates a bad result.

chingswy avatar Dec 11 '21 14:12 chingswy

it was also mentionedif model is smpl the optimization doesn't use nose keypoints, don't know if it affected the result

leilaUEA avatar Dec 11 '21 17:12 leilaUEA

Maybe fixed in current version.

chingswy avatar Nov 12 '22 14:11 chingswy