mmhuman3d icon indicating copy to clipboard operation
mmhuman3d copied to clipboard

Published 20 hours ago • verified publisher icon open-mmlab

convert agora data and visual smpl is wrong?

Open Gzzgz opened this issue 2 years ago • 13 comments

I convert agora data , the result is like this: 图片 and I found ori data has 'Cam' folder and you not used it.

Gzzgz avatar Mar 04 '22 10:03 Gzzgz

the same as surreal dataset

Gzzgz avatar Mar 04 '22 12:03 Gzzgz

Maybe surreal datdaset has some errors.

Gzzgz avatar Mar 05 '22 04:03 Gzzgz

@Gzzgz Thanks for raising the issue!

For surreal, I found that some of the ground-truth were noisy/ wrong when I visualised them. For the issue you raised here (https://github.com/open-mmlab/mmhuman3d/issues/121), there is a problem of left-right of flipping 3d keypoints and smpl poses that has been confirmed by the author, which I will push up the fix soon. I also realised that the global orientation is wrong for some samples but I have yet to obtain a reply from the author for this.

For agora, I will take a look at it soon.

pangyyyyy avatar Mar 07 '22 12:03 pangyyyyy

@pangyyyyy OK, THX.

Gzzgz avatar Mar 07 '22 14:03 Gzzgz

？

Gzzgz avatar Mar 25 '22 02:03 Gzzgz

Hi @Gzzgz,I have pushed up the fix for AGORA's global orientation in PR #143. I've made some visualisations and the smpl poses looks correct now.

frame_000005(1) frame_000008(1) frame_000001(1)

For SURREAL, I have added the left-right flipping of 3d keypoints and smpl poses - a problem for the issue you raised here (#121) that has been confirmed by the author. However, I have yet to obtain any reply from SURREAL's authors regarding the incorrect global orientation.

pangyyyyy avatar Mar 30 '22 10:03 pangyyyyy

Hi, @pangyyyyy Could you give me an example visualization script for the converted agora dataset? Thanks!

YongtaoGe avatar Mar 31 '22 01:03 YongtaoGe

Hi, @pangyyyyy Could you give me an example visualization script for the converted agora dataset? Thanks!

We will have add a data visualizer tool for HumanData format soon ;)

caizhongang avatar Mar 31 '22 13:03 caizhongang

OK ， But I maybe found it has some errors . in training processing, the kpt3d-loss is bigger than not use it. And I vis just look like this:[some images are ok] 图片 图片 图片

And I checkout your codes that like agora dataset codes. I maybe think the agora-dataset code is wrong.

Gzzgz avatar Apr 21 '22 03:04 Gzzgz

I think this code should be like : 图片

But I found realy it has a little angle error in some images.like it: 图片

Gzzgz avatar Apr 22 '22 03:04 Gzzgz

@caizhongang can you doing it with SMPL or SMPLX in cam?

Gzzgz avatar Apr 24 '22 10:04 Gzzgz

Hello @Gzzgz, thanks for your inputs, the keypoints3d problem and incorrect global orientation problem is fixed in #202.

I've visualised more images of the converted annotations but they look alright to me. Do you mind providing an example of the annotation id for the problematic visualisations?

pangyyyyy avatar Jun 27 '22 05:06 pangyyyyy

@Gzzgz @caizhongang
Could you give me an example visualization script for the converted agora dataset? Thanks! The official visualization tools is too complex to visual single image results

John-Yao avatar Nov 22 '22 10:11 John-Yao