3DCrowdNet_RELEASE icon indicating copy to clipboard operation
3DCrowdNet_RELEASE copied to clipboard

3DPW_validation_crowd_hhrnet_result.json

Open zhLawliet opened this issue 2 years ago • 18 comments

@hongsukchoi i can‘t find the
3DPW_validation_crowd_hhrnet_result.json J_regressor_mi_smpl.npy
MuPoTs_test_hhrnet_result.json image

zhLawliet avatar Nov 09 '22 03:11 zhLawliet

The 3dpw_validation_crowd_hhrnet_result.json is in the 2DPose_Detection folder.

I didn't prepare the MuPoTs evaluation code in this repo, since it has few crowd scenarios and is not a in-the-wild dataset.

hongsukchoi avatar Nov 09 '22 18:11 hongsukchoi

thanks, can you  share the  J_regressor_mi_smpl.npy or  if i  want  to  compare  the value of mupots with you in my paper ,can i  use J_regress_h36m.py  instead?

---Original--- From: "Hongsuk @.> Date: Thu, Nov 10, 2022 02:56 AM To: @.>; Cc: @.@.>; Subject: Re: [hongsukchoi/3DCrowdNet_RELEASE]3DPW_validation_crowd_hhrnet_result.json (Issue #22)

The 3dpw_validation_crowd_hhrnet_result.json is in the 2DPose_Detection folder.

I didn't prepare the MuPoTs evaluation code in this repo, since it has few crowd scenarios and is not a in-the-wild dataset.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

zhLawliet avatar Nov 09 '22 21:11 zhLawliet

I can share it. I uploaded to the joint_regressor folder.

hongsukchoi avatar Nov 09 '22 22:11 hongsukchoi

thanks

---Original--- From: "Hongsuk @.> Date: Thu, Nov 10, 2022 06:26 AM To: @.>; Cc: @.@.>; Subject: Re: [hongsukchoi/3DCrowdNet_RELEASE]3DPW_validation_crowd_hhrnet_result.json (Issue #22)

I can share it. I uploaded to the joint_regressor folder.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

zhLawliet avatar Nov 10 '22 01:11 zhLawliet

@hongsukchoi can you share the MuPoTs_test_hhrnet_result.json and MuPoTs_test_openpose_result.json, i want to reproduce the benchmark of MuPoTs, thanks if i set the input_joint_name = 'gt', the pck_mean of MPJPE is 0.72376, the pck_mean of PA-MPJPE is 0.9463 , (pck_thresh = 150) , that's meet your expectations?

zhLawliet avatar Nov 10 '22 03:11 zhLawliet

It takes some time to find them.

hongsukchoi avatar Nov 16 '22 18:11 hongsukchoi

And if you use GT, PCK should be much higher. Does 0.72376 mean 72.376 PCK?

hongsukchoi avatar Nov 16 '22 18:11 hongsukchoi

yes, 72.376 PCK

---Original--- From: "Hongsuk @.> Date: Thu, Nov 17, 2022 02:42 AM To: @.>; Cc: @.@.>; Subject: Re: [hongsukchoi/3DCrowdNet_RELEASE]3DPW_validation_crowd_hhrnet_result.json (Issue #22)

And if you use GT, PCK should be much higher. Does 0.72376 mean 72.376 PCK?

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

zhLawliet avatar Nov 16 '22 23:11 zhLawliet

Here is the hhrnet result. I cannot find the openpose result :( But I remember using this repo: https://github.com/tensorboy/pytorch_Realtime_Multi-Person_Pose_Estimation

https://drive.google.com/drive/folders/1_Xrtd6k8sFv8FHh7NOg4B8pVBX-vyzS0?usp=sharing

hongsukchoi avatar Nov 21 '22 21:11 hongsukchoi

thanks

---Original--- From: "Hongsuk @.> Date: Tue, Nov 22, 2022 05:25 AM To: @.>; Cc: @.@.>; Subject: Re: [hongsukchoi/3DCrowdNet_RELEASE]3DPW_validation_crowd_hhrnet_result.json (Issue #22)

Here is the hhrnet result. I cannot find the openpose result :( But I remember using this repo: https://github.com/tensorboy/pytorch_Realtime_Multi-Person_Pose_Estimation

https://drive.google.com/drive/folders/1_Xrtd6k8sFv8FHh7NOg4B8pVBX-vyzS0?usp=sharing

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

zhLawliet avatar Nov 21 '22 23:11 zhLawliet

When you run openpose, there could multiple outputs in the scene or even for one person. Filter them out with this code: https://github.com/hongsukchoi/3DCrowdNet_RELEASE/blob/main/tool/match_mupots_2dpose.py

hongsukchoi avatar Nov 22 '22 02:11 hongsukchoi

@hongsukchoi thanks,i have done it, i find the 3DPCK of MPJPE is just 61.2. my eval code is https://github.com/ddddwee1/MuPoTS3D-Evaluation/blob/master/util/evaluate.py image

zhLawliet avatar Nov 22 '22 03:11 zhLawliet

Hi,

I think there are some bugs.

  1. Use the matlab code from the original paper
  2. Check the output by comparing with the input image

hongsukchoi avatar Nov 22 '22 03:11 hongsukchoi

ok, i try it, if i want to get the results of paper, the chekpoint is exp_04-06_23_43 epoch10 of pretrained_3DCrowdNet?

zhLawliet avatar Nov 22 '22 04:11 zhLawliet

Yes. I haven’t checked it before the release, but it will at least give similar results. If there’s no bug and you use detected 2d poses and gt, pck will be at least over 70 and 80 respectively.

Also, compare the joint order with the MuPoTs dataset during debugging.

hongsukchoi avatar Nov 22 '22 04:11 hongsukchoi

yes, you are right, i can get the result. by https://github.com/mks0601/3DMPPE_POSENET_RELEASE/blob/master/data/MuPoTS/mpii_mupots_multiperson_eval.m image

zhLawliet avatar Nov 22 '22 15:11 zhLawliet

Great! The released pre-trained weights are for reproducing 3DPW-Crowd and 3DPW, which had the fastest convergence. If you want to reproduce the exact numbers or even higher accuracy, you can train longer. Like lr_decay: [40], end_epoch: 50

hongsukchoi avatar Nov 22 '22 17:11 hongsukchoi

ok,thank you

---Original--- From: "Hongsuk @.> Date: Wed, Nov 23, 2022 01:02 AM To: @.>; Cc: @.@.>; Subject: Re: [hongsukchoi/3DCrowdNet_RELEASE]3DPW_validation_crowd_hhrnet_result.json (Issue #22)

Great! The released pre-trained weights are for reproducing 3DPW-Crowd and 3DPW, which had the fastest convergence. If you want to reproduce the exact numbers or even higher accuracy, you can train longer. Like lr_decay: [40], end_epoch: 50

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

zhLawliet avatar Nov 22 '22 23:11 zhLawliet