DIR icon indicating copy to clipboard operation
DIR copied to clipboard

Test code on KPT method

Open ChanglongJiangGit opened this issue 1 year ago • 2 comments

Thanks for your excellent job! In your table 3 , you tested KPT method under MCP alignment with and without scale alignment. Can you share your testing code of this?

ChanglongJiangGit avatar Oct 27 '23 02:10 ChanglongJiangGit

Hi, @ChanglongJiangGit, we modified the public code of KPT to align the definition of evaluation. Since it was modified based on KPT, this part of the code is not in this codebase. According to the definition of evaluation metrics, this part of the modification is not complicated. If you need more help we can provide guidance on how to modify the code. cc @PengfeiRen96

walsvid avatar Dec 29 '23 05:12 walsvid

Thanks for your response! When we modified the code ourselves, we found that the order of hand joint point coordinates defined by MANO was different from the order defined by the interhand2.6M data set. In MANO, the root joint coordinate is 0 and MCP is 9, but corresponding to interhand2.6m, the root joint is 20 and MCP is 11. So we calculated the result after coordinate transformation, similar code is: pred_joint_coord_cam[self.joint_type['right']] = pred_joint_coord_cam[self.joint_type['right']] - pred_joint_coord_cam[11,None,:] gt_joint_coord[self.joint_type['right']] = gt_joint_coord[self.joint_type['right']] - gt_joint_coord[11,None,:] length_right_gt = np.linalg.norm(gt_joint_coord[11] - gt_joint_coord[20], axis=-1) scale_right = (length_right_gt / (length_right_pred)) Then scale through this scale parameter. Is this code correct?

ChanglongJiangGit avatar Jan 23 '24 08:01 ChanglongJiangGit