PVN3D icon indicating copy to clipboard operation
PVN3D copied to clipboard

Occ-linemod

Open hillaric opened this issue 3 years ago • 11 comments

First, congratulation for your new work FFB6D. I see that you test the occ_linemod in both methods, and I want to test PVN3D on occ_linemod, but I don't have the preprocessed occ-linemod data. In detail, the downloaded dataset can not be used directly, how do you process the data?

hillaric avatar Mar 21 '21 08:03 hillaric

We use preprocessing code from PVNet to transform the pose parameter (pvnet_code) and then use similar scripts as in our datasets/linemod/linemod_dataset.py to generate input to our model.

ethnhe avatar Mar 21 '21 15:03 ethnhe

thank you! I will have a try.

hillaric avatar Mar 21 '21 16:03 hillaric

The 'blender K' in common.py is the same K used in the 'occ_linemod'? I am a little confused.

hillaric avatar Mar 22 '21 06:03 hillaric

No, both the linemod and occ_linemod use 'linemod' K, the 'blender' K is only used for the synthetic dataset.

ethnhe avatar Mar 22 '21 07:03 ethnhe

Would you mind provide the corresponding code, especially the gt.yml. I try, but I can't do it. image

hillaric avatar Mar 22 '21 14:03 hillaric

After using the code 'Pose_transformer' you released in 'base_utils.py' for OCCLUSION_LINEMOD, I got a different pose from PVNet. Is it right?

hillaric avatar Mar 23 '21 10:03 hillaric

You can check if the pose is correct by transforming the object vertexes or the selected keypoint by the pose parameters and project them back to the RGB image for visualization, as what we have done in datasets/linemod/linemod_dataset.py code link.

ethnhe avatar Mar 23 '21 12:03 ethnhe

hello, have you solve the problem, I want to test the OCC-Linemod dataset, could you show your change or addition on the original code? Thank you

aiai84 avatar Jun 04 '21 07:06 aiai84

For occ-lm, i found the model performance on eggbox is pretty bad. Can you please give me any insight about it?

William-Klay avatar Jun 03 '22 15:06 William-Klay

For occ-lm, i found the model performance on eggbox is pretty bad. Can you please give me any insight about it?

May I know how you completed the test on occ? Especially in occ dataset processing.

d-serafly avatar Jul 07 '22 02:07 d-serafly