zero-shot-pose icon indicating copy to clipboard operation
zero-shot-pose copied to clipboard

Information about ZSP metrics

Open AlbertoRemus opened this issue 1 year ago • 0 comments

Hi!

By launching the script in "paper" configuration (5 tgt views, 50 correspondences, K-Means)

I get the following results

bicycle Acc 30: 67.0%
hydrant Acc 30: 24.0%
motorcycle Acc 30: 83.0%
teddybear Acc 30: 36.0%
toaster Acc 30: 43.0%
overall Acc 15: 30.55%
overall Acc 30: 45.35%
overall median error: 40.00860786437988 deg
overall mean error: 72.36980981090664 deg

which differ from the results in the main paper Screenshot from 2024-01-24 22-53-18+

The difference in accuracy 15, 30 degrees is in the order of 1-3 degrees, but median error is completely different and I would like to track down where the issue is

In this zip you can see the script I used to extract results from the logs included for reproducibility zsp.zip

Alberto

AlbertoRemus avatar Jan 24 '24 21:01 AlbertoRemus