LMCNet icon indicating copy to clipboard operation
LMCNet copied to clipboard

Evaluation Setting of SUN3D dataset

Open ruby50082 opened this issue 2 years ago • 1 comments

Hi! Much thanks for releasing the code.

I encountered an irrational result while evaluating on the SUN3D dataset following the config in this repository. It got much less AUC scores than those in the paper. I am wondering if any config setting I need to change by myself to nearly reach the accuracy shown in the paper.

ruby50082 avatar Mar 13 '22 06:03 ruby50082

Hi! Sorry for the late reply. I've checked the evaluation codes and I found I forgot to add a "pair" directory (downloaded from the OANet repo) in the "data" directory. I've added this in the README.md and the codes produce similar results as in the paper now. Thanks for pointing out this problem.

liuyuan-pal avatar Apr 06 '22 01:04 liuyuan-pal