accelerated_features icon indicating copy to clipboard operation
accelerated_features copied to clipboard

Eval-MegaDepth-1500

Open zw-92 opened this issue 1 year ago • 3 comments

Hello, I evaluated the method on MegaDepth based on the evaluation of LOFTR, but the effect is not good, I can't figure out the problem for the time being. Looking forward to your assessment.

zw-92 avatar Aug 30 '24 07:08 zw-92

Hello @zw-92, thank you for the interest in our work!

Please notice that we use poselib in our paper's evaluation, which provides much better and faster pose estimation than the opencv default implementation used in LoFTR

guipotje avatar Aug 30 '24 13:08 guipotje

@zw-92 你好,可以分享一下您用LOFTR评估方法评估Xfeat的代码吗?谢谢

Wang86760 avatar Sep 24 '24 03:09 Wang86760

@zw-92 Hello, can you provide the code for evaluating the Xfeat model?

cw314 avatar Oct 10 '24 14:10 cw314

不好意思,之前有事耽误了。之前因为评估指标非常低,所以暂时将该评估工作放下了。最近因为算力原因,又开始重新研究,等再次核验代码后,会提供评估代码。

zw-92 avatar Oct 14 '24 07:10 zw-92

Hello @zw-92, thank you for the interest in our work!

Please notice that we use poselib in our paper's evaluation, which provides much better and faster pose estimation than the opencv default implementation used in LoFTR

zw-92 avatar Oct 18 '24 07:10 zw-92

Hello @zw-92, thank you for the interest in our work!

Please notice that we use poselib in our paper's evaluation, which provides much better and faster pose estimation than the opencv default implementation used in LoFTR

Hi, your work is very good, I have reproduced the accuracy of the method in the MegaDepth 1500, and even improved by 1-2 points. I was wondering if I could replace ALike with ROMA if I wanted to optimize XFeat+LightGule.

zw-92 avatar Oct 18 '24 07:10 zw-92

@zw-92 你好,可以分享一下怎么使用的poselib吗,我尝试了很多方法都没能实现评估

Wang86760 avatar Oct 23 '24 05:10 Wang86760

anyone reproduce the AUC on ScanNet? I have reproduced AUC on MegaDepth1500, but ScanNet AUC is not that high...

xushangnjlh avatar Feb 21 '25 09:02 xushangnjlh

@xushangnjlh Hey, I am also observing this behavior. Where you able to spot an error in you approach? My scannet evaluation also does not reach the exspected values.

Odin-byte avatar May 12 '25 14:05 Odin-byte