LightGlue icon indicating copy to clipboard operation
LightGlue copied to clipboard

Issue with SuperPoint and LightGlue Keypoint Matching

Open p890040 opened this issue 2 years ago • 4 comments

Hello,

I've been utilizing the default SuperPoint for feature extraction combined with LightGlue for keypoint matching in this repository, and the results have been quite satisfactory in my use case.

However, today I replaced the SuperPoint weights with ones sourced from https://github.com/rpautrat/SuperPoint. Upon inspection, the model appears to identify a considerable number of keypoints accurately. Nevertheless, when these keypoints and descriptors are fed into LightGlue, it fails to find any matching keypoints.

Is this outcome expected, or could there be some unforeseen issue I've overlooked? I'd appreciate any insights or recommendations regarding this situation.

Thank you.

p890040 avatar Nov 06 '23 09:11 p890040

LightGlue models trained for one kind of descriptors are not compatible with other descriptors. These are 2 different implementations of SuperPoint with very different weights. We will release one model of LightGlue trained for this SuperPoint but this will have to wait longer.

sarlinpe avatar Nov 07 '23 08:11 sarlinpe

LightGlue models trained for one kind of descriptors are not compatible with other descriptors. These are 2 different implementations of SuperPoint with very different weights. We will release one model of LightGlue trained for this SuperPoint but this will have to wait longer.

Thanks for the explanation, I'm looking forward to your masterpiece.

p890040 avatar Nov 09 '23 05:11 p890040

@sarlinpe it will be interesting to see the comparison of the official SPSG and SP(https://github.com/rpautrat/SuperPoint.) + LightGlue. Thanks

nitinagarwal avatar Nov 20 '23 17:11 nitinagarwal

Hey, any updates on LightGlue trained for https://github.com/rpautrat/SuperPoint?

avdhoeke avatar Apr 24 '24 13:04 avdhoeke