Real-time suitable?
Thanks for sharing your work and code!
Can you tell us a bit about the runtime for inference? Is it generally suited for real-time applications and did you have some experience running it on the iPhone?
Hi, as mentioned in our paper, our 2D-3D matching module takes around 88ms which is tested on a single V100 GPU. The RansacPnP will also take a little time which is dependent on your CPU condition. Based on this, our method currently cannot perform real-time inference. We observe that reducing the number of 3D points for matching can help improve inference speed with little compensation for accuracy, as mentioned in the supplementary. Therefore, I think our method can be further elaborated for faster inference :).
Thanks for the info! 👍