stella_vslam icon indicating copy to clipboard operation
stella_vslam copied to clipboard

Add Multi-Camera support

Open slovak194 opened this issue 2 years ago • 6 comments

Hi!

I'm currently investigating the possibilities to introduce multi-camera (fisheye) support. Are there any plans or thoughts regarding how to do that? Here are some thoughts:

  1. Multi-image keyframes, camera rig, and feature matching across all cameras inspired by MultiCol-SLAM
  2. Stereo matching without rectification step inspired by fisheye stereo mode from ORB_SLAM3 or from Real-Time Variational Fisheye Stereo without Rectification and Undistortion in case of overlapping cameras.

I'd love to hear any suggestions regarding architectural and algorithmic work to be done. That's might be a big task. Does anybody have a willingness to help?

Best regards, Alex

slovak194 avatar Dec 08 '21 08:12 slovak194

Hi!

I'm willing to help with that, but I am not familiar yet with multi camera slam approaches, need to study it deeply

Also, as one more source of inspiration, that (PDF) ETH paper could be seen

dimaxano avatar Dec 08 '21 13:12 dimaxano

Hi, @dimaxano!

Also, as one more source of inspiration, that (PDF) ETH paper could be seen

Yes, I've seen this article before. It sounds really great. But the reference implementation is missing and it may be too complex to target automatic/adaptive detection of available cameras.

But it definitely worse looking into.

slovak194 avatar Dec 08 '21 14:12 slovak194

I'm currently working on this project as my personal project,porting from multicol-slam and openvslam.

QMonteCarlo avatar May 11 '22 02:05 QMonteCarlo

I'm currently working on this project as my personal project,porting from multicol-slam and openvslam.

MultiCol-SLAM is GPLv3. Therefore, if you ported their implementation, it cannot be merged into this repository. Please be careful.

ymd-stella avatar May 11 '22 10:05 ymd-stella

Hello, any update on this new feature? I am willing to help.

Alex-Beh avatar Sep 12 '22 07:09 Alex-Beh

Hello, any update on this new feature? I am willing to help. I've seen @QMonteCarlo is working on something, but I have not found the for he is using. It is still very relevant to me, but I have not progressed far.

slovak194 avatar Sep 12 '22 12:09 slovak194

@QMonteCarlo @ymd-stella May I know your ideas on this feature? Any proposal or idea so far? else I can try to work on it and discuss with you all in future.

Alex-Beh avatar Sep 13 '22 03:09 Alex-Beh