rtabmap icon indicating copy to clipboard operation
rtabmap copied to clipboard

Projection matrix

Open luantunez opened this issue 2 years ago • 3 comments

Hello! I am not being able to obtain the projection matrix from the desktop app using a iOS scan with LiDAR. Can you help to obtain that data, together with the intrinsics and camera pose matrices?

Thank you very much in advance!

luantunez avatar Apr 12 '22 21:04 luantunez

Before asking this I would suggest to post what you have tried to acheive yourself, what where the results and where exactly you are stuck and need help. You need to search/work yourself first

stevemartinov avatar Apr 17 '22 08:04 stevemartinov

I have been trying to get the projection matrix from your code extracting it from the ARframe, as an option, but it does not work for projecting the texture to the point cloud. The thing is that from you code I see that the output calibration.yaml file can give a projection matrix together with the camera matrix, intrinsics, distortion coefficients, etc. But with my LiDAR camera from the iPhone 12 pro I am not getting all of that information ( and specifically, the projection matrix I am looking for). I was wondering if there is a way of getting that more complete yaml file. Thank you again!

luantunez avatar Apr 17 '22 16:04 luantunez

From ARFrame, see:

frame.camera.viewMatrix
frame.camera.projectionMatrix
frame.camera.intrinsics

There would not be any distortion coefficients. In RTAB-Map, camera parameters are extracted in this function: https://github.com/introlab/rtabmap/blob/5d200a0799dd1efe143df8b7245b2cca0f7abf04/app/ios/RTABMapApp/RTABMap.swift#L233

matlabbe avatar May 09 '22 16:05 matlabbe