pytorch_depth_from_videos_in_the_wild icon indicating copy to clipboard operation
pytorch_depth_from_videos_in_the_wild copied to clipboard

incorrect intrinsics results with provided pretrained model

Open Ljiaooo opened this issue 1 year ago • 4 comments

Hello, thanks for your work on the code reconstruction. I got some problems when loading the model you provide in the readme page. I output the camera intrinsics and found there is a large distance with GT (taken in kitti raw). My output is as follow. I don't know where the problems lie in. QMJ7NXB 3IPHJER809ZX`4W

Ljiaooo avatar Apr 06 '23 01:04 Ljiaooo

Hi Ljiaooo,

Do you mean the x and y offsets are large? I should say the learning of the camera intrinsics is not perfect. It is theoretically able to converge to the true matrix when data and training techniques are proper, and is convenient when you don't know the values.

bolianchen avatar Apr 08 '23 01:04 bolianchen

Thanks for your reply, I found your reproduced IntrinsicsHead() is a little different from the original where the softpuls function is not applied on the offsets by the original. After I deleted the softplus on offsets, the camera matrix got normal.

Ljiaooo avatar Apr 15 '23 01:04 Ljiaooo

@Ljiaooo Thank you very much for the findings. Since the learnings of depth and intrinsics are affecting each other, really appreciate if you may share some experiment results to show the improvement brought about by this revision and send a pull request.

bolianchen avatar Apr 15 '23 03:04 bolianchen

Hello, Thank you for this repository, What is the image dimensions used for the intrinsic matrix above?

Kwame261 avatar May 04 '23 00:05 Kwame261