high-res-stereo icon indicating copy to clipboard operation
high-res-stereo copied to clipboard

Depth Estimation

Open skyhehe123 opened this issue 4 years ago • 5 comments

Hi, I use your pre-trained model and convert the disp to depth with the following formula, Depth = f * baseline / pred_disp, where the f and baseline are directly obtained from the calibration file. When I unproject the depth image to the point cloud, I found the result is no satisfactory. Do I go sth wrong when calculating the depth map? Screenshot from 2020-05-31 20-58-39

skyhehe123 avatar May 31 '20 13:05 skyhehe123

Which tool did you use for vis? I thought the cv toolkit uses disparity images as input? It will automatically convert disparity to depth for you.

gengshan-y avatar Jun 04 '20 06:06 gengshan-y

Which tool did you use for vis? I thought the cv toolkit uses disparity images as input? It will automatically convert disparity to depth for you.

hi,How did you get the camera parameters and correct the image

aihaoc avatar Dec 30 '20 02:12 aihaoc

Camera parameters are provided by the Middlebury dataset: https://vision.middlebury.edu/stereo/

gengshan-y avatar Dec 31 '20 07:12 gengshan-y

Camera parameters are provided by the Middlebury dataset: https://vision.middlebury.edu/stereo/

The file in high-res-stereo/data-mbtest/0593_8_0661_1/ isn't meant to be a Middlebury dataset, is it? How did Calib.txt come into being?

aihaoc avatar Jan 03 '21 12:01 aihaoc

Pair 0593_8_0661_1 is taken from the "Gangnam Style" sequence in open4d and Spatiotemporal BA. A spatiotemporal bundle adjustment method is used there. Please refer to the paper for details.

I believe classic SfM (e.g. COLMAP) can also be applied to get intrinsics/extrinsics for many use cases.

gengshan-y avatar Jan 03 '21 15:01 gengshan-y

Hi, Gengshan. Just found you refered the Spatiotemporal BA method. Did you have any reference implementation.

nnop avatar Mar 03 '24 13:03 nnop