depthai-core icon indicating copy to clipboard operation
depthai-core copied to clipboard

On-Device pointcloud generation from StereoDepth node

Open asa opened this issue 3 years ago • 0 comments

Currently the device has a calibration matrix and outputs depth data which must be fused on the host into a pointcloud.

It would be advantageous for various on device pipelines to be able to calculate a 3d pointcloud using these two components directly using shaves at high speed. Currently there is a proof of concept for using pytorch to create a pointcloud , which achieves 26fps at 400_P.

It would be ideal to enable an output for the StereoDepth node which would directly compute this output in an efficient way using shaves. It boils down to a simple matrix multiplication.

asa avatar Jul 18 '22 22:07 asa