depthai icon indicating copy to clipboard operation
depthai copied to clipboard

Motion Estimation

Open Luxonis-Brandon opened this issue 5 years ago • 1 comments

Start with the why:

In many CV/AI pipelines it is advantageous to seed the pipeline or inform the pipeline based on where there is motion in the scene and the DepthAI hardware has built-in hardware acceleration for motion estimation.

Move to the how:

Leverage the Gen2 Pipeline Builder architecture https://github.com/luxonis/depthai/issues/136 to implement motion estimation as a node in the pipeline (including operating directly on the camera feeds) which returns pixel locations of motion.

Move to the what:

Implement hardware accelerated motion estimation in the Gen2 DepthAI API.

Luxonis-Brandon avatar Oct 20 '20 19:10 Luxonis-Brandon

Demo of computing difference of 2 consecutive frames with a custom NN model can be found here.

diff-demo

Erol444 avatar Sep 12 '22 13:09 Erol444