Homography Estimation by Points, Lines and Ellipses Correspondence

[RoyiAvital]

Description:

The current estimator for Homography is based on correspondence between points in 2 images.

Yet it can be extend with lines and ellipses. Namely one can extract the parameters of 2 corresponding lines / ellipses on the images and use them to estimate the Homography.

It would be great if the estimate() method would support ellipses and lines in addition to points.

[github-actions[bot]]

Hello scikit-image core devs! There hasn't been any activity on this issue for more than 180 days. I have marked it as "dormant" to make it easy to find. To our contributors, thank you for your contribution and apologies if this issue fell through the cracks! Hopefully this ping will help bring some fresh attention to the issue. If you need help, you can always reach out on our forum If you think that this issue is no longer relevant, you may close it, or we may do it at some point (either way, it will be done manually).

[RoyiAvital]

This could be a feature to surpass OpenCV offerings for SciKit Image.

[lagru]

Thanks for reaching out @RoyiAvital and sorry for the delayed response.

Namely one can extract the parameters of 2 corresponding lines / ellipses on the images and use them to estimate the Homography.

Sounds interesting. Could you perhaps elaborate on what kind of concrete API you would like to see? E.g. how would lines / ellipses be defined?

[RoyiAvital]

Maybe a good starting point is something like: Luis Alvarez; Vicent Caselles - Homography Estimation Using One Ellipse Correspondence and Minimal Additional Information.

API wise, I guess extend the correspondence to the option of a list of dictionaries: [{'Type': 'Points', 'Source': srcMat, 'Target': tgtMat}, {'Type': 'Ellipse', 'Source': srcMat, 'Target': tgtMat}].