eye-tracking-ios-prototype icon indicating copy to clipboard operation
eye-tracking-ios-prototype copied to clipboard

Adds eye tracking calibration using linear affine transform

Open Schemetrical opened this issue 5 years ago • 8 comments

  • Adds 3 corner calibration (top left of screen, top right, bottom left)
  • Adds logging for calibration
  • Creates affine transform to shift the tracked coordinates to a more accurate place.

How to use (potential readme.md):

  1. Look at top left of screen
  2. Press "TL" under calibrate
  3. Repeat with top right, bottom left
  4. Press "Translate"

Schemetrical avatar Mar 07 '19 09:03 Schemetrical

Nice approach! However I am not able to move the cursor to the bottom right corner after calibrating. It just gets stuck in the middle.

RolandColored avatar Mar 08 '19 07:03 RolandColored

I'll take a look at it again, assuming top left corner is set correctly the affine transform should be correct. It works on my phone, and if the cursor is moving in other parts of the screen then it's difficult to see why the bottom right is not working.

Schemetrical avatar Mar 08 '19 07:03 Schemetrical

Maybe it's because I'm using it on the iPad Pro. I changed the screen size constants so far, but maybe something is wrong with that. Or it doesn't scale so easy on bigger screens like expected. :(

RolandColored avatar Mar 11 '19 16:03 RolandColored

That’s probably why. It works fine here but I will want to test it on the iPad Pro and create a separate PR for that.

Schemetrical avatar Mar 11 '19 19:03 Schemetrical

I find the results to be similar, only that Hawkeye has a larger smoothing. Calibration should be much easier if dots are presented on the screen for sure.

Schemetrical avatar Mar 13 '19 17:03 Schemetrical

It looks the same to me once I up the smoothing.

Schemetrical avatar Mar 13 '19 17:03 Schemetrical

@RolandColored want to understand why the matrix multiplication happened in such order? Any docs I can read to understand this in depth.

Aviral190694 avatar Jul 22 '19 11:07 Aviral190694

Hi,

I love the improvement requested and implemented by Schemetrical but the precission is not so good as I want. Do you have done any more improvements? I'm really interested. Thanks in advance!

jalemanyf avatar Feb 21 '21 11:02 jalemanyf