Eye
Eye copied to clipboard
Track eye pupil movement, detects blinking of an eye from videos taken from medical devices in which only eye is visible
Eye
Tracks the eye pupil's movement and effectively detects the blinking of eye. Blinking of eye can be easily detected when eye(facial) landmarks are available, Eye is a computer vision application which can effectively tracks the pupil and find the eye blinking based on heuristics powered by data.
Instructions to Run
Clone the project
$ git clone https://github.com/aditya98ak/Eye.git
Install the dependencies, create a virtual environment (recommended)
$ cd Eye
$ pip install -r requirements.txt
Run the application
$ python main.py
I've added a video file in order to show how it works. As of now, this application works on closely cropped eye videos stacked side by side (horizontally). The aim of this application is to apply heuristics to find blinking of the eye in case where eye(facial) landmarks are not available or can not be generated. This is just a POC and it's performace can definately be improved!
Final Result
Screenshots
- Sample frame
- Detection of pupil
- Detection of blink
- SSIM Difference
This approach can be helpful in cases where data is obtained from devices in healthcare domain and we may still need to track, capture blink of eye and not whole face is visible. If whole face is visible, then eye blink can be easily detected with help of (eye) facial landmarks!
Contributing
All patches welcome!