dlib icon indicating copy to clipboard operation
dlib copied to clipboard

Gaze Estimation Support

Open arasharchor opened this issue 8 years ago • 4 comments

As now there is a sample head position estimation and face landmark detection, I was wondering is there any plan to add gaze estimation module to Dlib library?

following repositories can be useful to do so: https://github.com/mpatacchiola/deepgaze https://github.com/opengazer/OpenGazer

arasharchor avatar Sep 18 '17 01:09 arasharchor

I'm not going to do it. But maybe someone will contribute :)

davisking avatar Sep 18 '17 01:09 davisking

@smajida , why not use shape_predictor for it? you simply need to have about 1000 images with human eyes, with pupil size about 3-10 pixels and train the model with the code from examples directory

e-fominov avatar Sep 18 '17 07:09 e-fominov

@e-fominov good idea. Do you know a sample dataset for this? I found this https://www.mpi-inf.mpg.de/departments/computer-vision-and-multimodal-computing/research/gaze-based-human-computer-interaction/appearance-based-gaze-estimation-in-the-wild-mpiigaze/

and this one

http://www.cs.columbia.edu/CAVE/databases/columbia_gaze/

I will take a look inside these two datasets

arasharchor avatar Sep 19 '17 22:09 arasharchor

The shape_predictor_68_face_landmarks.dat model includes pupil positions. I'm not sure how accurate it is.

TimSC avatar Nov 26 '23 23:11 TimSC