Eye Tracking for Everyone

--><br>-->

GazeCapture

Eye Tracking for Everyone

Kyle Krafka*, Aditya Khosla*, Petr Kellnhofer, Harini Kannan, Suchendra Bhandarkar,<br>Wojciech Matusik, Antonio Torralba

University of GeorgiaMassachusetts Institute of TechnologyMPI Informatik

From scientific research to commercial applications, eye tracking is an important tool across many domains. Despite its range of applications, eye tracking has yet to become a pervasive technology. We believe that we can put the power of eye tracking in everyone's palm by building eye tracking software that works on commodity hardware such as mobile phones and tablets, without the need for additional sensors or devices. We tackle this problem by introducing GazeCapture , the first large-scale dataset for eye tracking, containing data from over 1450 people consisting of almost $2.5M$ frames. Using GazeCapture, we train iTracker , a convolutional neural network for eye tracking, which achieves a significant reduction in error over previous approaches while running in real time (10 - 15fps) on a modern mobile device. Our model achieves a prediction error of 1.7cm and 2.5cm without calibration on mobile phones and tablets respectively. With calibration, this is reduced to 1.3cm and 2.1cm. Further, we demonstrate that the features learned by iTracker generalize well to other datasets, achieving state-of-the-art results.

Download our paper

Please cite the following paper if you use our data, models or code:

Eye Tracking for Everyone

K.Krafka*, A. Khosla*, P. Kellnhofer, H. Kannan, S. Bhandarkar, W. Matusik and A. Torralba

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016

PDF<br>Bibtex

Explore our dataset

Usage: http://memorability.csail.mit.edu/cgi-bin/image.py?url=IMG_URL

Example:<br>http://memorability.csail.mit.edu/cgi-bin/image.py?url=http://memorability.csail.mit.edu/imgs/1.jpg

Notice: Please do not overload our server by querying repeatedly in a short period of time. This is a free service for academic research and education purposes only. It has no guarantee of any kind. For any questions or comments regarding this API or potential commercial applications, please contact Aditya Khosla.

-->

Acknowledgements

We would like to thank Kyle Johnsen for his help with the IRB, as well as Bradley Barnes and Karen Aguar for helping to recruit participants. This research was supported by Samsung, Toyota, and the QCRI-CSAIL partnership.

Register

Already registered?<br>Login

Password Reset

Remembered your password?<br>Login

Login

Forgot your password?-->

Register