Abstract

This paper introduces an unsupervised modular approach for accurate and real-time eye center localization in images and videos, thus allowing a coarse-to-fine, global-to-regional scheme. The trajectories of eye centers in consecutive frames, i.e., gaze gestures, are further analyzed, recognized, and employed to boost the human–computer interaction (HCI) experience. This modular approach makes use of isophote and gradient features to estimate the eye center locations. A selective oriented gradient filter has been specifically designed to remove strong gradients from eyebrows, eye corners, and shadows, which sabotage most eye center localization methods. A real-world implementation utilizing these algorithms has been designed in the form of an interactive advertising billboard to demonstrate the effectiveness of our method for HCI. The eye center localization algorithm has been compared with 10 other algorithms on the BioID database and six other algorithms on the GI4E database. It outperforms all the other algorithms in comparison in terms of localization accuracy. Further tests on the extended Yale Face Database b and self-collected data have proved this algorithm to be robust against moderate head poses and poor illumination conditions. The interactive advertising billboard has manifested outstanding usability and effectiveness in our tests and shows great potential for benefiting a wide range of real-world HCI applications.

© 2016 Optical Society of America

Gender recognition from facial images: two or three dimensions?

Wenhao Zhang, Melvyn L. Smith, Lyndon N. Smith, and Abdul Farooq
J. Opt. Soc. Am. A 33(3) 333-344 (2016)

Human gesture recognition using three-dimensional integral imaging

V. Javier Traver, Pedro Latorre-Carmona, Eva Salvador-Balaguer, Filiberto Pla, and Bahram Javidi
J. Opt. Soc. Am. A 31(10) 2312-2320 (2014)

Registration of eye reflection and scene images using an aspherical eye model

Atsushi Nakazawa, Christian Nitschke, and Toyoaki Nishida
J. Opt. Soc. Am. A 33(11) 2264-2276 (2016)

Fundamentals of automated human gesture recognition using 3D integral imaging: a tutorial

Bahram Javidi, Filiberto Pla, José M. Sotoca, Xin Shen, Pedro Latorre-Carmona, Manuel Martínez-Corral, Rubén Fernández-Beltrán, and Gokul Krishnan
Adv. Opt. Photon. 12(4) 1237-1299 (2020)

Always-on low-power optical system for skin-based touchless machine control

Michela Lecca, Massimo Gottardi, Elisabetta Farella, and Bojan Milosevic
J. Opt. Soc. Am. A 33(6) 1015-1024 (2016)