Abstract

The focus of this paper is on the problem of recognizing faces across space-varying motion blur, changes in pose, illumination, and expression, as well as partial occlusion, when only a single image per subject is available in the gallery. We show how the blur, incurred due to relative motion between the camera and the subject during exposure, can be estimated from the alpha matte of pixels that straddle the boundary between the face and the background. We also devise a strategy to automatically generate the trimap required for matte estimation. Having computed the motion via the matte of the probe, we account for pose variations by synthesizing from the intensity image of the frontal gallery a face image that matches the pose of the probe. To handle illumination, expression variations, and partial occlusion, we model the probe as a linear combination of nine blurred illumination basis images in the synthesized nonfrontal pose, plus a sparse occlusion. We also advocate a recognition metric that capitalizes on the sparsity of the occluded pixels. The performance of our method is extensively validated on synthetic as well as real face data.

© 2016 Optical Society of America

Image-based face recognition under illumination and pose variations

Shaohua Kevin Zhou and Rama Chellappa
J. Opt. Soc. Am. A 22(2) 217-229 (2005)

Change detection in underwater imagery

Karthik Seemakurthy and A. N. Rajagopalan
J. Opt. Soc. Am. A 33(3) 301-313 (2016)

Unified multiframe super-resolution of matte, foreground, and background

Sahana M. Prabhu and A. N. Rajagopalan
J. Opt. Soc. Am. A 30(8) 1524-1534 (2013)

Dictionaries for image and video-based face recognition [Invited]

Vishal M. Patel, Yi-Chen Chen, Rama Chellappa, and P. Jonathon Phillips
J. Opt. Soc. Am. A 31(5) 1090-1103 (2014)

Thermal-to-visible face recognition using partial least squares

Shuowen Hu, Jonghyun Choi, Alex L. Chan, and William Robson Schwartz
J. Opt. Soc. Am. A 32(3) 431-442 (2015)