Ecole d'ingénieur et centre de recherche en Sciences du numérique

Inpainting of sparse occlusion in face recognition

Min, Rui; Dugelay, Jean-Luc

ICIP 2012, IEEE International Conference on Image Processing, 30 September-3 October, 2012, Orlando, Florida, USA

Facial occlusion is a critical issue in many face recognition applications. Existing approaches of face recognition under occlusion conditions mainly focus on the conventional facial accessories (such as sunglasses and scarf) and thus presume that the occluded region is dense and contiguous. Yet due to the wide variety of natural sources which can occlude a human face in uncontrolled environments, methods based on the dense assumption are not robust to thin and randomly distributed occlusions. This paper presents the solution to a newly identified facial occlusion problem - sparse occlusion in the context of face biometrics in video surveillance. We show that the occluded pixels can be detected in the low-rank structure of a canonical face set under the Robust-PCA framework; and the occluded part can be inpainted solely based on the non-occluded part and a Fields-of-Experts prior via spatial inference. Experiments demonstrate that the proposed approach significantly improve various face recognition algorithms in presence of complex sparse occlusions.

Document Doi Bibtex

Titre:Inpainting of sparse occlusion in face recognition
Mots Clés:Sparse Occlusion, Inpainting, Face Recognition, Robust-PCA, Fields-of-Experts
Département:Sécurité numérique
Eurecom ref:3712
Copyright: © 2012 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Bibtex: @inproceedings{EURECOM+3712, doi = {}, year = {2012}, title = {{I}npainting of sparse occlusion in face recognition}, author = {{M}in, {R}ui and {D}ugelay, {J}ean-{L}uc}, booktitle = {{ICIP} 2012, {IEEE} {I}nternational {C}onference on {I}mage {P}rocessing, 30 {S}eptember-3 {O}ctober, 2012, {O}rlando, {F}lorida, {USA}}, address = {{O}rlando, {\'{E}}{TATS}-{UNIS}}, month = {09}, url = {} }
Voir aussi: