Graduate School and Research Center in Digital Sciences

A secure visual-thermal fused face recognition system based on non-linear hashing

Dong, Xingbo; Wong, KokSheik; Jin, Zhe; Dugelay, Jean-Luc

MMSP 2019, IEEE 21st International Workshop on Multimedia Signal Processing, 27-29 September 2019, Kuala Lumpur, Malaysia

In this paper, we propose a secure visual-thermal fused face recognition system using non-linear hashing. To extract features from both thermal and visible facial images, a deep neural network model pre-trained by visible images, namely InsightFace, is utilized in extracting deep features from both thermal and visible images. Next, we investigate into the effectiveness of using nonlinear hashing in protecting deep features extracted from both thermal and visible face images. To further boost the accuracy performance of the facial recognition system under unfavorable environment, feature- and score-level fusion of thermal and visible images for face matching are studied. The performance of different application scenarios are tested on the EURECOM VIS-TH face dataset. Experiment results suggest that: 1) feature- and score-level fusion techniques are effective in achieving higher accuracy under unfavorable situation; 2) non-linear hashing offers additional layer of protection, namely, privacy preservation, to face image. We also found that the deep model trained by using visible images is applicable to thermal images for feature extraction, which is particularly useful because there is no large thermal dataset available to train deep neural network

Document Doi Bibtex

Title:A secure visual-thermal fused face recognition system based on non-linear hashing
Keywords:Face recognition, thermal face, fusion, biometric template protection
Type:Conference
Language:English
City:Kuala Lumpur
Country:MALAYSIA
Date:
Department:Digital Security
Eurecom ref:6130
Copyright: © 2019 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Bibtex: @inproceedings{EURECOM+6130, doi = {http://dx.doi.org/10.1109/MMSP.2019.8901814}, year = {2019}, title = {{A} secure visual-thermal fused face recognition system based on non-linear hashing}, author = {{D}ong, {X}ingbo and {W}ong, {K}ok{S}heik and {J}in, {Z}he and {D}ugelay, {J}ean-{L}uc}, booktitle = {{MMSP} 2019, {IEEE} 21st {I}nternational {W}orkshop on {M}ultimedia {S}ignal {P}rocessing, 27-29 {S}eptember 2019, {K}uala {L}umpur, {M}alaysia}, address = {{K}uala {L}umpur, {MALAYSIA}}, month = {09}, url = {http://www.eurecom.fr/publication/6130} }
See also: