Realistic and animatable face models for expression simulations in 3D

Erdogmus, Nesli, Etheve, Rémy; Dugelay, Jean-Luc
3DIP 2010, Electronic Imaging Conference on 3D Image Processing and Applications, January 17-21, 2010, San Jose, CA, USA / Also published as "SPIE - The International Society for Optical Engineering", Volume 7526, 2010

In the face recognition problem, one of the most critical sources of variation is facial expression. This paper presents a system to overcome this issue by utilizing facial expression simulations on realistic and animatable face models that are in compliance with MPEG-4 specifications.

 

In our system, firstly, 3D frontal face scans of the users in neutral expression and with closed mouth are taken for one-time enrollment. Those rigid face models are then converted into animatable models by warping a generic animatable model using Thin Plate Spline method. The warping is based on the facial feature points and both 2D color and 3D shape data are exploited for the automation of their extraction. The obtained models of the users can be animated by using a facial animation engine. This new attribution helps us to bring our whole database in the same "expression state" detected in a test image for better recognition results, since the disadvantage of expression variations is eliminated.


DOI
HAL
Type:
Conference
City:
San Jose
Date:
2010-01-17
Department:
Digital Security
Eurecom Ref:
2992
Copyright:
© 2010 Society of Photo-Optical Instrumentation Engineers.
This paper is published in 3DIP 2010, Electronic Imaging Conference on 3D Image Processing and Applications, January 17-21, 2010, San Jose, CA, USA / Also published as "SPIE - The International Society for Optical Engineering", Volume 7526, 2010 and is made available as an electronic preprint with permission of SPIE. One print or electronic copy may be made for personal use only. Systematic or multiple reproduction, distribution to multiple locations via electronic or other means, duplication of any material in this paper for a fee or for commercial purposes, or modification of the content of the paper are prohibited.

PERMALINK : https://www.eurecom.fr/publication/2992