Ecole d'ingénieur et centre de recherche en Sciences du numérique

Towards multimodal emotion recognition : A new approach

Paleari, Marco; Huet, Benoit; Chellali, Ryad

CIVR 2010, ACM International Conference on Image and Video Retrieval, July 5-7, 2010, Xi'an, China

                        Multimedia indexing is about developing techniques allowing       people to effectively find media. Content-based methods       become necessary when dealing with large databases as people       cannot possibly annotate all available content. Emotions       are intrinsic in human beings and are known to be very important       for natural interactions, decision making, memory,       and many other cognitive functions. Current technologies       allows exploring the emotional space by mean of content-       based analysis of audio and video, but also thanks to other       modalities such as the human physiology.       In this paper, we present the latest development in the       emotion recognition part of SAMMI [18] by mean of an       extensive study on feature selection and the application of       many of the principles we have presented in [17] and [15].       Then, we present the concepts of output thresholding, inverse       thresholding, and profiling which we used for improving       the results of the recognition. Finally, we present a study       on the robustness to rotations and zoom of our feature point       tracking system.       Our experiments on the six prototypical emotions by Ekman       and Friesen presented in the eNTERFACE'05 database       result in as much as 75% correct recognition rate.

Document Doi Bibtex

Titre:Towards multimodal emotion recognition : A new approach
Mots Clés:Emotion recognition; facial expressions; vocal expressions; prosody; affective computing; human?centered computing; indexing and retrieval
Département:Data Science
Eurecom ref:3107
Copyright: © ACM, 2010. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in CIVR 2010, ACM International Conference on Image and Video Retrieval, July 5-7, 2010, Xi'an, China
Bibtex: @inproceedings{EURECOM+3107, doi = {}, year = {2010}, title = {{T}owards multimodal emotion recognition : {A} new approach }, author = {{P}aleari, {M}arco and {H}uet, {B}enoit and {C}hellali, {R}yad}, booktitle = {{CIVR} 2010, {ACM} {I}nternational {C}onference on {I}mage and {V}ideo {R}etrieval, {J}uly 5-7, 2010, {X}i'an, {C}hina}, address = {{X}i'an, {CHINE}}, month = {07}, url = {} }
Voir aussi: