Graduate School and Research Center in Digital Sciences

A multimedia retrieval framework based on automatic graded relevance judgments

Redi, Miriam; Mérialdo, Bernard

MMM 2012, 18th International Conference on Multimedia Modeling, 4-6 January, 2012, Klagenfurt, Austria / Also published in Springer LNCS, Volume 7131/2012

Traditional Content Based Multimedia Retrieval (CBMR) systems measure the relevance of visual samples using a binary scale (Relevant/Non Relevant). However, a picture can be relevant to a semantic category with different degrees, depending on the way such concept is represented in the image. In this paper, we build a CBMR framework that supports graded relevance judgments. In order to quickly build graded ground truths, we propose a measure to reassess binary-labeled databases without involving manual effort: we automatically assign a reliable relevance degree (Non, Weakly, Average, Very Relevant) to each sample, based on its position with respect to the hyperplane drawn by support vector machines in the feature space. We test the effectiveness of our system on two large-scale databases, and we show that our approach outperforms the traditional binary relevance-based frameworks in both scene recognition and video retrieval.

Document Doi Bibtex

Title:A multimedia retrieval framework based on automatic graded relevance judgments
Type:Conference
Language:English
City:Klagenfurt
Country:AUSTRIA
Date:
Department:Data Science
Eurecom ref:3521
Copyright: © Springer. Personal use of this material is permitted. The definitive version of this paper was published in MMM 2012, 18th International Conference on Multimedia Modeling, 4-6 January, 2012, Klagenfurt, Austria / Also published in Springer LNCS, Volume 7131/2012 and is available at : http://dx.doi.org/10.1007/978-3-642-27355-1_29
Bibtex: @inproceedings{EURECOM+3521, doi = {http://dx.doi.org/10.1007/978-3-642-27355-1_29 }, year = {2012}, title = {{A} multimedia retrieval framework based on automatic graded relevance judgments }, author = {{R}edi, {M}iriam and {M}{\'e}rialdo, {B}ernard}, booktitle = {{MMM} 2012, 18th {I}nternational {C}onference on {M}ultimedia {M}odeling, 4-6 {J}anuary, 2012, {K}lagenfurt, {A}ustria / {A}lso published in {S}pringer {LNCS}, {V}olume 7131/2012}, address = {{K}lagenfurt, {AUSTRIA}}, month = {01}, url = {http://www.eurecom.fr/publication/3521} }
See also: