A multimedia retrieval framework based on automatic graded relevance judgments

Redi, Miriam; Mérialdo, Bernard
MMM 2012, 18th International Conference on Multimedia Modeling, 4-6 January, 2012, Klagenfurt, Austria / Also published in Springer LNCS, Volume 7131/2012

Traditional Content Based Multimedia Retrieval (CBMR) systems measure the relevance of visual samples using a binary scale (Relevant/Non Relevant). However, a picture can be relevant to a semantic category with different degrees, depending on the way such concept

is represented in the image. In this paper, we build a CBMR framework that supports graded relevance judgments. In order to quickly build graded ground truths, we propose a measure to reassess binary-labeled databases without involving manual effort: we automatically assign a reliable relevance degree (Non, Weakly, Average, Very Relevant) to each sample, based on its position with respect to the hyperplane drawn by support vector machines in the feature space. We test the effectiveness of our system on two large-scale databases, and we show that our approach outperforms the traditional binary relevance-based frameworks in both scene recognition and video retrieval.


DOI
Type:
Conference
City:
Klagenfurt
Date:
2012-01-04
Department:
Data Science
Eurecom Ref:
3521
Copyright:
© Springer. Personal use of this material is permitted. The definitive version of this paper was published in MMM 2012, 18th International Conference on Multimedia Modeling, 4-6 January, 2012, Klagenfurt, Austria / Also published in Springer LNCS, Volume 7131/2012 and is available at : http://dx.doi.org/10.1007/978-3-642-27355-1_29

PERMALINK : https://www.eurecom.fr/publication/3521