Ecole d'ingénieur et centre de recherche en Sciences du numérique

Effective video hyperlinking by means of enriched feature sets and monomodal query combinations

Kavoosifar, Mohammad Reza; Apiletti, Daniele; Baralis, Elena; Garza, Paolo; Huet, Benoit

International Journal of Multimedia Information Retrieval, 10 June 2019

Video content has been increasing at an unprecedented rate in recent years, bringing the need for improved tools providing efficient access to specific contents of interest. Within the management of video content, hyperlinking aims at determining related video segments from a collection with respect to an input video anchor. This paper describes the system we designed to address feature selection for the video hyperlinking challenge, as defined by TRECVID, one of the top worldwide venues for multimedia benchmarking. The proposed solution is based on different combinations of textual and visual features, enriched to capture the various facets of the videos: automatically generated transcripts, visual concepts, video metadata, named-entity recognition, and concept-mapping techniques. The different combinations of monomodal queries are experimentally evaluated, and the impact of both parameters and single features are discussed to identify their contributions. The best performing approach at the TRECVID 2017 video hyperlinking challenge was the ensemble feature selection, which includes three different monomodal queries based on enriched feature sets.

Document Doi Bibtex

Titre:Effective video hyperlinking by means of enriched feature sets and monomodal query combinations
Mots Clés:Video retrieval; TRECVID; Multimedia indexing; Feature selection
Type:Journal
Langue:English
Ville:
Date:
Département:Data Science
Eurecom ref:5913
Copyright: © Springer. Personal use of this material is permitted. The definitive version of this paper was published in International Journal of Multimedia Information Retrieval, 10 June 2019 and is available at : https://doi.org/10.1007/s13735-019-00173-y
Bibtex: @article{EURECOM+5913, doi = {https://doi.org/10.1007/s13735-019-00173-y}, year = {2019}, month = {06}, title = {{E}ffective video hyperlinking by means of enriched feature sets and monomodal query combinations}, author = {{K}avoosifar, {M}ohammad {R}eza and {A}piletti, {D}aniele and {B}aralis, {E}lena and {G}arza, {P}aolo and {H}uet, {B}enoit}, journal = {{I}nternational {J}ournal of {M}ultimedia {I}nformation {R}etrieval, 10 {J}une 2019}, url = {http://www.eurecom.fr/publication/5913} }
Voir aussi: