Ecole d'ingénieur et centre de recherche en Sciences du numérique

Semantic concept detection using dense codeword motion

Tanase, Claudiu; Mérialdo, Bernard

ACIVS 2013, 15th International Conference, October 28-31, 2013, Poznan, Poland / Also published in LNCS, Volume 8192/2013

When detecting semantic concepts in video, much of the existing research in content-based classification uses keyframe information only. Particularly the combination between local features such as SIFT and the Bag of Words model is very popular with TRECVID participants. The few existing motion and spatiotemporal descriptors are computationally heavy and become impractical when applied on large datasets such as TRECVID. In this paper, we propose a way to efficiently combine positional motion obtained from optic flow in the keyframe with information given by the Dense SIFT Bag of Words feature. The features we propose work by spatially binning motion vectors belonging to the same codeword into separate histograms describing movement direction (left, right, vertical, zero, etc.). Classifiers are mapped using the homogeneous kernel map techinque for approximating the χ2 kernel and then trained efficiently using linear SVM. By using a simple linear fusion technique we can improve the Mean Average Precision of the Bag of Words DSIFT classifier on the TRECVID 2010 Semantic Indexing benchmark from 0.0924 to 0.0972, which is confirmed to be a statistically significant increase based on standardized TRECVID randomization tests.

Document Doi Bibtex

Titre:Semantic concept detection using dense codeword motion
Mots Clés:content based video retrieval, semantic indexing, TRECVID, spatio-temporal features, motion feature
Type:Conférence
Langue:English
Ville:Poznan
Pays:POLOGNE
Date:
Département:Data Science
Eurecom ref:4185
Copyright: © Springer. Personal use of this material is permitted. The definitive version of this paper was published in ACIVS 2013, 15th International Conference, October 28-31, 2013, Poznan, Poland / Also published in LNCS, Volume 8192/2013 and is available at : http://dx.doi.org/10.1007/978-3-319-02895-8_63
Bibtex: @inproceedings{EURECOM+4185, doi = {http://dx.doi.org/10.1007/978-3-319-02895-8_63}, year = {2013}, title = {{S}emantic concept detection using dense codeword motion}, author = {{T}anase, {C}laudiu and {M}{\'e}rialdo, {B}ernard}, booktitle = {{ACIVS} 2013, 15th {I}nternational {C}onference, {O}ctober 28-31, 2013, {P}oznan, {P}oland / {A}lso published in {LNCS}, {V}olume 8192/2013}, address = {{P}oznan, {POLOGNE}}, month = {10}, url = {http://www.eurecom.fr/publication/4185} }
Voir aussi: