The paper presents work aimed at reducing the semantic gap between low level video features and semantic video contents. The proposed method for finding associations between segmented frame region characteristics relies on the strength of latent semantic analysis (LSA). Previous work, using colour histograms and Gabor features, has rapidly shown the potential of this approach, but also uncovered some of its limitations. The use of structural information is necessary, yet rarely employed for such a task. The paper addresses two important issues: the first is to verify that using structural information does indeed improve information retrieval performances; the second concerns the manner in which this additional information is integrated within the framework. Two methods are proposed using the structural information contained in an object parts' topological arrangement. The first adds structural constraints indirectly to the LSA during the preprocessing of the video, while the other includes the structure directly within the LSA. Finally, retrieval results demonstrate that, when the structure is added directly to the LSA, the performance gain of combining visual (low level) and structural information is convincing.
Partition sampling : an active learning selection strategy for large database annotation
IEE Proceedings on Vision, Image and Signal Processing, Volume 152, N°3, June 2005, Special section on Technologies for interactive multimedia services
© IEE or IET. Personal use of this material is permitted. The definitive version of this paper was published in IEE Proceedings on Vision, Image and Signal Processing, Volume 152, N°3, June 2005, Special section on Technologies for interactive multimedia services and is available at : http://dx.doi.org/10.1049/ip-vis:20045079
PERMALINK : https://www.eurecom.fr/publication/1536