What fresh media are you looking ? for Extracting media items from multiple social networks

Social networks play an increasingly important role for sharing media items related to daily life moments or for the live coverage of events. One of the problems is that media are spread over multiple social networks. In this paper, we propose a social network-agnostic approach for collecting recent images and videos which can be potentially attached to an event. These media items can be used for the automatic generation of visual summaries in the form of media galleries. Our approach includes the alignment of the varying search result formats of different social networks, while putting media items in correspondence with the status updates and stories they are related to. More precisely we leverage on: (i) visual features from media items, (ii) textual features from status updates, and (iii) social features from social networks to interpret, deduplicate, cluster, and visualize media items. We address the technical details of media item extraction and media item processing, discuss criteria for media item filtering and envision several visualization options for media presentation. Our evaluation is divided into two parts: first we assess the performances of the image process deduplication and then we propose a human evaluation of the summary creation compared with Teleportd and Twitter media galleries. A demo of our approach is publicly available at http://eventmedia.eurecom.fr/media-finder.