Ecole d'ingénieur et centre de recherche en Sciences du numérique

Harnessing A.I. for augmenting creativity: Application to movie trailer creation

Smith, John R.; Joshi, Dhiraj; Huet, Benoit; Hsu, Winston; Cota, Jozef

ACMMM 2017, 25th ACM Multimedia Conference, October 23-27, 2017, Mountain View, CA, USA

Best Brave New Idea Award

In this paper, we describe the first-ever machine human collaboration at creating a real movie trailer (officially released by 20th Century Fox). We introduce an intelligent system designed to understand and encode patterns and types of emotions in horror movies that are useful in trailers. We perform multi-modal semantics extraction including audio visual sentiments and scene analysis and employ a statistical approach to model the key defining components that characterize horror movie trailers. The system was applied on a full-length feature film, "Morgan" released in 2016 where the system identified 10 moments as best candidates for a trailer. We partnered with a professional filmmaker who arranged and edited each of the moments together to construct a comprehensive trailer completing the entire processing as well as the final trailer assembly within 24 hours. We discuss disruptive opportunities for the film industry and the tremendous media impact of the AI trailer. We confirm the effectiveness of our trailer with a very supportive user study. Finally based on our close interaction with the film industry, we also introduce and investigate the novel paradigm of tropes within the context of movies for advancing content creation.

Document Doi Bibtex

Titre:Harnessing A.I. for augmenting creativity: Application to movie trailer creation
Mots Clés:Automatic Trailer Generation; Computational Creativity
Type:Conférence
Langue:English
Ville:Mountain View
Pays:ÉTATS-UNIS
Date:
Département:Data Science
Eurecom ref:5344
Copyright: © ACM, 2017. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in ACMMM 2017, 25th ACM Multimedia Conference, October 23-27, 2017, Mountain View, CA, USA http://dx.doi.org/10.1145/3123266.3127906
Bibtex: @inproceedings{EURECOM+5344, doi = {http://dx.doi.org/10.1145/3123266.3127906}, year = {2017}, title = {{H}arnessing {A}.{I}. for augmenting creativity: {A}pplication to movie trailer creation}, author = {{S}mith, {J}ohn {R}. and {J}oshi, {D}hiraj and {H}uet, {B}enoit and {H}su, {W}inston and {C}ota, {J}ozef}, booktitle = {{ACMMM} 2017, 25th {ACM} {M}ultimedia {C}onference, {O}ctober 23-27, 2017, {M}ountain {V}iew, {CA}, {USA} }, address = {{M}ountain {V}iew, {\'{E}}{TATS}-{UNIS}}, month = {10}, url = {http://www.eurecom.fr/publication/5344} }
Voir aussi: