IBERSPEECH 2018, 21-23 November 2018, Barcelona, Spain
Best System Award Iberspeech 2018 Albayzin Challenges - Multimodal Diarization
This paper describes ODESSA and PLUMCOT submissions to Albayzin Multimodal Diarization Challenge 2018. Given a list of people to recognize (alongside image and short video samples of those people), the task consists in jointly answering the two questions "who speaks when?" and "who appears when?". Both consortia submitted 3 runs (1 primary and 2 contrastive) based on the same underlying monomodal neural technologies: neural speaker segmentation, neural speaker embeddings, neural
face embeddings, and neural talking-face detection. Our submissions aim at showing that face clustering and recognition can (hopefully) help to improve speaker diarization.
© ISCA. Personal use of this material is permitted. The definitive version of this paper was published in IBERSPEECH 2018, 21-23 November 2018, Barcelona, Spain and is available at : http://dx.doi.org/10.21437/IberSPEECH.2018-39