Speaker embeddings for diarization of broadcast data in the allies challenge

Larcher, Anthony; Mehrish, Ambuj; Tahon, Marie; Meignier, Sylvain; Carrive, Jean; Doukhan, David; Galibert, Olivier; Evans, Nicholas
ICASSP 2021, IEEE International Conference on Acoustics, Speech and Signal Processing, 6-11 June 2021, Toronto, Ontario, Canada

Diarization consists in the segmentation of speech signals and the clustering of homogeneous speaker segments. State-of-the-art systems typically operate upon speaker embeddings, such as i-vectors or neural x-vectors, extracted from mel cepstral coefficients (MFCCs) or spectrograms. The recent SincNet architecture extracts x-vectors directly from raw speech signals. The work reported in this paper compares the performance of different embeddings extracted from MFCCs or the raw signal for speaker diarization and broadcast media treated with compression and sub-sampling, operations which typically degrade performance. Experiments are performed with the new ALLIES database that was designed to complement existing, publicly available French corpora of broadcast radio and TV shows. Results show that, in adverse conditions, with compression and sampling mismatch, SincNet x-vectors outperform i-vectors and x-vectors by relative DERs of 43% and 73% respectively. Additionally we found that SincNet x-vectors are not the absolute best embeddings but are more robust to data mismatch than others.


DOI
HAL
Type:
Conference
City:
Toronto
Date:
2021-06-05
Department:
Digital Security
Eurecom Ref:
6560
Copyright:
© 2021 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
See also:

PERMALINK : https://www.eurecom.fr/publication/6560