Graduate School and Research Center in Digital Sciences

Making sense of Microposts (#Microposts2015) named entity recognition & linking challenge

Rizzo, Giuseppe; Cano Amparo E; Pereira, Bianca; Varga, Andrea

WWW 2015, 5th International Workshop on Making Sense of Microposts (#Microposts'15), May 18-22, 2015, Florence, Italy

Microposts are small fragments of social media content and a popular medium for sharing facts, opinions and emotions. Collectively, they comprise a wealth of data that is increasing exponentially, and which therefore presents new challenges for the Information Extraction community, among others. This paper describes the Making Sense of Microposts (#Microposts2015) Workshop's Named Entity rEcognition and Linking (NEEL) Challenge, held as part of the 2015 World Wide Web conference (WWW'15). The challenge task comprised automatic recognition and linking of entities appearing in different event streams of English Microposts on Twitter. Participants were set the task of investigating novel strategies for extracting entities in a tweet stream, typing these based on a set of pre-defined classes, and linking to DBpedia or NIL referents. They were also asked to implement a web service to run their systems, to minimize human involvement in the evaluation and allow measuring of processing times. The challenge attracted a lot of interest: 29 research groups expressed an intent to participate, out of which 21 signed the agreement required to be given a copy of the training and development datasets. Seven teams participated in the final evaluation of the challenge task, out of which six completed all requirements, including submission of an abstract describing their approach. The submissions covered sequential and joint linguistic methods, end-to-end and hybrid end-to-end, and linguistic approaches for tackling the challenge task. We describe the evaluation process and discuss the performance of the different approaches to the #Microposts2015 NEEL Challenge. We also release, with this paper, the #Microposts2015 NEEL Challenge Gold Standard, comprising the set of manually annotated tweets. 

Document Bibtex

Title:Making sense of Microposts (#Microposts2015) named entity recognition & linking challenge
Keywords:Microposts, Named Entity Recognition, Named Entity Linking, Disambiguation, Knowledge Base, Evaluation, Challenge
Department:Data Science
Eurecom ref:4638
Copyright: © ACM, 2015. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in WWW 2015, 5th International Workshop on Making Sense of Microposts (#Microposts'15), May 18-22, 2015, Florence, Italy
Bibtex: @inproceedings{EURECOM+4638, year = {2015}, title = {{M}aking sense of {M}icroposts (\#{M}icroposts2015) named entity recognition \& linking challenge}, author = {{R}izzo, {G}iuseppe and {C}ano {A}mparo {E} and {P}ereira, {B}ianca and {V}arga, {A}ndrea}, booktitle = {{WWW} 2015, 5th {I}nternational {W}orkshop on {M}aking {S}ense of {M}icroposts (\#{M}icroposts'15), {M}ay 18-22, 2015, {F}lorence, {I}taly}, address = {{F}lorence, {ITALY}}, month = {05}, url = {} }
See also: