Graduate School and Research Center in Digital Sciences

Buckle: Evaluating fact checking algorithms built on knowledge bases

Huynh, Viet-Phi; Papotti, Paolo

VLDB 2019, 45th International Conference on Very Large Data Bases, 26-30 August 2019, Los Angeles, CA, USA

Fact checking is the task of determining if a given claim holds. Several algorithms have been developed to check facts with reference information in the form of knowledge bases. We demonstrate BUCKLE, an open-source benchmark for comparing and evaluating fact checking algorithms in a level playing field across a range of scenarios. The demo is centered around three main lessons. To start, we show how, by changing the properties of the training and test facts, it is possible to influence significantly the performance of the algorithms. We then show the role of the reference data. Finally, we discuss the performance for algorithms designed on different principles and assumptions, as well as approaches that address the link prediction task in knowledge bases.

Document Doi Bibtex

Title:Buckle: Evaluating fact checking algorithms built on knowledge bases
Type:Conference
Language:English
City:Los Angeles
Country:UNITED STATES
Date:
Department:Data Science
Eurecom ref:6021
Copyright: © ACM, 2019. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in VLDB 2019, 45th International Conference on Very Large Data Bases, 26-30 August 2019, Los Angeles, CA, USA http://dx.doi.org/10.14778/3352063.3352069
Bibtex: @inproceedings{EURECOM+6021, doi = {http://dx.doi.org/10.14778/3352063.3352069}, year = {2019}, title = {{B}uckle: {E}valuating fact checking algorithms built on knowledge bases}, author = {{H}uynh, {V}iet-{P}hi and {P}apotti, {P}aolo}, booktitle = {{VLDB} 2019, 45th {I}nternational {C}onference on {V}ery {L}arge {D}ata {B}ases, 26-30 {A}ugust 2019, {L}os {A}ngeles, {CA}, {USA}}, address = {{L}os {A}ngeles, {UNITED} {STATES}}, month = {08}, url = {http://www.eurecom.fr/publication/6021} }
See also: