Towards a benchmark for fact checking with knowledge bases

Huynh, Viet Phi; Papotti, Paolo
RoD 2018, Reasoning on Data Workshop, collocated with WWW 2018, April 24, 2018, Lyon, France

Fact checking is the task of determining if a given claim holds. Several algorithms have been developed to check facts with reference information in the form of knowledge bases. While individual algorithms have been experimentally evaluated, we provide a first
publicly available benchmark evaluating fact checking implementations across a range of assumptions about the properties of the facts and the reference data. We used our benchmark to compare algorithms designed on different principles and assumptions, as
well as algorithms that can solve similar tasks developed in closely related communities. Our evaluation provided us with a number of new insights concerning the factors that impact the performance of the different methods.

DOI
Type:
Conférence
City:
Lyon
Date:
2018-04-24
Department:
Data Science
Eurecom Ref:
5468
Copyright:
© ACM, 2018. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in RoD 2018, Reasoning on Data Workshop, collocated with WWW 2018, April 24, 2018, Lyon, France http://dx.doi.org/10.1145/3184558.3191616
See also:

PERMALINK : https://www.eurecom.fr/publication/5468