Fact Checking in Community Forums

Tsvetomila Mihaylova; Preslav Nakov; Lluís Màrquez; Alberto Barrón-Cedeño; Mitra Mohtarami; Georgi Karadzhnov; James Glass

doi:10.1609/aaai.v32i1.11983

Fact Checking in Community Forums

Tsvetomila Mihaylova, Preslav Nakov, Lluís Màrquez, Alberto Barrón-Cedeño, Mitra Mohtarami, Georgi Karadzhnov, James Glass

Not published at Aalto University

Sofia University St. Kliment Ohridski

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

Abstract

Community Question Answering (cQA) forums are very popular nowadays, as they represent effective means for communities around particular topics to share information. Unfortunately, this information is not always factual. Thus, here we explore a new dimension in the context of cQA, which has been ignored so far: checking the veracity of answers to particular questions in cQA forums. As this is a new problem, we create a specialized dataset for it. We further propose a novel multi-faceted model, which captures information from the answer content (what is said and how), from the author profile (who says it), from the rest of the community forum (where it is said), and from external authoritative sources of information (external support). Evaluation results show a MAP value of 86.54, which is 21 points absolute above the baseline.

Original language	English
Title of host publication	Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018
Publisher	AAAI Press
DOIs	https://doi.org/10.1609/aaai.v32i1.11983
Publication status	Published - 2018
MoE publication type	A4 Conference publication
Event	AAAI Conference on Artificial Intelligence - Hilton New Orleans Riverside, New Orleans, United States Duration: 2 Feb 2018 → 7 Feb 2018 Conference number: 32

Publication series

Name	Proceedings of the AAAI Conference on Artificial Intelligence
Number	1
Volume	33
ISSN (Print)	2159-5399
ISSN (Electronic)	2374-3468

Conference

Conference	AAAI Conference on Artificial Intelligence
Abbreviated title	AAAI
Country/Territory	United States
City	New Orleans
Period	02/02/2018 → 07/02/2018

Keywords

fact checking
veracity
community
question answering

Access to Document

10.1609/aaai.v32i1.11983

Cite this

Mihaylova, T., Nakov, P., Màrquez, L., Barrón-Cedeño, A., Mohtarami, M., Karadzhnov, G., & Glass, J. (2018). Fact Checking in Community Forums. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018 (Proceedings of the AAAI Conference on Artificial Intelligence; Vol. 33, No. 1). AAAI Press. https://doi.org/10.1609/aaai.v32i1.11983

Mihaylova, Tsvetomila ; Nakov, Preslav ; Màrquez, Lluís et al. / Fact Checking in Community Forums. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018. AAAI Press, 2018. (Proceedings of the AAAI Conference on Artificial Intelligence; 1).

@inproceedings{78acfd496f2c40199a6276cea38dbf37,

title = "Fact Checking in Community Forums",

abstract = " Community Question Answering (cQA) forums are very popular nowadays, as they represent effective means for communities around particular topics to share information. Unfortunately, this information is not always factual. Thus, here we explore a new dimension in the context of cQA, which has been ignored so far: checking the veracity of answers to particular questions in cQA forums. As this is a new problem, we create a specialized dataset for it. We further propose a novel multi-faceted model, which captures information from the answer content (what is said and how), from the author profile (who says it), from the rest of the community forum (where it is said), and from external authoritative sources of information (external support). Evaluation results show a MAP value of 86.54, which is 21 points absolute above the baseline.",

keywords = "fact checking, veracity, community, question answering",

author = "Tsvetomila Mihaylova and Preslav Nakov and Llu{\'i}s M{\`a}rquez and Alberto Barr{\'o}n-Cede{\~n}o and Mitra Mohtarami and Georgi Karadzhnov and James Glass",

year = "2018",

doi = "10.1609/aaai.v32i1.11983",

language = "English",

series = "Proceedings of the AAAI Conference on Artificial Intelligence",

publisher = "AAAI Press",

number = "1",

booktitle = "Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018",

address = "United States",

note = "AAAI Conference on Artificial Intelligence, AAAI ; Conference date: 02-02-2018 Through 07-02-2018",

}

Mihaylova, T, Nakov, P, Màrquez, L, Barrón-Cedeño, A, Mohtarami, M, Karadzhnov, G & Glass, J 2018, Fact Checking in Community Forums. in Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018. Proceedings of the AAAI Conference on Artificial Intelligence, no. 1, vol. 33, AAAI Press, AAAI Conference on Artificial Intelligence, New Orleans, Louisiana, United States, 02/02/2018. https://doi.org/10.1609/aaai.v32i1.11983

Fact Checking in Community Forums. / Mihaylova, Tsvetomila; Nakov, Preslav; Màrquez, Lluís et al.
Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018. AAAI Press, 2018. (Proceedings of the AAAI Conference on Artificial Intelligence; Vol. 33, No. 1).

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

TY - GEN

T1 - Fact Checking in Community Forums

AU - Mihaylova, Tsvetomila

AU - Nakov, Preslav

AU - Màrquez, Lluís

AU - Barrón-Cedeño, Alberto

AU - Mohtarami, Mitra

AU - Karadzhnov, Georgi

AU - Glass, James

N1 - Conference code: 32

PY - 2018

Y1 - 2018

N2 - Community Question Answering (cQA) forums are very popular nowadays, as they represent effective means for communities around particular topics to share information. Unfortunately, this information is not always factual. Thus, here we explore a new dimension in the context of cQA, which has been ignored so far: checking the veracity of answers to particular questions in cQA forums. As this is a new problem, we create a specialized dataset for it. We further propose a novel multi-faceted model, which captures information from the answer content (what is said and how), from the author profile (who says it), from the rest of the community forum (where it is said), and from external authoritative sources of information (external support). Evaluation results show a MAP value of 86.54, which is 21 points absolute above the baseline.

AB - Community Question Answering (cQA) forums are very popular nowadays, as they represent effective means for communities around particular topics to share information. Unfortunately, this information is not always factual. Thus, here we explore a new dimension in the context of cQA, which has been ignored so far: checking the veracity of answers to particular questions in cQA forums. As this is a new problem, we create a specialized dataset for it. We further propose a novel multi-faceted model, which captures information from the answer content (what is said and how), from the author profile (who says it), from the rest of the community forum (where it is said), and from external authoritative sources of information (external support). Evaluation results show a MAP value of 86.54, which is 21 points absolute above the baseline.

KW - fact checking

KW - veracity

KW - community

KW - question answering

UR - https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/view/16780

U2 - 10.1609/aaai.v32i1.11983

DO - 10.1609/aaai.v32i1.11983

M3 - Conference article in proceedings

T3 - Proceedings of the AAAI Conference on Artificial Intelligence

BT - Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018

PB - AAAI Press

T2 - AAAI Conference on Artificial Intelligence

Y2 - 2 February 2018 through 7 February 2018

ER -

Mihaylova T, Nakov P, Màrquez L, Barrón-Cedeño A, Mohtarami M, Karadzhnov G et al. Fact Checking in Community Forums. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018. AAAI Press. 2018. (Proceedings of the AAAI Conference on Artificial Intelligence; 1). doi: 10.1609/aaai.v32i1.11983

Fact Checking in Community Forums

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this