Fact Checking in Community Forums

Tsvetomila Mihaylova; Preslav Nakov; Lluís Màrquez; Alberto Barrón-Cedeño; Mitra Mohtarami; Georgi Karadzhnov; James Glass

doi:10.1609/aaai.v32i1.11983

Fact Checking in Community Forums

Tsvetomila Mihaylova, Preslav Nakov, Lluís Màrquez, Alberto Barrón-Cedeño, Mitra Mohtarami, Georgi Karadzhnov, James Glass

Ei julkaistu Aalto-yliopiston affiliaatiolla

Department of Astronomy, University of Sofia "St. Kliment Ohridski"

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussa › Conference article in proceedings › Scientific › vertaisarvioitu

Abstrakti

Community Question Answering (cQA) forums are very popular nowadays, as they represent effective means for communities around particular topics to share information. Unfortunately, this information is not always factual. Thus, here we explore a new dimension in the context of cQA, which has been ignored so far: checking the veracity of answers to particular questions in cQA forums. As this is a new problem, we create a specialized dataset for it. We further propose a novel multi-faceted model, which captures information from the answer content (what is said and how), from the author profile (who says it), from the rest of the community forum (where it is said), and from external authoritative sources of information (external support). Evaluation results show a MAP value of 86.54, which is 21 points absolute above the baseline.

Alkuperäiskieli	Englanti
Otsikko	Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018
Kustantaja	AAAI Press
DOI - pysyväislinkit	https://doi.org/10.1609/aaai.v32i1.11983
Tila	Julkaistu - 2018
OKM-julkaisutyyppi	A4 Artikkeli konferenssijulkaisussa
Tapahtuma	AAAI Conference on Artificial Intelligence - Hilton New Orleans Riverside, New Orleans, Yhdysvallat Kesto: 2 helmik. 2018 → 7 helmik. 2018 Konferenssinumero: 32

Julkaisusarja

Nimi	Proceedings of the AAAI Conference on Artificial Intelligence
Numero	1
Vuosikerta	33
ISSN (painettu)	2159-5399
ISSN (elektroninen)	2374-3468

Conference

Conference	AAAI Conference on Artificial Intelligence
Lyhennettä	AAAI
Maa/Alue	Yhdysvallat
Kaupunki	New Orleans
Ajanjakso	02/02/2018 → 07/02/2018

Pääsy asiakirjaan

10.1609/aaai.v32i1.11983

Muut tiedostot ja linkit

https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/view/16780

Siteeraa tätä

Mihaylova, T., Nakov, P., Màrquez, L., Barrón-Cedeño, A., Mohtarami, M., Karadzhnov, G., & Glass, J. (2018). Fact Checking in Community Forums. teoksessa Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018 (Proceedings of the AAAI Conference on Artificial Intelligence; Vuosikerta 33, Nro 1). AAAI Press. https://doi.org/10.1609/aaai.v32i1.11983

Mihaylova, Tsvetomila ; Nakov, Preslav ; Màrquez, Lluís et al. / Fact Checking in Community Forums. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018. AAAI Press, 2018. (Proceedings of the AAAI Conference on Artificial Intelligence; 1).

@inproceedings{78acfd496f2c40199a6276cea38dbf37,

title = "Fact Checking in Community Forums",

abstract = " Community Question Answering (cQA) forums are very popular nowadays, as they represent effective means for communities around particular topics to share information. Unfortunately, this information is not always factual. Thus, here we explore a new dimension in the context of cQA, which has been ignored so far: checking the veracity of answers to particular questions in cQA forums. As this is a new problem, we create a specialized dataset for it. We further propose a novel multi-faceted model, which captures information from the answer content (what is said and how), from the author profile (who says it), from the rest of the community forum (where it is said), and from external authoritative sources of information (external support). Evaluation results show a MAP value of 86.54, which is 21 points absolute above the baseline.",

keywords = "fact checking, veracity, community, question answering",

author = "Tsvetomila Mihaylova and Preslav Nakov and Llu{\'i}s M{\`a}rquez and Alberto Barr{\'o}n-Cede{\~n}o and Mitra Mohtarami and Georgi Karadzhnov and James Glass",

year = "2018",

doi = "10.1609/aaai.v32i1.11983",

language = "English",

series = "Proceedings of the AAAI Conference on Artificial Intelligence",

publisher = "AAAI Press",

number = "1",

booktitle = "Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018",

address = "United States",

note = "AAAI Conference on Artificial Intelligence, AAAI ; Conference date: 02-02-2018 Through 07-02-2018",

}

Mihaylova, T, Nakov, P, Màrquez, L, Barrón-Cedeño, A, Mohtarami, M, Karadzhnov, G & Glass, J 2018, Fact Checking in Community Forums. julkaisussa Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018. Proceedings of the AAAI Conference on Artificial Intelligence, Nro 1, Vuosikerta 33, AAAI Press, AAAI Conference on Artificial Intelligence, New Orleans, Louisiana, Yhdysvallat, 02/02/2018. https://doi.org/10.1609/aaai.v32i1.11983

Fact Checking in Community Forums. / Mihaylova, Tsvetomila; Nakov, Preslav; Màrquez, Lluís et al.
Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018. AAAI Press, 2018. (Proceedings of the AAAI Conference on Artificial Intelligence; Vuosikerta 33, Nro 1).

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussa › Conference article in proceedings › Scientific › vertaisarvioitu

TY - GEN

T1 - Fact Checking in Community Forums

AU - Mihaylova, Tsvetomila

AU - Nakov, Preslav

AU - Màrquez, Lluís

AU - Barrón-Cedeño, Alberto

AU - Mohtarami, Mitra

AU - Karadzhnov, Georgi

AU - Glass, James

N1 - Conference code: 32

PY - 2018

Y1 - 2018

N2 - Community Question Answering (cQA) forums are very popular nowadays, as they represent effective means for communities around particular topics to share information. Unfortunately, this information is not always factual. Thus, here we explore a new dimension in the context of cQA, which has been ignored so far: checking the veracity of answers to particular questions in cQA forums. As this is a new problem, we create a specialized dataset for it. We further propose a novel multi-faceted model, which captures information from the answer content (what is said and how), from the author profile (who says it), from the rest of the community forum (where it is said), and from external authoritative sources of information (external support). Evaluation results show a MAP value of 86.54, which is 21 points absolute above the baseline.

AB - Community Question Answering (cQA) forums are very popular nowadays, as they represent effective means for communities around particular topics to share information. Unfortunately, this information is not always factual. Thus, here we explore a new dimension in the context of cQA, which has been ignored so far: checking the veracity of answers to particular questions in cQA forums. As this is a new problem, we create a specialized dataset for it. We further propose a novel multi-faceted model, which captures information from the answer content (what is said and how), from the author profile (who says it), from the rest of the community forum (where it is said), and from external authoritative sources of information (external support). Evaluation results show a MAP value of 86.54, which is 21 points absolute above the baseline.

KW - fact checking

KW - veracity

KW - community

KW - question answering

UR - https://www.aaai.org/ocs/index.php/AAAI/AAAI18/paper/view/16780

U2 - 10.1609/aaai.v32i1.11983

DO - 10.1609/aaai.v32i1.11983

M3 - Conference article in proceedings

T3 - Proceedings of the AAAI Conference on Artificial Intelligence

BT - Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018

PB - AAAI Press

T2 - AAAI Conference on Artificial Intelligence

Y2 - 2 February 2018 through 7 February 2018

ER -

Mihaylova T, Nakov P, Màrquez L, Barrón-Cedeño A, Mohtarami M, Karadzhnov G et al. Fact Checking in Community Forums. julkaisussa Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2-7, 2018. AAAI Press. 2018. (Proceedings of the AAAI Conference on Artificial Intelligence; 1). doi: 10.1609/aaai.v32i1.11983

Fact Checking in Community Forums

Abstrakti

Julkaisusarja

Conference

Pääsy asiakirjaan

Muut tiedostot ja linkit

Sormenjälki

Siteeraa tätä