SemEval-2019 Task 8: Fact Checking in Community Question Answering
               Forums

Tsvetomila Mihaylova; Georgi Karadzhov; Pepa Atanasova; Ramy Baly; Mitra Mohtarami; Preslav Nakov

doi:10.18653/v1/s19-2149

SemEval-2019 Task 8: Fact Checking in Community Question Answering Forums

Tsvetomila Mihaylova, Georgi Karadzhov, Pepa Atanasova, Ramy Baly, Mitra Mohtarami, Preslav Nakov

Ei julkaistu Aalto-yliopiston affiliaatiolla

Instituto de Telecomunicações

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussa › Conference article in proceedings › Scientific › vertaisarvioitu

Abstrakti

We present SemEval-2019 Task 8 on Fact Checking in Community Question Answering Forums, which features two subtasks. Subtask A is about deciding whether a question asks for factual information vs. an opinion/advice vs. just socializing. Subtask B asks to predict whether an answer to a factual question is true, false or not a proper answer. We received 17 official submissions for subtask A and 11 official submissions for Subtask B. For subtask A, all systems improved over the majority class baseline. For Subtask B, all systems were below a majority class baseline, but several systems were very close to it. The leaderboard and the data from the competition can be found at http://competitions.codalab.org/competitions/20022.

Alkuperäiskieli	Englanti
Otsikko	Proceedings of the 13th International Workshop on Semantic Evaluation, SemEval@NAACL-HLT 2019, Minneapolis, MN, USA, June 6-7, 2019
Kustantaja	Association for Computational Linguistics
ISBN (elektroninen)	978-1-950737-06-2
DOI - pysyväislinkit	https://doi.org/10.18653/v1/s19-2149
Tila	Julkaistu - 2019
OKM-julkaisutyyppi	A4 Artikkeli konferenssijulkaisussa
Tapahtuma	International Workshop on Semantic Evaluation - Minneapolis, Yhdysvallat Kesto: 6 kesäk. 2019 → 7 kesäk. 2019 Konferenssinumero: 13

Workshop

Workshop	International Workshop on Semantic Evaluation
Lyhennettä	SemEval
Maa/Alue	Yhdysvallat
Kaupunki	Minneapolis
Ajanjakso	06/06/2019 → 07/06/2019

Pääsy asiakirjaan

10.18653/v1/s19-2149

Muut tiedostot ja linkit

https://doi.org/10.18653/v1/s19-2149

Siteeraa tätä

Mihaylova, T., Karadzhov, G., Atanasova, P., Baly, R., Mohtarami, M., & Nakov, P. (2019). SemEval-2019 Task 8: Fact Checking in Community Question Answering Forums. teoksessa Proceedings of the 13th International Workshop on Semantic Evaluation, SemEval@NAACL-HLT 2019, Minneapolis, MN, USA, June 6-7, 2019 Association for Computational Linguistics. https://doi.org/10.18653/v1/s19-2149

@inproceedings{4ac6f5708f9e4f4e88ef31316eb8ea01,

title = "SemEval-2019 Task 8: Fact Checking in Community Question Answering Forums",

abstract = "We present SemEval-2019 Task 8 on Fact Checking in Community Question Answering Forums, which features two subtasks. Subtask A is about deciding whether a question asks for factual information vs. an opinion/advice vs. just socializing. Subtask B asks to predict whether an answer to a factual question is true, false or not a proper answer. We received 17 official submissions for subtask A and 11 official submissions for Subtask B. For subtask A, all systems improved over the majority class baseline. For Subtask B, all systems were below a majority class baseline, but several systems were very close to it. The leaderboard and the data from the competition can be found at http://competitions.codalab.org/competitions/20022.",

author = "Tsvetomila Mihaylova and Georgi Karadzhov and Pepa Atanasova and Ramy Baly and Mitra Mohtarami and Preslav Nakov",

year = "2019",

doi = "10.18653/v1/s19-2149",

language = "English",

booktitle = "Proceedings of the 13th International Workshop on Semantic Evaluation, SemEval@NAACL-HLT 2019, Minneapolis, MN, USA, June 6-7, 2019",

publisher = "Association for Computational Linguistics",

address = "United States",

note = "International Workshop on Semantic Evaluation, SemEval ; Conference date: 06-06-2019 Through 07-06-2019",

}

Mihaylova, T, Karadzhov, G, Atanasova, P, Baly, R, Mohtarami, M & Nakov, P 2019, SemEval-2019 Task 8: Fact Checking in Community Question Answering Forums. julkaisussa Proceedings of the 13th International Workshop on Semantic Evaluation, SemEval@NAACL-HLT 2019, Minneapolis, MN, USA, June 6-7, 2019. Association for Computational Linguistics, International Workshop on Semantic Evaluation, Minneapolis, Minnesota, Yhdysvallat, 06/06/2019. https://doi.org/10.18653/v1/s19-2149

SemEval-2019 Task 8: Fact Checking in Community Question Answering Forums. / Mihaylova, Tsvetomila; Karadzhov, Georgi; Atanasova, Pepa et al.
Proceedings of the 13th International Workshop on Semantic Evaluation, SemEval@NAACL-HLT 2019, Minneapolis, MN, USA, June 6-7, 2019. Association for Computational Linguistics, 2019.

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussa › Conference article in proceedings › Scientific › vertaisarvioitu

TY - GEN

T1 - SemEval-2019 Task 8: Fact Checking in Community Question Answering Forums

AU - Mihaylova, Tsvetomila

AU - Karadzhov, Georgi

AU - Atanasova, Pepa

AU - Baly, Ramy

AU - Mohtarami, Mitra

AU - Nakov, Preslav

N1 - Conference code: 13

PY - 2019

Y1 - 2019

N2 - We present SemEval-2019 Task 8 on Fact Checking in Community Question Answering Forums, which features two subtasks. Subtask A is about deciding whether a question asks for factual information vs. an opinion/advice vs. just socializing. Subtask B asks to predict whether an answer to a factual question is true, false or not a proper answer. We received 17 official submissions for subtask A and 11 official submissions for Subtask B. For subtask A, all systems improved over the majority class baseline. For Subtask B, all systems were below a majority class baseline, but several systems were very close to it. The leaderboard and the data from the competition can be found at http://competitions.codalab.org/competitions/20022.

AB - We present SemEval-2019 Task 8 on Fact Checking in Community Question Answering Forums, which features two subtasks. Subtask A is about deciding whether a question asks for factual information vs. an opinion/advice vs. just socializing. Subtask B asks to predict whether an answer to a factual question is true, false or not a proper answer. We received 17 official submissions for subtask A and 11 official submissions for Subtask B. For subtask A, all systems improved over the majority class baseline. For Subtask B, all systems were below a majority class baseline, but several systems were very close to it. The leaderboard and the data from the competition can be found at http://competitions.codalab.org/competitions/20022.

UR - https://doi.org/10.18653/v1/s19-2149

U2 - 10.18653/v1/s19-2149

DO - 10.18653/v1/s19-2149

M3 - Conference article in proceedings

BT - Proceedings of the 13th International Workshop on Semantic Evaluation, SemEval@NAACL-HLT 2019, Minneapolis, MN, USA, June 6-7, 2019

PB - Association for Computational Linguistics

T2 - International Workshop on Semantic Evaluation

Y2 - 6 June 2019 through 7 June 2019

ER -