Statistical Significance Testing at CHI PLAY: Challenges and Opportunities for More Transparency

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference contributionScientificvertaisarvioitu

17 Sitaatiot (Scopus)
174 Lataukset (Pure)

Abstrakti

Statistical Significance Testing -- or Null Hypothesis Significance Testing (NHST) -- is common to quantitative CHI PLAY research. Drawing from recent work in HCI and psychology promoting transparent statistics and the reduction of questionable research practices, we systematically review the reporting quality of 119 CHI PLAY papers using NHST (data and analysis plan at https://osf.io/4mcbn/. We find that over half of these papers employ NHST without specific statistical hypotheses or research questions, which may risk the proliferation of false positive findings. Moreover, we observe inconsistencies in the reporting of sample sizes and statistical tests. These issues reflect fundamental incompatibilities between NHST and the frequently exploratory work common to CHI PLAY. We discuss the complementary roles of exploratory and confirmatory research, and provide a template for more transparent research and reporting practices.
AlkuperäiskieliEnglanti
OtsikkoCHI PLAY 2020 - Proceedings of the Annual Symposium on Computer-Human Interaction in Play
KustantajaACM
Sivut4-18
Sivumäärä15
ISBN (elektroninen)978-1-4503-8074-4
DOI - pysyväislinkit
TilaJulkaistu - 2 marrask. 2020
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaACM SIGCHI Annual Symposium on Computer-Human Interaction in Play - Virtual, Online, Kanada
Kesto: 1 marrask. 20204 marrask. 2020
Konferenssinumero: 7

Conference

ConferenceACM SIGCHI Annual Symposium on Computer-Human Interaction in Play
LyhennettäCHI PLAY
Maa/AlueKanada
KaupunkiVirtual, Online
Ajanjakso01/11/202004/11/2020

Sormenjälki

Sukella tutkimusaiheisiin 'Statistical Significance Testing at CHI PLAY: Challenges and Opportunities for More Transparency'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä