Replication in Computing Education Research: Researcher Attitudes and Experiences

Alireza Ahadi, Arto Hellas, Petri Ihantola, Ari Korhonen, Andrew Petersen

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

13 Citations (Scopus)

Abstract

Replicability is a core principle of the scientific method. However, several scientific disciplines have suffered crises in confidence caused, in large part, by attitudes toward replication. This work reports on the value the computing education research community associates with studies that aim to replicate, reproduce or repeat earlier research. The results were obtained from a survey of 73 computing education researchers. An analysis of the responses confirms that researchers in our field hold many of the same biases as those in other fields experiencing a crisis in replication. In particular, researchers agree that original works - novel works that report new phenomena - have more impact and are more prestigious. They also agree that originality is an important criteria for accepting a paper, making such work more likely to be published. Furthermore, while the respondents agree that published work should be verifiable, they doubt this standard is widely met in the computing education field and are not eager to perform the work of verifying others' work themselves.
Original languageEnglish
Title of host publicationProceedings of the 16th Koli Calling International Conference on Computing Education Research
PublisherACM
Pages2-11
Number of pages10
ISBN (Print)978-1-4503-4770-9
DOIs
Publication statusPublished - 2016
MoE publication typeA4 Article in a conference publication
EventKoli Calling - International Conference on Computing Education Research - Koli, Lieksa, Finland
Duration: 24 Nov 201627 Nov 2016
Conference number: 16
http://kolicalling.fi

Conference

ConferenceKoli Calling - International Conference on Computing Education Research
CountryFinland
CityLieksa
Period24/11/201627/11/2016
Internet address

Fingerprint Dive into the research topics of 'Replication in Computing Education Research: Researcher Attitudes and Experiences'. Together they form a unique fingerprint.

  • Cite this

    Ahadi, A., Hellas, A., Ihantola, P., Korhonen, A., & Petersen, A. (2016). Replication in Computing Education Research: Researcher Attitudes and Experiences. In Proceedings of the 16th Koli Calling International Conference on Computing Education Research (pp. 2-11). ACM. https://doi.org/10.1145/2999541.2999554