Evaluation of prototypes and the problem of possible futures

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

10 Citations (Scopus)
123 Downloads (Pure)

Abstract

There is a blind spot in HCI’s evaluation methodology: we rarely consider the implications of the fact that a prototype can never be fully evaluated in a study. A prototype under study exists firmly in the present world, in the circumstances created in the study, but its real context of use is a partially unknown future state of affairs. This present–future gap is implicit in any evaluation of prototypes, be they usability tests, controlled experiments, or field trials. A carelessly designed evaluation may inadvertently evaluate the wrong futures, contexts, or user groups, thereby leading to false conclusions
and expensive design failures. The essay analyses evaluation methodology from this perspective, illuminating how to mitigate the present–future gap.
Original languageEnglish
Title of host publicationCHI 2017 - Proceedings of the 2017 ACM SIGCHI Conference on Human Factors in Computing Systems
PublisherACM SIGCHI
Pages2064-2077
ISBN (Print)978-1-4503-4655-9
DOIs
Publication statusPublished - 2017
MoE publication typeA4 Article in a conference publication
EventACM SIGCHI Annual Conference on Human Factors in Computing Systems - Colorado Convention Center, Denver, United States
Duration: 6 May 201711 May 2017
Conference number: 35
https://chi2017.acm.org/

Conference

ConferenceACM SIGCHI Annual Conference on Human Factors in Computing Systems
Abbreviated titleACM CHI
CountryUnited States
CityDenver
Period06/05/201711/05/2017
Internet address

Keywords

  • Evaluation methodology
  • Field trials
  • Experiments
  • Usability studies
  • Prototypes
  • Future

Fingerprint Dive into the research topics of 'Evaluation of prototypes and the problem of possible futures'. Together they form a unique fingerprint.

  • Cite this

    Salovaara, A., Oulasvirta, A., & Jacucci, G. (2017). Evaluation of prototypes and the problem of possible futures. In CHI 2017 - Proceedings of the 2017 ACM SIGCHI Conference on Human Factors in Computing Systems (pp. 2064-2077). ACM SIGCHI. https://doi.org/10.1145/3025453.3025658