We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement

Mari Tyllinen; Johanna Kaipio; Tinja Lääveri; Marko Nieminen

doi:10.1145/2858036.2858570

We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement

Mari Tyllinen, Johanna Kaipio, Tinja Lääveri, Marko Nieminen

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

5 Citations (Scopus)

Abstract

We introduce a new usability inspection method called HED (heuristic evaluation during demonstrations) for measuring and comparing usability of competing complex IT systems in public procurement. The method presented enhances traditional heuristic evaluation to include the use context, comprehensive view of the system, and reveals missing functionality by using user scenarios and demonstrations. HED also quantifies the results in a comparable way. We present findings from a real-life validation of the method in a large-scale procurement project of a healthcare and social welfare information system. We analyze and compare the performance of HED to other usability evaluation methods used in procurement. Based on the analysis HED can be used to evaluate the level of usability of an IT system during procurement correctly, comprehensively and efficiently.

Original language	English
Title of host publication	Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
Publisher	ACM
Pages	4129-4141
Number of pages	13
ISBN (Print)	978-1-4503-3362-7
DOIs	https://doi.org/10.1145/2858036.2858570
Publication status	Published - May 2016
MoE publication type	A4 Article in a conference publication
Event	ACM SIGCHI Annual Conference on Human Factors in Computing Systems - Colorado Convention Center, Denver, United States Duration: 6 May 2017 → 11 May 2017 Conference number: 35 https://chi2017.acm.org/

Conference

Conference	ACM SIGCHI Annual Conference on Human Factors in Computing Systems
Abbreviated title	ACM CHI
Country/Territory	United States
City	Denver
Period	06/05/2017 → 11/05/2017
Internet address	https://chi2017.acm.org/

Keywords

Usability evaluation
Public Procurement
summative evaluation
measuring usability
healthcare and social welfare information system
Electronic Health Record

Access to Document

10.1145/2858036.2858570

Cite this

@inproceedings{a0b9bd3411314f6780c14cc362881d2d,

title = "We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement",

abstract = "We introduce a new usability inspection method called HED (heuristic evaluation during demonstrations) for measuring and comparing usability of competing complex IT systems in public procurement. The method presented enhances traditional heuristic evaluation to include the use context, comprehensive view of the system, and reveals missing functionality by using user scenarios and demonstrations. HED also quantifies the results in a comparable way. We present findings from a real-life validation of the method in a large-scale procurement project of a healthcare and social welfare information system. We analyze and compare the performance of HED to other usability evaluation methods used in procurement. Based on the analysis HED can be used to evaluate the level of usability of an IT system during procurement correctly, comprehensively and efficiently.",

keywords = "Usability evaluation, Public Procurement, summative evaluation, measuring usability, healthcare and social welfare information system, Electronic Health Record",

author = "Mari Tyllinen and Johanna Kaipio and Tinja L{\"a}{\"a}veri and Marko Nieminen",

year = "2016",

month = may,

doi = "10.1145/2858036.2858570",

language = "English",

isbn = "978-1-4503-3362-7",

pages = "4129--4141",

booktitle = "Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems",

publisher = "ACM",

note = "ACM SIGCHI Annual Conference on Human Factors in Computing Systems, ACM CHI ; Conference date: 06-05-2017 Through 11-05-2017",

url = "https://chi2017.acm.org/",

}

Tyllinen, M , Kaipio, J, Lääveri, T & Nieminen, M 2016, We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement. in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, pp. 4129-4141, ACM SIGCHI Annual Conference on Human Factors in Computing Systems, Denver, Colorado, United States, 06/05/2017. https://doi.org/10.1145/2858036.2858570

We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement. / Tyllinen, Mari ; Kaipio, Johanna; Lääveri, Tinja; Nieminen, Marko.

Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2016. p. 4129-4141.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

TY - GEN

T1 - We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement

AU - Tyllinen, Mari

AU - Kaipio, Johanna

AU - Lääveri, Tinja

AU - Nieminen, Marko

N1 - Conference code: 35

PY - 2016/5

Y1 - 2016/5

N2 - We introduce a new usability inspection method called HED (heuristic evaluation during demonstrations) for measuring and comparing usability of competing complex IT systems in public procurement. The method presented enhances traditional heuristic evaluation to include the use context, comprehensive view of the system, and reveals missing functionality by using user scenarios and demonstrations. HED also quantifies the results in a comparable way. We present findings from a real-life validation of the method in a large-scale procurement project of a healthcare and social welfare information system. We analyze and compare the performance of HED to other usability evaluation methods used in procurement. Based on the analysis HED can be used to evaluate the level of usability of an IT system during procurement correctly, comprehensively and efficiently.

AB - We introduce a new usability inspection method called HED (heuristic evaluation during demonstrations) for measuring and comparing usability of competing complex IT systems in public procurement. The method presented enhances traditional heuristic evaluation to include the use context, comprehensive view of the system, and reveals missing functionality by using user scenarios and demonstrations. HED also quantifies the results in a comparable way. We present findings from a real-life validation of the method in a large-scale procurement project of a healthcare and social welfare information system. We analyze and compare the performance of HED to other usability evaluation methods used in procurement. Based on the analysis HED can be used to evaluate the level of usability of an IT system during procurement correctly, comprehensively and efficiently.

KW - Usability evaluation

KW - Public Procurement

KW - summative evaluation

KW - measuring usability

KW - healthcare and social welfare information system

KW - Electronic Health Record

U2 - 10.1145/2858036.2858570

DO - 10.1145/2858036.2858570

M3 - Conference contribution

SN - 978-1-4503-3362-7

SP - 4129

EP - 4141

BT - Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

PB - ACM

T2 - ACM SIGCHI Annual Conference on Human Factors in Computing Systems

Y2 - 6 May 2017 through 11 May 2017

ER -

We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement

Abstract

Conference

Keywords

Access to Document

Fingerprint

Cite this