We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement

Mari Tyllinen; Johanna Kaipio; Tinja Lääveri; Marko Nieminen

doi:10.1145/2858036.2858570

We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement

Mari Tyllinen, Johanna Kaipio, Tinja Lääveri, Marko Nieminen

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussa › Conference article in proceedings › Scientific › vertaisarvioitu

6 Sitaatiot (Scopus)

Abstrakti

We introduce a new usability inspection method called HED (heuristic evaluation during demonstrations) for measuring and comparing usability of competing complex IT systems in public procurement. The method presented enhances traditional heuristic evaluation to include the use context, comprehensive view of the system, and reveals missing functionality by using user scenarios and demonstrations. HED also quantifies the results in a comparable way. We present findings from a real-life validation of the method in a large-scale procurement project of a healthcare and social welfare information system. We analyze and compare the performance of HED to other usability evaluation methods used in procurement. Based on the analysis HED can be used to evaluate the level of usability of an IT system during procurement correctly, comprehensively and efficiently.

Alkuperäiskieli	Englanti
Otsikko	Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems
Kustantaja	ACM
Sivut	4129-4141
Sivumäärä	13
ISBN (painettu)	978-1-4503-3362-7
DOI - pysyväislinkit	https://doi.org/10.1145/2858036.2858570
Tila	Julkaistu - toukok. 2016
OKM-julkaisutyyppi	A4 Artikkeli konferenssijulkaisussa
Tapahtuma	ACM SIGCHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS - Colorado Convention Center, Denver, Yhdysvallat Kesto: 6 toukok. 2017 → 11 toukok. 2017 Konferenssinumero: 35 https://chi2017.acm.org/

Conference

Conference	ACM SIGCHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS
Lyhennettä	ACM CHI
Maa/Alue	Yhdysvallat
Kaupunki	Denver
Ajanjakso	06/05/2017 → 11/05/2017
www-osoite	https://chi2017.acm.org/

Pääsy asiakirjaan

10.1145/2858036.2858570

6 Viittaukset
1 Article

Menettelyprosessi käytettävyys- ja loppukäyttäjänäkökulman integroimiseksi tietojärjestelmähankintaan: Tapaus Apotti
Kaipio, J., Lääveri, T. & Tyllinen, M., 2015, julkaisussa: Finnish Journal of eHealth and eWelfare . 7, 2-3, s. 104-121
Tutkimustuotos: Lehtiartikkeli › Article › Scientific › vertaisarvioitu

Open access
Tiedosto

Siteeraa tätä

@inproceedings{a0b9bd3411314f6780c14cc362881d2d,

title = "We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement",

abstract = "We introduce a new usability inspection method called HED (heuristic evaluation during demonstrations) for measuring and comparing usability of competing complex IT systems in public procurement. The method presented enhances traditional heuristic evaluation to include the use context, comprehensive view of the system, and reveals missing functionality by using user scenarios and demonstrations. HED also quantifies the results in a comparable way. We present findings from a real-life validation of the method in a large-scale procurement project of a healthcare and social welfare information system. We analyze and compare the performance of HED to other usability evaluation methods used in procurement. Based on the analysis HED can be used to evaluate the level of usability of an IT system during procurement correctly, comprehensively and efficiently.",

keywords = "Usability evaluation, Public Procurement, summative evaluation, measuring usability, healthcare and social welfare information system, Electronic Health Record",

author = "Mari Tyllinen and Johanna Kaipio and Tinja L{\"a}{\"a}veri and Marko Nieminen",

year = "2016",

month = may,

doi = "10.1145/2858036.2858570",

language = "English",

isbn = "978-1-4503-3362-7",

pages = "4129--4141",

booktitle = "Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems",

publisher = "ACM",

address = "United States",

note = "ACM SIGCHI Annual Conference on Human Factors in Computing Systems, ACM CHI ; Conference date: 06-05-2017 Through 11-05-2017",

url = "https://chi2017.acm.org/",

}

Tyllinen, M, Kaipio, J, Lääveri, T & Nieminen, M 2016, We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement. julkaisussa Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, Sivut 4129-4141, ACM SIGCHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, Denver, Colorado, Yhdysvallat, 06/05/2017. https://doi.org/10.1145/2858036.2858570

We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement. / Tyllinen, Mari; Kaipio, Johanna; Lääveri, Tinja et al.
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2016. s. 4129-4141.

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussa › Conference article in proceedings › Scientific › vertaisarvioitu

TY - GEN

T1 - We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement

AU - Tyllinen, Mari

AU - Kaipio, Johanna

AU - Lääveri, Tinja

AU - Nieminen, Marko

N1 - Conference code: 35

PY - 2016/5

Y1 - 2016/5

N2 - We introduce a new usability inspection method called HED (heuristic evaluation during demonstrations) for measuring and comparing usability of competing complex IT systems in public procurement. The method presented enhances traditional heuristic evaluation to include the use context, comprehensive view of the system, and reveals missing functionality by using user scenarios and demonstrations. HED also quantifies the results in a comparable way. We present findings from a real-life validation of the method in a large-scale procurement project of a healthcare and social welfare information system. We analyze and compare the performance of HED to other usability evaluation methods used in procurement. Based on the analysis HED can be used to evaluate the level of usability of an IT system during procurement correctly, comprehensively and efficiently.

AB - We introduce a new usability inspection method called HED (heuristic evaluation during demonstrations) for measuring and comparing usability of competing complex IT systems in public procurement. The method presented enhances traditional heuristic evaluation to include the use context, comprehensive view of the system, and reveals missing functionality by using user scenarios and demonstrations. HED also quantifies the results in a comparable way. We present findings from a real-life validation of the method in a large-scale procurement project of a healthcare and social welfare information system. We analyze and compare the performance of HED to other usability evaluation methods used in procurement. Based on the analysis HED can be used to evaluate the level of usability of an IT system during procurement correctly, comprehensively and efficiently.

KW - Usability evaluation

KW - Public Procurement

KW - summative evaluation

KW - measuring usability

KW - healthcare and social welfare information system

KW - Electronic Health Record

U2 - 10.1145/2858036.2858570

DO - 10.1145/2858036.2858570

M3 - Conference article in proceedings

SN - 978-1-4503-3362-7

SP - 4129

EP - 4141

BT - Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

PB - ACM

T2 - ACM SIGCHI Annual Conference on Human Factors in Computing Systems

Y2 - 6 May 2017 through 11 May 2017

ER -

We Need Numbers! - Heuristic Evaluation during Demonstrations (HED) for Measuring Usability in IT System Procurement

Abstrakti

Conference

Pääsy asiakirjaan

Sormenjälki

Tutkimustuotos

Menettelyprosessi käytettävyys- ja loppukäyttäjänäkökulman integroimiseksi tietojärjestelmähankintaan: Tapaus Apotti

Siteeraa tätä