Context Changes and the Performance of a Learning Human-in-the-loop System: A Case Study of Automatic Speech Recognition Use in Medical Transcription

Tomasz Mucha, Jane Seppälä, Henrik Puraskivi

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

1 Citation (Scopus)
48 Downloads (Pure)

Abstract

The paper presents how organizational practices enable the improvement and maintenance of task performance in a learning human-in-the-loop system exposed to a wide range of context changes. We investigate how the case company tripled the efficiency of medical transcribers by leveraging its machine learning-based automatic speech recognition technology. We find that the focal system operated across stable, drifting, and jumping contexts. Despite changes, it continued to improve or maintained performance thanks to two sets of organizational practices aligning it with the context: extending and refining. This paper makes two key contributions: It shows the importance of considering context changes in the design and operation of learning human-in-the-loop systems. Our empirical findings help with resolving some contradictory outcomes of the recent conceptual work. Secondly, we show that context alignment practices are situated at the sociotechnical system level and, thus, are not just technical solution nor can be detached from social elements.
Original languageEnglish
Title of host publicationProceedings of the 56th Hawaii International Conference on System Sciences
EditorsTung X. Bui
PublisherHawaii International Conference on System Sciences
Pages3121-3130
Number of pages10
ISBN (Electronic)978-0-9981331-6-4
Publication statusPublished - Jan 2023
MoE publication typeA4 Conference publication
EventAnnual Hawaii International Conference on System Sciences - Maui, United States
Duration: 3 Jan 20236 Jan 2023
Conference number: 56

Conference

ConferenceAnnual Hawaii International Conference on System Sciences
Abbreviated titleHICSS
Country/TerritoryUnited States
CityMaui
Period03/01/202306/01/2023

Keywords

  • human-in-the-loop
  • machine learning
  • artificial intelligence
  • task performance

Fingerprint

Dive into the research topics of 'Context Changes and the Performance of a Learning Human-in-the-loop System: A Case Study of Automatic Speech Recognition Use in Medical Transcription'. Together they form a unique fingerprint.

Cite this