A user study to compare two conversational assistants designed for people with hearing impairments

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

19 Downloads (Pure)

Abstract

Participating in conversations can be difficult for people with hearing loss, especially in acoustically challenging environments. We studied the preferences the hearing impaired have for a personal conversation assistant based on automatic speech recognition (ASR) technology. We created two prototypes which were evaluated by hearing impaired test users. This paper qualitatively compares the two based on the feedback obtained from the tests. The first prototype was a proof-of-concept system running real-time ASR on a laptop. The second prototype was developed for a mobile device with the recognizer running on a separate server. In the mobile device, augmented reality (AR) was used to help the hearing impaired observe gestures and lip movements of the speaker simultaneously with the transcriptions. Several testers found the systems useful enough to use in their daily lives, with majority preferring the mobile AR version. The biggest concern of the testers was the accuracy of the transcriptions and the lack of speaker identification.
Original languageEnglish
Title of host publicationProceedings of the Eighth Workshop on Speech and Language Processing for Assistive Technologies
Pages1-8
Number of pages8
ISBN (Electronic)978-1-950737-08-6
Publication statusPublished - Jun 2019
MoE publication typeA4 Article in a conference publication
EventWorkshop on Speech and Language Processing for Assistive Technologies - Minneapolis, United States
Duration: 7 Jun 20197 Jun 2019
Conference number: 8

Workshop

WorkshopWorkshop on Speech and Language Processing for Assistive Technologies
Abbreviated titleSLPAT
CountryUnited States
CityMinneapolis
Period07/06/201907/06/2019

Keywords

  • speech recognition
  • hearing impairment
  • assistive technology
  • user testing

Fingerprint Dive into the research topics of 'A user study to compare two conversational assistants designed for people with hearing impairments'. Together they form a unique fingerprint.

  • Projects

    Conversation assistant for the hearing impaired

    Virkkunen, A., Palomäki, K., Singh, M., Leinonen, J., Rouhe, A., Enarvi, S. & Lukkarila, J.

    01/10/201630/09/2018

    Project: Academy of Finland: Other research funding

    Cite this

    Virkkunen, A., Lukkarila, J., Palomäki, K., & Kurimo, M. (2019). A user study to compare two conversational assistants designed for people with hearing impairments. In Proceedings of the Eighth Workshop on Speech and Language Processing for Assistive Technologies (pp. 1-8)