A user study to compare two conversational assistants designed for people with hearing impairments

Anja Virkkunen, Juri Lukkarila, Kalle Palomäki, Mikko Kurimo

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

39 Downloads (Pure)

Abstract

Participating in conversations can be difficult for people with hearing loss, especially in acoustically challenging environments. We studied the preferences the hearing impaired have for a personal conversation assistant based on automatic speech recognition (ASR) technology. We created two prototypes which were evaluated by hearing impaired test users. This paper qualitatively compares the two based on the feedback obtained from the tests. The first prototype was a proof-of-concept system running real-time ASR on a laptop. The second prototype was developed for a mobile device with the recognizer running on a separate server. In the mobile device, augmented reality (AR) was used to help the hearing impaired observe gestures and lip movements of the speaker simultaneously with the transcriptions. Several testers found the systems useful enough to use in their daily lives, with majority preferring the mobile AR version. The biggest concern of the testers was the accuracy of the transcriptions and the lack of speaker identification.
Original languageEnglish
Title of host publicationProceedings of the Eighth Workshop on Speech and Language Processing for Assistive Technologies
Pages1-8
Number of pages8
ISBN (Electronic)978-1-950737-08-6
Publication statusPublished - Jun 2019
MoE publication typeA4 Article in a conference publication
EventWorkshop on Speech and Language Processing for Assistive Technologies - Minneapolis, United States
Duration: 7 Jun 20197 Jun 2019
Conference number: 8

Workshop

WorkshopWorkshop on Speech and Language Processing for Assistive Technologies
Abbreviated titleSLPAT
Country/TerritoryUnited States
CityMinneapolis
Period07/06/201907/06/2019

Keywords

  • speech recognition
  • hearing impairment
  • assistive technology
  • user testing

Fingerprint

Dive into the research topics of 'A user study to compare two conversational assistants designed for people with hearing impairments'. Together they form a unique fingerprint.

Cite this