A wearable multimodal interface for exploring urban points of interest

Antti Jylhä, Yi Ta Hsieh, Valeria Orso, Salvatore Andolina, Luciano Gamberini, Giulio Jacucci

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

20 Citations (Scopus)


Locating points of interest (POIs) in cities is typically facilitated by visual aids such as paper maps, brochures, and mobile applications. However, these techniques require visual attention, which ideally should be on the surroundings. Non-visual techniques for navigating towards specific POIs typically lack support for free exploration of the city or more detailed guidance. To overcome these issues, we propose a multimodal, wearable system for alerting the user of nearby recommended POIs. The system, built around a tactile glove, provides audio-tactile cues when a new POI is in the vicinity, and more detailed information and guidance if the user expresses interest in this POI. We evaluated the system in a field study, comparing it to a visual baseline application. The encouraging results show that the glovebased system helps keep the attention on the surroundings and that its performance is on the same level as that of the baseline.

Original languageEnglish
Title of host publicationICMI 2015 - Proceedings of the 2015 ACM International Conference on Multimodal Interaction
Number of pages8
ISBN (Print)978-1-4503-3912-4
Publication statusPublished - 9 Nov 2015
MoE publication typeA4 Article in a conference publication
EventInternational Conference on Multimodal Interaction - Seattle, United States
Duration: 9 Nov 201513 Nov 2015


ConferenceInternational Conference on Multimodal Interaction
Abbreviated titleICMI
Country/TerritoryUnited States


  • Auditory icons
  • Cultural heritage
  • Multimodal interaction
  • Tactile feedback
  • Wearable computing

Cite this