VIMES: A Wearable Memory Assistance System for Automatic Information Retrieval

Carlos Bermejo, Tristan Braud, Ji Yang, Shayan Mirjafari, Bowen Shi, Yu Xiao, Pan Hui

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference contributionScientificvertaisarvioitu

Abstrakti

The advancement of artificial intelligence and wearable computing triggers the radical innovation of cognitive applications. In this work, we propose VIMES, an augmented reality-based memory assistance system that helps recall declarative memory, such as whom the user meets and what they chat. Through a collaborative method with 20 participants, we design VIMES, a system that runs on smartglasses, takes the first-person audio and video as input, and extracts personal profiles and event information to display on the embedded display or a smartphone. We perform an extensive evaluation with 50 participants to show the effectiveness of VIMES for memory recall. VIMES outperforms (90% memory accuracy) other traditional methods such as self-recall (34%) while offering the best memory experience (Vividness, Coherence, and Visual Perspective all score over 4/5). The user study results show that most participants find VIMES useful (3.75/5) and easy to use (3.46/5).
AlkuperäiskieliEnglanti
OtsikkoProceedings of the 28th ACM International Conference on Multimedia
KustantajaACM
Sivut3191-3200
Sivumäärä10
ISBN (elektroninen)978-1-4503-7988-5
DOI - pysyväislinkit
TilaJulkaistu - lokakuuta 2020
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaACM International Conference on Multimedia - Virtual, Online
Kesto: 12 lokakuuta 202016 lokakuuta 2020
Konferenssinumero: 28

Conference

ConferenceACM International Conference on Multimedia
LyhennettäMM
KaupunkiVirtual, Online
Ajanjakso12/10/202016/10/2020

Sormenjälki

Sukella tutkimusaiheisiin 'VIMES: A Wearable Memory Assistance System for Automatic Information Retrieval'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä