VIMES: A Wearable Memory Assistance System for Automatic Information Retrieval

Carlos Bermejo, Tristan Braud, Ji Yang, Shayan Mirjafari, Bowen Shi, Yu Xiao, Pan Hui

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference contributionScientificvertaisarvioitu

103 Lataukset (Pure)


The advancement of artificial intelligence and wearable computing triggers the radical innovation of cognitive applications. In this work, we propose VIMES, an augmented reality-based memory assistance system that helps recall declarative memory, such as whom the user meets and what they chat. Through a collaborative method with 20 participants, we design VIMES, a system that runs on smartglasses, takes the first-person audio and video as input, and extracts personal profiles and event information to display on the embedded display or a smartphone. We perform an extensive evaluation with 50 participants to show the effectiveness of VIMES for memory recall. VIMES outperforms (90% memory accuracy) other traditional methods such as self-recall (34%) while offering the best memory experience (Vividness, Coherence, and Visual Perspective all score over 4/5). The user study results show that most participants find VIMES useful (3.75/5) and easy to use (3.46/5).
OtsikkoProceedings of the 28th ACM International Conference on Multimedia
ISBN (elektroninen)978-1-4503-7988-5
DOI - pysyväislinkit
TilaJulkaistu - lokak. 2020
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisuussa
TapahtumaACM International Conference on Multimedia - Virtual, Online
Kesto: 12 lokak. 202016 lokak. 2020
Konferenssinumero: 28


ConferenceACM International Conference on Multimedia
KaupunkiVirtual, Online


Sukella tutkimusaiheisiin 'VIMES: A Wearable Memory Assistance System for Automatic Information Retrieval'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä