VIMES: A Wearable Memory Assistance System for Automatic Information Retrieval

Carlos Bermejo, Tristan Braud, Ji Yang, Shayan Mirjafari, Bowen Shi, Yu Xiao, Pan Hui

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference article in proceedingsScientificvertaisarvioitu

169 Lataukset (Pure)


The advancement of artificial intelligence and wearable computing triggers the radical innovation of cognitive applications. In this work, we propose VIMES, an augmented reality-based memory assistance system that helps recall declarative memory, such as whom the user meets and what they chat. Through a collaborative method with 20 participants, we design VIMES, a system that runs on smartglasses, takes the first-person audio and video as input, and extracts personal profiles and event information to display on the embedded display or a smartphone. We perform an extensive evaluation with 50 participants to show the effectiveness of VIMES for memory recall. VIMES outperforms (90% memory accuracy) other traditional methods such as self-recall (34%) while offering the best memory experience (Vividness, Coherence, and Visual Perspective all score over 4/5). The user study results show that most participants find VIMES useful (3.75/5) and easy to use (3.46/5).
OtsikkoProceedings of the 28th ACM International Conference on Multimedia
ISBN (elektroninen)978-1-4503-7988-5
DOI - pysyväislinkit
TilaJulkaistu - lokak. 2020
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisussa
TapahtumaACM International Conference on Multimedia - Virtual, Online
Kesto: 12 lokak. 202016 lokak. 2020
Konferenssinumero: 28


ConferenceACM International Conference on Multimedia
KaupunkiVirtual, Online


Sukella tutkimusaiheisiin 'VIMES: A Wearable Memory Assistance System for Automatic Information Retrieval'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä