VIMES: A Wearable Memory Assistance System for Automatic Information Retrieval

Carlos Bermejo, Tristan Braud, Ji Yang, Shayan Mirjafari, Bowen Shi, Yu Xiao, Pan Hui

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference article in proceedingsScientificvertaisarvioitu

169 Lataukset (Pure)

Abstrakti

The advancement of artificial intelligence and wearable computing triggers the radical innovation of cognitive applications. In this work, we propose VIMES, an augmented reality-based memory assistance system that helps recall declarative memory, such as whom the user meets and what they chat. Through a collaborative method with 20 participants, we design VIMES, a system that runs on smartglasses, takes the first-person audio and video as input, and extracts personal profiles and event information to display on the embedded display or a smartphone. We perform an extensive evaluation with 50 participants to show the effectiveness of VIMES for memory recall. VIMES outperforms (90% memory accuracy) other traditional methods such as self-recall (34%) while offering the best memory experience (Vividness, Coherence, and Visual Perspective all score over 4/5). The user study results show that most participants find VIMES useful (3.75/5) and easy to use (3.46/5).
AlkuperäiskieliEnglanti
OtsikkoProceedings of the 28th ACM International Conference on Multimedia
KustantajaACM
Sivut3191-3200
Sivumäärä10
ISBN (elektroninen)978-1-4503-7988-5
DOI - pysyväislinkit
TilaJulkaistu - lokak. 2020
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisussa
TapahtumaACM International Conference on Multimedia - Virtual, Online
Kesto: 12 lokak. 202016 lokak. 2020
Konferenssinumero: 28

Conference

ConferenceACM International Conference on Multimedia
LyhennettäMM
KaupunkiVirtual, Online
Ajanjakso12/10/202016/10/2020

Sormenjälki

Sukella tutkimusaiheisiin 'VIMES: A Wearable Memory Assistance System for Automatic Information Retrieval'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä