Projects per year
The advancement of artificial intelligence and wearable computing triggers the radical innovation of cognitive applications. In this work, we propose VIMES, an augmented reality-based memory assistance system that helps recall declarative memory, such as whom the user meets and what they chat. Through a collaborative method with 20 participants, we design VIMES, a system that runs on smartglasses, takes the first-person audio and video as input, and extracts personal profiles and event information to display on the embedded display or a smartphone. We perform an extensive evaluation with 50 participants to show the effectiveness of VIMES for memory recall. VIMES outperforms (90% memory accuracy) other traditional methods such as self-recall (34%) while offering the best memory experience (Vividness, Coherence, and Visual Perspective all score over 4/5). The user study results show that most participants find VIMES useful (3.75/5) and easy to use (3.46/5).
|Title of host publication||Proceedings of the 28th ACM International Conference on Multimedia|
|Number of pages||10|
|Publication status||Published - Oct 2020|
|MoE publication type||A4 Article in a conference publication|
|Event||ACM International Conference on Multimedia - Virtual, Online|
Duration: 12 Oct 2020 → 16 Oct 2020
Conference number: 28
|Conference||ACM International Conference on Multimedia|
|Period||12/10/2020 → 16/10/2020|
- information retrieval
- wearable computing
- memory assistance system
FingerprintDive into the research topics of 'VIMES: A Wearable Memory Assistance System for Automatic Information Retrieval'. Together they form a unique fingerprint.
- 1 Finished
FIT: Federated probabilistic modelling for heterogeneous programmable IoT systems
Kaski, S., Filstroff, L., Jälkö, J., Prediger, L., Kulkarni, T. & Mallasto, A.
04/09/2019 → 31/12/2022
Project: Academy of Finland: Other research funding