Projects per year
Abstract
Dynamic machine vision requires recognizing the past and predicting the future of a moving object based on present vision. Current machine vision systems accomplish this by processing numerous image frames or using complex algorithms. Here, we report motion recognition and prediction in recurrent photomemristor networks. In our system, a retinomorphic photomemristor array, working as dynamic vision reservoir, embeds past motion frames as hidden states into the present frame through inherent dynamic memory. The informative present frame facilitates accurate recognition of past and prediction of future motions with machine learning algorithms. This in-sensor motion processing capability eliminates redundant data flows and promotes real-time perception of moving objects for dynamic machine vision.
Original language | English |
---|---|
Article number | 2169 |
Pages (from-to) | 1-9 |
Number of pages | 9 |
Journal | Nature Communications |
Volume | 14 |
Issue number | 1 |
DOIs | |
Publication status | Published - Dec 2023 |
MoE publication type | A1 Journal article-refereed |
Fingerprint
Dive into the research topics of 'Dynamic machine vision with retinomorphic photomemristor-reservoir computing'. Together they form a unique fingerprint.Projects
- 2 Finished
-
Optoelectronic Synapses for Artificial Neuro Networks
Tan, H. (Principal investigator)
01/09/2018 → 31/08/2021
Project: Academy of Finland: Other research funding
-
COIN: Complex Oxide Interfaces for Nanoelectronics (COIN)
Majumdar, S. (Principal investigator)
01/09/2015 → 31/08/2018
Project: Academy of Finland: Other research funding
Equipment
-
-
-
OtaNano - Nanomicroscopy Center
Seitsonen, J. (Manager) & Rissanen, A. (Other)
OtaNanoFacility/equipment: Facility
Press/Media
-
A neuromorphic visual sensor can recognize moving objects and predict their path
17/04/2023 → 25/08/2023
3 items of Media coverage
Press/Media: Media appearance
-
Reports on Science Findings from Aalto University School of Science and Technology Provide New Insights (Dynamic machine vision with retinomorphic photomemristor-reservoir computing)
03/05/2023
1 item of Media coverage
Press/Media: Media appearance
-
Neuromorphic Sensor Recognizes Motion, Predicts Path
18/04/2023
1 item of Media coverage
Press/Media: Media appearance