Projects per year
Abstract
Dynamic machine vision requires recognizing the past and predicting the future of a moving object based on present vision. Current machine vision systems accomplish this by processing numerous image frames or using complex algorithms. Here, we report motion recognition and prediction in recurrent photomemristor networks. In our system, a retinomorphic photomemristor array, working as dynamic vision reservoir, embeds past motion frames as hidden states into the present frame through inherent dynamic memory. The informative present frame facilitates accurate recognition of past and prediction of future motions with machine learning algorithms. This in-sensor motion processing capability eliminates redundant data flows and promotes real-time perception of moving objects for dynamic machine vision.
Original language | English |
---|---|
Article number | 2169 |
Pages (from-to) | 1-9 |
Number of pages | 9 |
Journal | Nature Communications |
Volume | 14 |
Issue number | 1 |
DOIs | |
Publication status | Published - Dec 2023 |
MoE publication type | A1 Journal article-refereed |
Fingerprint
Dive into the research topics of 'Dynamic machine vision with retinomorphic photomemristor-reservoir computing'. Together they form a unique fingerprint.Projects
- 2 Finished
-
Optoelectronic Synapses for Artificial Neuro Networks
01/09/2018 → 31/08/2021
Project: Academy of Finland: Other research funding
-
COIN: Complex Oxide Interfaces for Nanoelectronics (COIN)
Majumdar, S., Qin, Q., Tan, H. & Pande, I.
01/09/2015 → 31/08/2018
Project: Academy of Finland: Other research funding
Equipment
Press/Media
-
Reports on Science Findings from Aalto University School of Science and Technology Provide New Insights (Dynamic machine vision with retinomorphic photomemristor-reservoir computing)
Sebastiaan van Dijken & Hongwei Tan
03/05/2023
1 item of Media coverage
Press/Media: Media appearance
-
Neuromorphic Sensor Recognizes Motion, Predicts Path
Sebastiaan van Dijken & Hongwei Tan
18/04/2023
1 item of Media coverage
Press/Media: Media appearance
-
A neuromorphic visual sensor can recognize moving objects and predict their path
Sebastiaan van Dijken & Hongwei Tan
17/04/2023
2 items of Media coverage
Press/Media: Media appearance