Attention to audiovisual speech shapes neural processing through feedback-feedforward loops between different nodes of the speech network

Patrik Wikman*, Viljami Salmela, Eetu Sjöblom, Miika Leminen, Matti Laine, Kimmo Alho

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

23 Downloads (Pure)

Abstract

Selective attention-related top-down modulation plays a significant role in separating relevant speech from irrelevant background speech when vocal attributes separating concurrent speakers are small and continuously evolving. Electrophysiological studies have shown that such top-down modulation enhances neural tracking of attended speech. Yet, the specific cortical regions involved remain unclear due to the limited spatial resolution of most electrophysiological techniques. To overcome such limitations, we collected both electroencephalography (EEG) (high temporal resolution) and functional magnetic resonance imaging (fMRI) (high spatial resolution), while human participants selectively attended to speakers in audiovisual scenes containing overlapping cocktail party speech. To utilise the advantages of the respective techniques, we analysed neural tracking of speech using the EEG data and performed representational dissimilarity-based EEG-fMRI fusion. We observed that attention enhanced neural tracking and modulated EEG correlates throughout the latencies studied. Further, attention-related enhancement of neural tracking fluctuated in predictable temporal profiles. We discuss how such temporal dynamics could arise from a combination of interactions between attention and prediction as well as plastic properties of the auditory cortex. EEG-fMRI fusion revealed attention-related iterative feedforward-feedback loops between hierarchically organised nodes of the ventral auditory object related processing stream. Our findings support models where attention facilitates dynamic neural changes in the auditory cortex, ultimately aiding discrimination of relevant sounds from irrelevant ones while conserving neural resources.

Original languageEnglish
Article numbere3002534
Pages (from-to)1-27
Number of pages27
JournalPLoS Biology
Volume22
Issue number3
DOIs
Publication statusPublished - Mar 2024
MoE publication typeA1 Journal article-refereed

Fingerprint

Dive into the research topics of 'Attention to audiovisual speech shapes neural processing through feedback-feedforward loops between different nodes of the speech network'. Together they form a unique fingerprint.

Cite this