Brain-based decoding of mentally imagined film clips and sounds reveals experience-based information patterns in film professionals

Research output: Contribution to journalArticleScientificpeer-review

Standard

Brain-based decoding of mentally imagined film clips and sounds reveals experience-based information patterns in film professionals. / de Borst, Aline W.; Valente, Giancarlo; Jääskeläinen, Iiro P.; Tikka, Pia.

In: NeuroImage, Vol. 129, 01.04.2016, p. 428-438.

Research output: Contribution to journalArticleScientificpeer-review

Harvard

APA

Vancouver

Author

Bibtex - Download

@article{70e10f06a6d3410b9b84829fd5bb70c0,
title = "Brain-based decoding of mentally imagined film clips and sounds reveals experience-based information patterns in film professionals",
abstract = "In the perceptual domain, it has been shown that the human brain is strongly shaped through experience, leading to expertise in highly-skilled professionals. What has remained unclear is whether specialization also shapes brain networks underlying mental imagery. In our fMRI study, we aimed to uncover modality-specific mental imagery specialization of film experts. Using multi-voxel pattern analysis we decoded from brain activity of professional cinematographers and sound designers whether they were imagining sounds or images of particular film clips. In each expert group distinct multi-voxel patterns, specific for the modality of their expertise, were found during classification of imagery modality. These patterns were mainly localized in the occipito-temporal and parietal cortex for cinematographers and in the auditory cortex for sound designers. We also found generalized patterns across perception and imagery that were distinct for the two expert groups: they involved frontal cortex for the cinematographers and temporal cortex for the sound designers. Notably, the mental representations of film clips and sounds of cinematographers contained information that went beyond modality-specificity. We were able to successfully decode the implicit presence of film genre from brain activity during mental imagery in cinematographers. The results extend existing neuroimaging literature on expertise into the domain of mental imagery and show that experience in visual versus auditory imagery can alter the representation of information in modality-specific association cortices.",
keywords = "Expertise, Film, FMRI, Mental imagery, MVPA, Naturalistic stimuli",
author = "{de Borst}, {Aline W.} and Giancarlo Valente and J{\"a}{\"a}skel{\"a}inen, {Iiro P.} and Pia Tikka",
year = "2016",
month = "4",
day = "1",
doi = "10.1016/j.neuroimage.2016.01.043",
language = "English",
volume = "129",
pages = "428--438",
journal = "NeuroImage",
issn = "1053-8119",

}

RIS - Download

TY - JOUR

T1 - Brain-based decoding of mentally imagined film clips and sounds reveals experience-based information patterns in film professionals

AU - de Borst, Aline W.

AU - Valente, Giancarlo

AU - Jääskeläinen, Iiro P.

AU - Tikka, Pia

PY - 2016/4/1

Y1 - 2016/4/1

N2 - In the perceptual domain, it has been shown that the human brain is strongly shaped through experience, leading to expertise in highly-skilled professionals. What has remained unclear is whether specialization also shapes brain networks underlying mental imagery. In our fMRI study, we aimed to uncover modality-specific mental imagery specialization of film experts. Using multi-voxel pattern analysis we decoded from brain activity of professional cinematographers and sound designers whether they were imagining sounds or images of particular film clips. In each expert group distinct multi-voxel patterns, specific for the modality of their expertise, were found during classification of imagery modality. These patterns were mainly localized in the occipito-temporal and parietal cortex for cinematographers and in the auditory cortex for sound designers. We also found generalized patterns across perception and imagery that were distinct for the two expert groups: they involved frontal cortex for the cinematographers and temporal cortex for the sound designers. Notably, the mental representations of film clips and sounds of cinematographers contained information that went beyond modality-specificity. We were able to successfully decode the implicit presence of film genre from brain activity during mental imagery in cinematographers. The results extend existing neuroimaging literature on expertise into the domain of mental imagery and show that experience in visual versus auditory imagery can alter the representation of information in modality-specific association cortices.

AB - In the perceptual domain, it has been shown that the human brain is strongly shaped through experience, leading to expertise in highly-skilled professionals. What has remained unclear is whether specialization also shapes brain networks underlying mental imagery. In our fMRI study, we aimed to uncover modality-specific mental imagery specialization of film experts. Using multi-voxel pattern analysis we decoded from brain activity of professional cinematographers and sound designers whether they were imagining sounds or images of particular film clips. In each expert group distinct multi-voxel patterns, specific for the modality of their expertise, were found during classification of imagery modality. These patterns were mainly localized in the occipito-temporal and parietal cortex for cinematographers and in the auditory cortex for sound designers. We also found generalized patterns across perception and imagery that were distinct for the two expert groups: they involved frontal cortex for the cinematographers and temporal cortex for the sound designers. Notably, the mental representations of film clips and sounds of cinematographers contained information that went beyond modality-specificity. We were able to successfully decode the implicit presence of film genre from brain activity during mental imagery in cinematographers. The results extend existing neuroimaging literature on expertise into the domain of mental imagery and show that experience in visual versus auditory imagery can alter the representation of information in modality-specific association cortices.

KW - Expertise

KW - Film

KW - FMRI

KW - Mental imagery

KW - MVPA

KW - Naturalistic stimuli

UR - http://www.scopus.com/inward/record.url?scp=84958214333&partnerID=8YFLogxK

U2 - 10.1016/j.neuroimage.2016.01.043

DO - 10.1016/j.neuroimage.2016.01.043

M3 - Article

VL - 129

SP - 428

EP - 438

JO - NeuroImage

JF - NeuroImage

SN - 1053-8119

ER -

ID: 1590943