The Impact of Sound Systems on the Perception of Cinematic Content in Immersive Audiovisual Productions

Victoria Korshunova; Gerard B. Remijn; Synes Elischka; Catarina Mendonca

doi:10.1109/APMAR.2019.8709163

The Impact of Sound Systems on the Perception of Cinematic Content in Immersive Audiovisual Productions

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

Standard

The Impact of Sound Systems on the Perception of Cinematic Content in Immersive Audiovisual Productions. / Korshunova, Victoria; Remijn, Gerard B.; Elischka, Synes ; Mendonca, Catarina.

Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019. ed. / Dongdong Weng; Liwei Chan; Youngho Lee; Xiaohui Liang; Nobuchika Sakata. Institute of Electrical and Electronics Engineers, 2019. p. 70-74 8709163 (Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Scientific › peer-review

Harvard

Korshunova, V, Remijn, GB, Elischka, S & Mendonca, C 2019, The Impact of Sound Systems on the Perception of Cinematic Content in Immersive Audiovisual Productions. in D Weng, L Chan, Y Lee, X Liang & N Sakata (eds), Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019., 8709163, Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019, Institute of Electrical and Electronics Engineers, pp. 70-74, Asia Pacific Workshop on Mixed and Augmented Reality, Ikoma, Nara, Japan, 28/03/2019. https://doi.org/10.1109/APMAR.2019.8709163

APA

Korshunova, V., Remijn, G. B., Elischka, S., & Mendonca, C. (2019). The Impact of Sound Systems on the Perception of Cinematic Content in Immersive Audiovisual Productions. In D. Weng, L. Chan, Y. Lee, X. Liang, & N. Sakata (Eds.), Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019 (pp. 70-74). [8709163] (Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019). Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/APMAR.2019.8709163

Vancouver

Korshunova V, Remijn GB, Elischka S , Mendonca C. The Impact of Sound Systems on the Perception of Cinematic Content in Immersive Audiovisual Productions. In Weng D, Chan L, Lee Y, Liang X, Sakata N, editors, Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019. Institute of Electrical and Electronics Engineers. 2019. p. 70-74. 8709163. (Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019). https://doi.org/10.1109/APMAR.2019.8709163

Author

Korshunova, Victoria ; Remijn, Gerard B. ; Elischka, Synes ; Mendonca, Catarina. / The Impact of Sound Systems on the Perception of Cinematic Content in Immersive Audiovisual Productions. Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019. editor / Dongdong Weng ; Liwei Chan ; Youngho Lee ; Xiaohui Liang ; Nobuchika Sakata. Institute of Electrical and Electronics Engineers, 2019. pp. 70-74 (Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019).

Bibtex - Download

@inproceedings{406d8d5a579143fabed9a833566081ec,

title = "The Impact of Sound Systems on the Perception of Cinematic Content in Immersive Audiovisual Productions",

abstract = "With fast technological developments, traditional perceptual environments disappear and new ones emerge. These changes make the human senses adapt to new ways of perceptual understanding, for example, regarding the perceptual integration of sound and vision. Proceeding from the fact that hearing cooperates with visual attention processes, the aim of this study is to investigate the effect of different sound design conditions on the perception of cinematic content in immersive audiovisual reproductions. Here we introduce the results of a visual selective attention task (counting objects) performed by participants watching a 270-degree immersive audiovisual display, on which a movie (»Ego Cure») was shown. Four sound conditions were used, which employed an increasing number of loudspeakers, i.e., mono, stereo, 5.1 and 7.1.4. Eye tracking was used to record the participant's eye gaze during the task. The eye tracking data showed that an increased number of speakers and a wider spatial audio distribution diffused the participants' attention from the task-related part of the display to non-task-related directions. The number of participants looking at the task-irrelevant display in the 7.1.4 condition was significantly higher than in the mono audio condition. This implies that additional spatial cues in the auditory modality automatically influence human visual attention (involuntary eye movements) and human analysis of visual information. Sound engineers should consider this when mixing educational or any other information-oriented productions.",

keywords = "audiovisual perception, eye gaze, eye tracking, immersive environments, sound systems, spatial sound",

author = "Victoria Korshunova and Remijn, {Gerard B.} and Synes Elischka and Catarina Mendonca",

note = "| openaire: EC/H2020/659114/EU//MULTISSOUND",

year = "2019",

month = "5",

day = "7",

doi = "10.1109/APMAR.2019.8709163",

language = "English",

series = "Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019",

publisher = "Institute of Electrical and Electronics Engineers",

pages = "70--74",

editor = "Dongdong Weng and Liwei Chan and Youngho Lee and Xiaohui Liang and Nobuchika Sakata",

booktitle = "Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019",

address = "United States",

}

RIS - Download

TY - GEN

T1 - The Impact of Sound Systems on the Perception of Cinematic Content in Immersive Audiovisual Productions

AU - Korshunova, Victoria

AU - Remijn, Gerard B.

AU - Elischka, Synes

AU - Mendonca, Catarina

N1 - | openaire: EC/H2020/659114/EU//MULTISSOUND

PY - 2019/5/7

Y1 - 2019/5/7

N2 - With fast technological developments, traditional perceptual environments disappear and new ones emerge. These changes make the human senses adapt to new ways of perceptual understanding, for example, regarding the perceptual integration of sound and vision. Proceeding from the fact that hearing cooperates with visual attention processes, the aim of this study is to investigate the effect of different sound design conditions on the perception of cinematic content in immersive audiovisual reproductions. Here we introduce the results of a visual selective attention task (counting objects) performed by participants watching a 270-degree immersive audiovisual display, on which a movie (»Ego Cure») was shown. Four sound conditions were used, which employed an increasing number of loudspeakers, i.e., mono, stereo, 5.1 and 7.1.4. Eye tracking was used to record the participant's eye gaze during the task. The eye tracking data showed that an increased number of speakers and a wider spatial audio distribution diffused the participants' attention from the task-related part of the display to non-task-related directions. The number of participants looking at the task-irrelevant display in the 7.1.4 condition was significantly higher than in the mono audio condition. This implies that additional spatial cues in the auditory modality automatically influence human visual attention (involuntary eye movements) and human analysis of visual information. Sound engineers should consider this when mixing educational or any other information-oriented productions.

AB - With fast technological developments, traditional perceptual environments disappear and new ones emerge. These changes make the human senses adapt to new ways of perceptual understanding, for example, regarding the perceptual integration of sound and vision. Proceeding from the fact that hearing cooperates with visual attention processes, the aim of this study is to investigate the effect of different sound design conditions on the perception of cinematic content in immersive audiovisual reproductions. Here we introduce the results of a visual selective attention task (counting objects) performed by participants watching a 270-degree immersive audiovisual display, on which a movie (»Ego Cure») was shown. Four sound conditions were used, which employed an increasing number of loudspeakers, i.e., mono, stereo, 5.1 and 7.1.4. Eye tracking was used to record the participant's eye gaze during the task. The eye tracking data showed that an increased number of speakers and a wider spatial audio distribution diffused the participants' attention from the task-related part of the display to non-task-related directions. The number of participants looking at the task-irrelevant display in the 7.1.4 condition was significantly higher than in the mono audio condition. This implies that additional spatial cues in the auditory modality automatically influence human visual attention (involuntary eye movements) and human analysis of visual information. Sound engineers should consider this when mixing educational or any other information-oriented productions.

KW - audiovisual perception

KW - eye gaze

KW - eye tracking

KW - immersive environments

KW - sound systems

KW - spatial sound

UR - http://www.scopus.com/inward/record.url?scp=85066332801&partnerID=8YFLogxK

U2 - 10.1109/APMAR.2019.8709163

DO - 10.1109/APMAR.2019.8709163

M3 - Conference contribution

T3 - Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019

SP - 70

EP - 74

BT - Proceedings of the 2019 12th Asia Pacific Workshop on Mixed and Augmented Reality, APMAR 2019

A2 - Weng, Dongdong

A2 - Chan, Liwei

A2 - Lee, Youngho

A2 - Liang, Xiaohui

A2 - Sakata, Nobuchika

PB - Institute of Electrical and Electronics Engineers

ER -

ID: 34667158