Augmented/Mixed Reality Audio for Hearables: Sensing, control, and rendering

Rishabh Gupta, Jianjun He, Rishabh Ranjan, Woon Seng Gan, Florian Klein, Christian Schneiderwind, Annika Neidhardt, Karlheinz Brandenburg, Vesa Valimaki

Research output: Contribution to journalArticleScientificpeer-review

2 Citations (Scopus)
95 Downloads (Pure)

Abstract

Augmented or mixed reality (AR/MR) is emerging as one of the key technologies in the future of computing. Audio cues are critical for maintaining a high degree of realism, social connection, and spatial awareness for various AR/MR applications, such as education and training, gaming, remote work, and virtual social gatherings to transport the user to an alternate world called the metaverse. Motivated by a wide variety of AR/MR listening experiences delivered over hearables, this article systematically reviews the integration of fundamental and advanced signal processing techniques for AR/MR audio to equip researchers and engineers in the signal processing community for the next wave of AR/MR.

Original languageEnglish
Pages (from-to)63-89
Number of pages27
JournalIEEE Signal Processing Magazine
Volume39
Issue number3
DOIs
Publication statusPublished - 1 May 2022
MoE publication typeA1 Journal article-refereed

Fingerprint

Dive into the research topics of 'Augmented/Mixed Reality Audio for Hearables: Sensing, control, and rendering'. Together they form a unique fingerprint.

Cite this