Spatial Sound Scene Synthesis and Manipulation for Virtual Reality and Audio Effects.

Ville Pulkki, Archontis Politis, Tapani Pihlajamäki, Mikko-Ville Laitinen

Research output: Chapter in Book/Report/Conference proceedingChapterScientificpeer-review

1 Citation (Scopus)

Abstract

This chapter covers DirAC-based parametric time-frequency domain (TF domain) audio techniques where the virtual sound scene is synthesized based on a geometric description of it around the avatar. Time-frequency domain parametric spatial audio techniques also have applications in audio engineering, in addition to applications in virtual reality. The basic processing block of DirAC-based spatialization in virtual worlds is the DirAC monosynth. When producing audio for virtual reality, often some recorded speech, music, and/or environmental sounds are used as signals for virtual sources. The chapter presents the application of parametric analysis and synthesis to spatial audio effects, using the DirAC framework. The ambience extraction method attempts to make foreground sounds with a clear direction softer, while preserving background sounds or ambience. Spatialization of a monophonic audio channel, either to a multichannel audio reproduction setup or as background sound in virtual reality, is a useful task in many audio engineering applications.
Original languageEnglish
Title of host publicationParametric Time-Frequency Domain Spatial Audio
EditorsVille Pulkki, Symeon Delikaris-Manias, Archontis Politis
PublisherWILEY-BLACKWELL
Chapter14
Pages347-361
ISBN (Electronic)9781119252634
ISBN (Print)9781119252597
DOIs
Publication statusPublished - 15 Dec 2017
MoE publication typeA3 Part of a book or another research book

Keywords

  • DirAC-based spatialization
  • parametric analysis
  • spatial audio techniques
  • time-frequency domain
  • virtual reality

Fingerprint Dive into the research topics of 'Spatial Sound Scene Synthesis and Manipulation for Virtual Reality and Audio Effects.'. Together they form a unique fingerprint.

  • Cite this

    Pulkki, V., Politis, A., Pihlajamäki, T., & Laitinen, M-V. (2017). Spatial Sound Scene Synthesis and Manipulation for Virtual Reality and Audio Effects. In V. Pulkki, S. Delikaris-Manias, & A. Politis (Eds.), Parametric Time-Frequency Domain Spatial Audio (pp. 347-361). WILEY-BLACKWELL. https://doi.org/10.1002/9781119252634.ch14