Optimizing Higher-Order Directional Audio Coding with Adaptive Mixing and Energy Matching for Ambisonic Compression and Upmixing

Christoph Hold*, Leo McCormack, Archontis Politis, Ville Pulkki

*Tämän työn vastaava kirjoittaja

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference article in proceedingsScientificvertaisarvioitu

44 Lataukset (Pure)

Abstrakti

In order to transmit sound-scenes encoded into the higher-order Ambisonics (HOA) format to low-bandwidth devices, transmission codecs are needed to reduce data requirements. Recently, the model-based higher-order directional audio coding (HO-DirAC) method was formulated for HOA input to HOA output. Compression is achieved by reducing the number of audio transport channels through spatial discretization. These transport channels are then used to reconstruct the scene on the receiving end based on accompanying spatial metadata. This reconstructed scene may also be optionally upmixed to a higher-order; leading to an enhancement in spatial-resolution. In this paper, the authors analyze certain sound-scenes that were especially challenging for the previously proposed HO-DirAC framework, which the authors postulate could be attributed to the lower-order reconstruction of diffuse sound-field components. Three optimizations for HO-DirAC are proposed, which all employ optimal adaptive mixing and/or energy matching of Ambisonic components based on spatial covariance matrices. The methods are formulated such that they are applied directly in the reconstruction of HOA from the spatially discrete transport audio signals. Notably, a dedicated low-complexity solution without additional side-information is derived. Instrumental evaluations confirm a reduced reconstruction error when using either of the proposed optimizations. These improvements were also demonstrated via a perceptual evaluation, whereby four, six, and twelve transport channels were used to reconstruct (and upmix to) fifth-order reference sound-scenes. The evaluation highlighted the high perceptual performance of the proposed optimizations, including the low-complexity version, thereby improving parametric spatial audio coding and reproduction.

AlkuperäiskieliEnglanti
OtsikkoProceedings of the 2023 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, WASPAA 2023
KustantajaIEEE
Sivumäärä5
ISBN (elektroninen)979-8-3503-2372-6
DOI - pysyväislinkit
TilaJulkaistu - 2023
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisussa
TapahtumaIEEE Workshop on Applications of Signal Processing to Audio and Acoustics - New Paltz, Yhdysvallat
Kesto: 22 lokak. 202325 lokak. 2023

Julkaisusarja

NimiIEEE Workshop on Applications of Signal Processing to Audio and Acoustics
Vuosikerta2023-October
ISSN (painettu)1931-1168
ISSN (elektroninen)1947-1629

Workshop

WorkshopIEEE Workshop on Applications of Signal Processing to Audio and Acoustics
LyhennettäWASPAA
Maa/AlueYhdysvallat
KaupunkiNew Paltz
Ajanjakso22/10/202325/10/2023

Sormenjälki

Sukella tutkimusaiheisiin 'Optimizing Higher-Order Directional Audio Coding with Adaptive Mixing and Energy Matching for Ambisonic Compression and Upmixing'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä