Skip to main navigation Skip to search Skip to main content

Mixture-of-Experts Framework for Field-of-View Enhanced Signal-Dependent Binauralization of Moving Talkers

  • Manan Mittal
  • , Thomas Deppisch
  • , Joseph Forrer
  • , Chris Le Sueur
  • , Zamir Ben-Hur
  • , David Lou Alon
  • , Daniel D.E. Wong
  • Stony Brook University
  • Chalmers University of Technology
  • Reality Labs Research

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

Abstract

We propose a novel mixture of experts framework for field-of-view enhancement in binaural signal matching. Our approach enables dynamic spatial audio rendering that adapts to source motion, allowing users to emphasize or suppress sounds from selected directions while preserving natural bin-aural cues. Unlike traditional methods that rely on explicit direction-of-arrival estimation, our signal-dependent framework combines multiple binaural filters in an online manner using implicit localization. This allows for real-time tracking and enhancement of moving sound sources, supporting applications such as speech focus, noise reduction, and world-locked audio in augmented and virtual reality. The method is agnostic to array geometry and offers a flexible solution for spatial audio capture and playback in next-generation consumer audio devices.
Original languageEnglish
Title of host publicationICASSP 2026 - 2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
PublisherIEEE
Pages15287-15291
Number of pages5
ISBN (Print)979-8-3315-6702-6
DOIs
Publication statusPublished - 8 May 2026
MoE publication typeA4 Conference publication
EventIEEE International Conference on Acoustics, Speech, and Signal Processing - Barcelona, Spain, Barcelona, Spain
Duration: 3 May 2026 → 8 May 2026

Conference

ConferenceIEEE International Conference on Acoustics, Speech, and Signal Processing
Abbreviated titleICASSP
Country/TerritorySpain
CityBarcelona
Period03/05/2026 → 08/05/2026

Keywords

  • Low earth orbit satellites
  • Filtering
  • Filters
  • Circuits and systems
  • Matched filters
  • Location awareness
  • Smart devices
  • Protocols
  • Mobile communication
  • HTTP

Fingerprint

Dive into the research topics of 'Mixture-of-Experts Framework for Field-of-View Enhanced Signal-Dependent Binauralization of Moving Talkers'. Together they form a unique fingerprint.

Cite this