Diffusion-Based Generative Equalizer for Music Restoration

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

2 Citations (Scopus)
62 Downloads (Pure)

Abstract

This paper presents a novel approach to audio restoration, focusing on the enhancement of low-quality music recordings, and in particular historical ones. Building upon a previous algorithm called BABE, or Blind Audio Bandwidth Extension, we introduce BABE-2, which presents a series of improvements. This research broadens the concept of bandwidth extension to generative equalization, a task that, to the best of our knowledge, has not been previously addressed for music restoration. BABE-2 is built around an optimization algorithm utilizing priors from diffusion models, which are trained or fine-tuned using a curated set of high-quality music tracks. The algorithm simultaneously performs two critical tasks: estimation of the filter degradation magnitude response and hallucination of the restored audio. The proposed method is objectively evaluated on historical piano recordings, showing an enhancement over the prior version. The method yields similarly impressive results in rejuvenating the works of renowned vocalists Enrico Caruso and Nellie Melba. This research represents an advancement in the practical restoration of historical music. Historical music restoration examples are available at: research.spa.aalto.fi/publications/papers/dafx-babe2/.

Original languageEnglish
Title of host publicationProceedings of the 27th International Conference on Digital Audio Effects (DAFx24)
EditorsE. De Sena, J. Mannall
Place of PublicationGuildford, UK
PublisherUniversity of Surrey
Pages25-32
Number of pages8
Volume27
Publication statusPublished - 2024
MoE publication typeA4 Conference publication
EventInternational Conference on Digital Audio Effects - University of Surrey, Guildford, United Kingdom
Duration: 3 Sept 20247 Sept 2024
Conference number: 27
https://dafx24.surrey.ac.uk/

Publication series

NameProceedings of the International Conference on Digital Audio Effects, DAFx
ISSN (Print)2413-6700
ISSN (Electronic)2413-6689

Conference

ConferenceInternational Conference on Digital Audio Effects
Abbreviated titleDAFX
Country/TerritoryUnited Kingdom
CityGuildford
Period03/09/202407/09/2024
Internet address

Fingerprint

Dive into the research topics of 'Diffusion-Based Generative Equalizer for Music Restoration'. Together they form a unique fingerprint.

Cite this