Noise Morphing for Audio Time Stretching

Eloi Moliner Juanpere, Leonardo Fierro, Alec Wright, Matti S. Hamalainen, Vesa Valimaki

Research output: Contribution to journalArticleScientificpeer-review

19 Downloads (Pure)

Abstract

This letter introduces an innovative method to enhance the quality of audio time stretching by precisely decomposing a sound into sines, transients, and noise and by improving the processing of the latter component. While there are established methods for time-stretching sines and transients with high quality, the manipulation of noise or residual components has lacked robust solutions in prior research. The proposed method combines sound decomposition with previous techniques for audio spectral resynthesis. The time-stretched noise component is achieved by morphing its time-interpolated spectral magnitude with a white-noise excitation signal. This method stands out for its simplicity, efficiency, and audio quality. The results of a subjective experiment affirm the superiority of this approach over current state-of-the-art methods across all evaluated stretch factors. The proposed technique notably excels in extreme stretching scenarios, signifying a substantial elevation in performance. The proposed method holds promise for a wide range of applications in slow-motion media content, such as music or sports video production.

Original languageEnglish
Article number3386118
Pages (from-to)1144-1148
Number of pages5
JournalIEEE Signal Processing Letters
Volume31
Early online date2024
DOIs
Publication statusPublished - 2024
MoE publication typeA1 Journal article-refereed

Keywords

  • Audio systems
  • Interpolation
  • interpolation
  • Noise
  • signal restoration
  • spectral analysis
  • Spectrogram
  • Task analysis
  • timbre
  • Time-frequency analysis
  • Transient analysis
  • Vocoders

Fingerprint

Dive into the research topics of 'Noise Morphing for Audio Time Stretching'. Together they form a unique fingerprint.

Cite this