Extreme Audio Time Stretching Using Neural Synthesis

Leonardo Fierro, Alec Wright, Vesa Välimäki, Matti Hämäläinen

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference article in proceedingsScientificvertaisarvioitu

27 Lataukset (Pure)

Abstrakti

A deep neural network solution for time-scale modification (TSM) focused on large stretching factors is proposed, targeting environmental sounds. Traditional TSM artifacts such as transient smearing, loss of presence, and phasiness are heavily accentuated and cause poor audio quality when the TSM factor is four or larger. The weakness of established TSM methods, often based on a phase vocoder structure, lies in the poor description and scaling of the transient and noise components, or nuances, of a sound. Our novel solution combines a sines-transients-noise decomposition with an independent WaveNet synthesizer to provide a better description of the noise component and an improve sound quality for large stretching factors. Results of a subjective listening test against four other TSM algorithms are reported, showing the proposed method to be often superior. The proposed method is stereo compatible and has a wide range of applications related to the slow motion of media content.
AlkuperäiskieliEnglanti
OtsikkoICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
KustantajaIEEE
Sivut1-5
Sivumäärä5
ISBN (elektroninen)978-1-7281-6327-7
ISBN (painettu)978-1-7281-6328-4
DOI - pysyväislinkit
TilaJulkaistu - 10 kesäk. 2023
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisussa
TapahtumaIEEE International Conference on Acoustics, Speech, and Signal Processing - Rhodes Island, Kreikka
Kesto: 4 kesäk. 202310 kesäk. 2023

Julkaisusarja

NimiProceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing
ISSN (elektroninen)2379-190X

Conference

ConferenceIEEE International Conference on Acoustics, Speech, and Signal Processing
LyhennettäICASSP
Maa/AlueKreikka
KaupunkiRhodes Island
Ajanjakso04/06/202310/06/2023

Sormenjälki

Sukella tutkimusaiheisiin 'Extreme Audio Time Stretching Using Neural Synthesis'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä