Projects per year
Abstract
Currently, there is increasing interest to use sequence-to-sequence models in text-to-speech (TTS) synthesis with attention like that in Tacotron models. These models are end-to-end, meaning that they learn both co-articulation and duration properties directly from text and speech. Since these models are entirely data-driven, they need large amounts of data to generate synthetic speech of good quality. However, in challenging speaking styles, such as Lombard speech, it is difficult to record sufficiently large speech corpora. Therefore, we propose a transfer learning method to adapt a TTS system of normal speaking style to Lombard style. We also experiment with a WaveNet vocoder along with a traditional vocoder (WORLD) in the synthesis of Lombard speech. The subjective and objective evaluation results indicated that the proposed adaptation system coupled with the WaveNet vocoder clearly outperformed the conventional deep neural network based TTS system in the synthesis of Lombard speech
Original language | English |
---|---|
Title of host publication | Proceedings of Interspeech |
Publisher | International Speech Communication Association (ISCA) |
Pages | 2833-2837 |
DOIs | |
Publication status | Published - 2019 |
MoE publication type | A4 Conference publication |
Event | Interspeech - Graz, Austria Duration: 15 Sept 2019 → 19 Sept 2019 https://www.interspeech2019.org/ |
Publication series
Name | Interspeech - Annual Conference of the International Speech Communication Association |
---|---|
ISSN (Electronic) | 2308-457X |
Conference
Conference | Interspeech |
---|---|
Country/Territory | Austria |
City | Graz |
Period | 15/09/2019 → 19/09/2019 |
Internet address |
Keywords
- Adaptation
- Lombard speaking style
- Tacotron
- Text-To-Speech (TTS)
Fingerprint
Dive into the research topics of 'Lombard speech synthesis using transfer learning in a Tacotron text-to-speech system'. Together they form a unique fingerprint.Projects
- 1 Finished
-
Interdisciplinary research on statistical parametric speech synthesis
Alku, P. (Principal investigator), Bäckström, T. (Project Member), Juvela, L. (Project Member), Murtola, T. (Project Member), Nonavinakere Prabhakera, N. (Project Member), Bollepalli, B. (Project Member) & Airaksinen, M. (Project Member)
01/01/2018 → 31/12/2019
Project: Academy of Finland: Other research funding