Federated Learning for Privacy Preserving On-Device Speaker Recognition

Abraham Zewoudie, Tom Bäckström

Tutkimustuotos: Artikkeli kirjassa/konferenssijulkaisussaConference article in proceedingsProfessional

216 Lataukset (Pure)


State-of-the-art speaker recognition systems are usually trained on a single computer using speech data collected from multiple users. However, these speech samples may contain private information which users are not willing to share. To overcome such potential breaches of privacy, we investigate the use of federated learning in speaker recognition. Distributed learning methods such as federated learning enable us to train a shared model without sharing the private data by training the models on edge devices where the data resides. In the proposed system, each edge device trains an individual model which is subsequently sent to a secure aggregator. To provide contrasting data without the need for transmitting data, we use a generative adversarial network (GAN) to generate impostor data at the edge. Afterwards, the secure aggregator merges the individual models, builds a global model and transmits the global model to the edge devices through a main server. Experimental results on the Voxceleb-1 dataset show that the use of federated learning for speaker recognition system provides two advantages. Firstly, it retains privacy since the raw data does not leave the edge devices. Secondly, experimental results show that the aggregated model provides better average equal error rate than the individual models.
OtsikkoISCA Symposium on Security and Privacy in Speech Communication proceedings
KustantajaInternational Speech Communication Association (ISCA)
DOI - pysyväislinkit
TilaJulkaistu - 2021
OKM-julkaisutyyppiD3 Artikkeli ammatillisessa konferenssijulkaisussa
TapahtumaISCA Symposium on Security and Privacy in Speech Communication - Virtual, Online
Kesto: 10 marrask. 202112 marrask. 2021
Konferenssinumero: 1


ConferenceISCA Symposium on Security and Privacy in Speech Communication
KaupunkiVirtual, Online


Sukella tutkimusaiheisiin 'Federated Learning for Privacy Preserving On-Device Speaker Recognition'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä