Deep Learning for Loudspeaker Digital Twin Creation

Several studies have used deep learning methods to create digital twins of amps, speakers, and effects pedals. This paper presents a novel method for creating a digital twin of a physical loudspeaker with stereo output. Two neural network architectures are considered: a Recurrent Neural Network (RNN) and a WaveNet-style Convolutional Neural Network (CNN). The models were tested on two datasets containing speech and music, respectively. The method of recording and preprocessing the target audio data addresses the challenge of lacking a direct output line to digitize the effect of nonlinear circuits. Both model architectures successfully create a digital twin of the loudspeaker with no direct output line and stereo audio. The RNN model achieved the best result on the music dataset, while the WaveNet model achieved the best result on the speech dataset.