Al-terity: Non-Rigid Musical Instrument with Artificial Intelligence Applied to Real-Time Audio Synthesis

Koray Tahiroğlu, Miranda Kastemaa, Oskar Koli

    Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

    826 Downloads (Pure)

    Abstract

    A deformable musical instrument can take numerous dis- tinct shapes with its non-rigid features. Building audio syn- thesis module for such an interface behaviour can be chal- lenging. In this paper, we present the Al-terity, a non-rigid musical instrument that comprises a deep learning model with generative adversarial network architecture and use it for generating audio samples for real-time audio synthesis. The particular deep learning model we use for this instru- ment was trained with existing data set as input for pur- poses of further experimentation. The main benefits of the model used are the ability to produce the realistic range of timbre of the trained data set and the ability to generate new audio samples in real-time, in the moment of playing, with the characteristics of sounds that the performer ever heard before. We argue that these advanced intelligence features on the audio synthesis level could allow us to ex- plore performing music with particular response features that define the instrument’s digital idiomaticity and allow us reinvent the instrument in the act of music performance.
    Original languageEnglish
    Title of host publicationProceedings of the International Conference on New Interfaces for Musical Expression
    Place of PublicationBirmingham
    PublisherInternational Conference on New Interfaces for Musical Expression (NIME)
    Pages337-342
    Number of pages6
    Publication statusPublished - 25 Jul 2020
    MoE publication typeA4 Conference publication
    EventINTERNATIONAL CONFERENCE ON NEW INTERFACES FOR MUSICAL EXPRESSION -
    Duration: 1 Jan 1900 → …

    Publication series

    NameProceedings of the International Conference on New Interfaces for Musical Expression
    ISSN (Electronic)2220-4806

    Conference

    ConferenceINTERNATIONAL CONFERENCE ON NEW INTERFACES FOR MUSICAL EXPRESSION
    Abbreviated titleNIME
    Period01/01/1900 → …

    Keywords

    • NIME
    • Artificial Intelligence (AI)
    • GAN
    • deep learning
    • SOPI

    Fingerprint

    Dive into the research topics of 'Al-terity: Non-Rigid Musical Instrument with Artificial Intelligence Applied to Real-Time Audio Synthesis'. Together they form a unique fingerprint.
    • GANSpaceSynth

      Tahiroğlu, K., Kastemaa, M. & Koli, O., 15 Jun 2021

      Research output: Artistic and non-textual formSoftwareScientificpeer-review

      Open Access

    Cite this