Data Musicalization

Research output: Contribution to journalArticleScientificpeer-review

Researchers

  • Aurora Tulilaulu
  • Matti Nelimarkka

  • Joonas Paalasmaa
  • Daniel Johanson
  • Dan Ventura
  • Petri Myllys
  • Hannu Toivonen

Research units

  • University of Helsinki
  • Beddit Ltd
  • Brigham Young University

Abstract

Data musicalization is the process of automatically composing music based on given data as an approach to perceptualizing information artistically. The aim of data musicalization is to evoke subjective experiences in relation to the information rather than merely to convey unemotional information objectively. This article is written as a tutorial for readers interested in data musicalization. We start by providing a systematic characterization of musicalization approaches, based on their inputs, methods, and outputs. We then illustrate data musicalization techniques with examples from several applications: one that perceptualizes physical sleep data as music, several that artistically compose music inspired by the sleep data, one that musicalizes on-line chat conversations to provide a perceptualization of liveliness of a discussion, and one that uses musicalization in a gamelike mobile application that allows its users to produce music. We additionally provide a number of electronic samples of music produced by the different musicalization applications.

Details

Original languageEnglish
Article number47
Pages (from-to)1-27
JournalACM Transactions on Multimedia Computing, Communications and Applications
Volume14
Issue number2
Publication statusPublished - 1 Apr 2018
MoE publication typeA1 Journal article-refereed

    Research areas

  • Data Musicalization, Sonification, Automated Composition, Music, Data Analysis, Computational Creativity

Download statistics

No data available

ID: 17058106