Data Musicalization

Aurora Tulilaulu, Matti Nelimarkka, Joonas Paalasmaa, Daniel Johnson, Dan Ventura, Petri Myllys, Hannu Toivonen

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Data musicalization is the process of automatically composing music based on given data, as an approach to perceptualizing information artistically. The aim of data musicalization is to evoke subjective experiences in relation to the information, rather than merely to convey unemotional information objectively. This paper is written as a tutorial for readers interested in data musicalization. We start by providing a systematic characterization of musicalization approaches, based on their inputs, methods and outputs. We then illustrate data musicalization techniques with examples from several applications: one that perceptualizes physical sleep data as music, several that artistically compose music inspired by the sleep data, one that musicalizes on-line chat conversations to provide a perceptualization of liveliness of a discussion, and one that uses musicalization in a game-like mobile application that allows its users to produce music. We additionally provide a number of electronic samples of music produced by the different musicalization applications.
Original languageEnglish
Article number47
JournalACM Transactions on Multimedia Computing Communications and Applications
Volume14
Issue number2
Number of pages27
ISSN1551-6857
DOIs
Publication statusPublished - May 2018
MoE publication typeA1 Journal article-refereed

Fields of Science

  • 113 Computer and information sciences
  • Computational Creativity
  • Artificial Intelligence
  • Multimedia
  • Automated Composision
  • Data Analysis
  • Data Science
  • 6131 Theatre, dance, music, other performing arts
  • Music
  • Algorithmic Composition
  • Data musicalization
  • sonification
  • automated composition
  • music
  • data analysis
  • computational creativity
  • WALKING STYLES
  • SONIFICATION

Cite this