Data Musicalization

Aurora Tulilaulu, Matti Nelimarkka, Joonas Paalasmaa, Daniel Johnson, Dan Ventura, Petri Myllys, Hannu Toivonen

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Data musicalization is the process of automatically composing music based on given data, as an approach to perceptualizing information artistically. The aim of data musicalization is to evoke subjective experiences in relation to the information, rather than merely to convey unemotional information objectively. This paper is written as a tutorial for readers interested in data musicalization. We start by providing a systematic characterization of musicalization approaches, based on their inputs, methods and outputs. We then illustrate data musicalization techniques with examples from several applications: one that perceptualizes physical sleep data as music, several that artistically compose music inspired by the sleep data, one that musicalizes on-line chat conversations to provide a perceptualization of liveliness of a discussion, and one that uses musicalization in a game-like mobile application that allows its users to produce music. We additionally provide a number of electronic samples of music produced by the different musicalization applications.
Original languageEnglish
Article number47
JournalACM Transactions on Multimedia Computing Communications and Applications
Volume14
Issue number2
Number of pages27
ISSN1551-6857
DOIs
Publication statusPublished - May 2018
MoE publication typeA1 Journal article-refereed

Fields of Science

  • 113 Computer and information sciences
  • Computational Creativity
  • Artificial Intelligence
  • Multimedia
  • Automated Composision
  • Data Analysis
  • Data Science
  • 6131 Theatre, dance, music, other performing arts
  • Music
  • Algorithmic Composition
  • Data musicalization
  • sonification
  • automated composition
  • music
  • data analysis
  • computational creativity
  • WALKING STYLES
  • SONIFICATION

Cite this

Tulilaulu, Aurora ; Nelimarkka, Matti ; Paalasmaa, Joonas ; Johnson, Daniel ; Ventura, Dan ; Myllys, Petri ; Toivonen, Hannu. / Data Musicalization. In: ACM Transactions on Multimedia Computing Communications and Applications. 2018 ; Vol. 14, No. 2.
@article{82c4cd96d4244737b6c22e73c9542ba6,
title = "Data Musicalization",
abstract = "Data musicalization is the process of automatically composing music based on given data, as an approach to perceptualizing information artistically. The aim of data musicalization is to evoke subjective experiences in relation to the information, rather than merely to convey unemotional information objectively. This paper is written as a tutorial for readers interested in data musicalization. We start by providing a systematic characterization of musicalization approaches, based on their inputs, methods and outputs. We then illustrate data musicalization techniques with examples from several applications: one that perceptualizes physical sleep data as music, several that artistically compose music inspired by the sleep data, one that musicalizes on-line chat conversations to provide a perceptualization of liveliness of a discussion, and one that uses musicalization in a game-like mobile application that allows its users to produce music. We additionally provide a number of electronic samples of music produced by the different musicalization applications.",
keywords = "113 Computer and information sciences, Computational Creativity, Artificial Intelligence, Multimedia, Automated Composision, Data Analysis, Data Science, 6131 Theatre, dance, music, other performing arts, Music, Algorithmic Composition, Data musicalization, sonification, automated composition, music, data analysis, computational creativity, WALKING STYLES, SONIFICATION",
author = "Aurora Tulilaulu and Matti Nelimarkka and Joonas Paalasmaa and Daniel Johnson and Dan Ventura and Petri Myllys and Hannu Toivonen",
year = "2018",
month = "5",
doi = "10.1145/3184742",
language = "English",
volume = "14",
journal = "ACM Transactions on Multimedia Computing Communications and Applications",
issn = "1551-6857",
publisher = "ASSOC COMPUTING MACHINERY",
number = "2",

}

Data Musicalization. / Tulilaulu, Aurora; Nelimarkka, Matti; Paalasmaa, Joonas; Johnson, Daniel; Ventura, Dan; Myllys, Petri; Toivonen, Hannu.

In: ACM Transactions on Multimedia Computing Communications and Applications, Vol. 14, No. 2, 47, 05.2018.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Data Musicalization

AU - Tulilaulu, Aurora

AU - Nelimarkka, Matti

AU - Paalasmaa, Joonas

AU - Johnson, Daniel

AU - Ventura, Dan

AU - Myllys, Petri

AU - Toivonen, Hannu

PY - 2018/5

Y1 - 2018/5

N2 - Data musicalization is the process of automatically composing music based on given data, as an approach to perceptualizing information artistically. The aim of data musicalization is to evoke subjective experiences in relation to the information, rather than merely to convey unemotional information objectively. This paper is written as a tutorial for readers interested in data musicalization. We start by providing a systematic characterization of musicalization approaches, based on their inputs, methods and outputs. We then illustrate data musicalization techniques with examples from several applications: one that perceptualizes physical sleep data as music, several that artistically compose music inspired by the sleep data, one that musicalizes on-line chat conversations to provide a perceptualization of liveliness of a discussion, and one that uses musicalization in a game-like mobile application that allows its users to produce music. We additionally provide a number of electronic samples of music produced by the different musicalization applications.

AB - Data musicalization is the process of automatically composing music based on given data, as an approach to perceptualizing information artistically. The aim of data musicalization is to evoke subjective experiences in relation to the information, rather than merely to convey unemotional information objectively. This paper is written as a tutorial for readers interested in data musicalization. We start by providing a systematic characterization of musicalization approaches, based on their inputs, methods and outputs. We then illustrate data musicalization techniques with examples from several applications: one that perceptualizes physical sleep data as music, several that artistically compose music inspired by the sleep data, one that musicalizes on-line chat conversations to provide a perceptualization of liveliness of a discussion, and one that uses musicalization in a game-like mobile application that allows its users to produce music. We additionally provide a number of electronic samples of music produced by the different musicalization applications.

KW - 113 Computer and information sciences

KW - Computational Creativity

KW - Artificial Intelligence

KW - Multimedia

KW - Automated Composision

KW - Data Analysis

KW - Data Science

KW - 6131 Theatre, dance, music, other performing arts

KW - Music

KW - Algorithmic Composition

KW - Data musicalization

KW - sonification

KW - automated composition

KW - music

KW - data analysis

KW - computational creativity

KW - WALKING STYLES

KW - SONIFICATION

U2 - 10.1145/3184742

DO - 10.1145/3184742

M3 - Article

VL - 14

JO - ACM Transactions on Multimedia Computing Communications and Applications

JF - ACM Transactions on Multimedia Computing Communications and Applications

SN - 1551-6857

IS - 2

M1 - 47

ER -