Applying Acoustical and Musicological Analysis to Detect Brain Responses to Realistic Music: A Case Study

Niels Trusbak Haumann, Marina Kliuchko, Peter Vuust, Elvira Brattico

Research output: Contribution to journalArticleScientificpeer-review

Abstract

Music information retrieval (MIR) methods offer interesting possibilities for automatically identifying time points in music recordings that relate to specific brain responses. However, how the acoustical features and the novelty of the music structure affect the brain response is not yet clear. In the present study, we tested a new method for automatically identifying time points of brain responses based on MIR analysis. We utilized an existing database including brain recordings of 48 healthy listeners measured with electroencephalography (EEG) and magnetoencephalography (MEG). While we succeeded in capturing brain responses related to acoustical changes in the modern tango piece Adios Nonino, we obtained less reliable brain responses with a metal rock piece and a modern symphony orchestra musical composition. However, brain responses might also relate to the novelty of the music structure. Hence, we added a manual musicological analysis of novelty in the musical structure to the computational acoustic analysis, obtaining strong brain responses even to the rock and modern pieces. Although no standardized method yet exists, these preliminary results suggest that analysis of novelty in music is an important aid to MIR analysis for investigating brain responses to realistic music.
Original languageEnglish
Article number716
JournalApplied sciences
Volume8
Issue number5
Number of pages15
ISSN2076-3417
DOIs
Publication statusPublished - 4 May 2018
MoE publication typeA1 Journal article-refereed

Fields of Science

  • 6131 Theatre, dance, music, other performing arts
  • 3112 Neurosciences

Cite this

@article{240bb01dd9e54e2ba702835b00a81faf,
title = "Applying Acoustical and Musicological Analysis to Detect Brain Responses to Realistic Music: A Case Study",
abstract = "Music information retrieval (MIR) methods offer interesting possibilities for automatically identifying time points in music recordings that relate to specific brain responses. However, how the acoustical features and the novelty of the music structure affect the brain response is not yet clear. In the present study, we tested a new method for automatically identifying time points of brain responses based on MIR analysis. We utilized an existing database including brain recordings of 48 healthy listeners measured with electroencephalography (EEG) and magnetoencephalography (MEG). While we succeeded in capturing brain responses related to acoustical changes in the modern tango piece Adios Nonino, we obtained less reliable brain responses with a metal rock piece and a modern symphony orchestra musical composition. However, brain responses might also relate to the novelty of the music structure. Hence, we added a manual musicological analysis of novelty in the musical structure to the computational acoustic analysis, obtaining strong brain responses even to the rock and modern pieces. Although no standardized method yet exists, these preliminary results suggest that analysis of novelty in music is an important aid to MIR analysis for investigating brain responses to realistic music.",
keywords = "6131 Theatre, dance, music, other performing arts, 3112 Neurosciences",
author = "Haumann, {Niels Trusbak} and Marina Kliuchko and Peter Vuust and Elvira Brattico",
year = "2018",
month = "5",
day = "4",
doi = "10.3390/app8050716",
language = "English",
volume = "8",
journal = "Applied sciences",
issn = "2076-3417",
publisher = "MDPI",
number = "5",

}

Applying Acoustical and Musicological Analysis to Detect Brain Responses to Realistic Music: A Case Study. / Haumann, Niels Trusbak; Kliuchko, Marina; Vuust, Peter; Brattico, Elvira.

In: Applied sciences, Vol. 8, No. 5, 716, 04.05.2018.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Applying Acoustical and Musicological Analysis to Detect Brain Responses to Realistic Music: A Case Study

AU - Haumann, Niels Trusbak

AU - Kliuchko, Marina

AU - Vuust, Peter

AU - Brattico, Elvira

PY - 2018/5/4

Y1 - 2018/5/4

N2 - Music information retrieval (MIR) methods offer interesting possibilities for automatically identifying time points in music recordings that relate to specific brain responses. However, how the acoustical features and the novelty of the music structure affect the brain response is not yet clear. In the present study, we tested a new method for automatically identifying time points of brain responses based on MIR analysis. We utilized an existing database including brain recordings of 48 healthy listeners measured with electroencephalography (EEG) and magnetoencephalography (MEG). While we succeeded in capturing brain responses related to acoustical changes in the modern tango piece Adios Nonino, we obtained less reliable brain responses with a metal rock piece and a modern symphony orchestra musical composition. However, brain responses might also relate to the novelty of the music structure. Hence, we added a manual musicological analysis of novelty in the musical structure to the computational acoustic analysis, obtaining strong brain responses even to the rock and modern pieces. Although no standardized method yet exists, these preliminary results suggest that analysis of novelty in music is an important aid to MIR analysis for investigating brain responses to realistic music.

AB - Music information retrieval (MIR) methods offer interesting possibilities for automatically identifying time points in music recordings that relate to specific brain responses. However, how the acoustical features and the novelty of the music structure affect the brain response is not yet clear. In the present study, we tested a new method for automatically identifying time points of brain responses based on MIR analysis. We utilized an existing database including brain recordings of 48 healthy listeners measured with electroencephalography (EEG) and magnetoencephalography (MEG). While we succeeded in capturing brain responses related to acoustical changes in the modern tango piece Adios Nonino, we obtained less reliable brain responses with a metal rock piece and a modern symphony orchestra musical composition. However, brain responses might also relate to the novelty of the music structure. Hence, we added a manual musicological analysis of novelty in the musical structure to the computational acoustic analysis, obtaining strong brain responses even to the rock and modern pieces. Although no standardized method yet exists, these preliminary results suggest that analysis of novelty in music is an important aid to MIR analysis for investigating brain responses to realistic music.

KW - 6131 Theatre, dance, music, other performing arts

KW - 3112 Neurosciences

U2 - 10.3390/app8050716

DO - 10.3390/app8050716

M3 - Article

VL - 8

JO - Applied sciences

JF - Applied sciences

SN - 2076-3417

IS - 5

M1 - 716

ER -