Exploring relationships between effort, motion, and sound in new musical instruments
Erdem, Çağrı; Lan, Qichao; Jensenius, Alexander Refsum (2020). Exploring relationships between effort, motion, and sound in new musical instruments. Human Technology, 16 (3), 310-347. DOI: 10.17011/ht/urn.202011256767
Published inHuman Technology
©2020 Çağrı Erdem, Qichao Lan, & Alexander Refsum Jensenius, and the Open Science Centre, University of Jyväskylä
We investigated how the action–sound relationships found in electric guitar performance can be used in the design of new instruments. Thirty-one trained guitarists performed a set of basic sound-producing actions (impulsive, sustained, and iterative) and free improvisations on an electric guitar. We performed a statistical analysis of the muscle activation data (EMG) and audio recordings from the experiment. Then we trained a long short-term memory network with nine different configurations to map EMG signal to sound. We found that the preliminary models were able to predict audio energy features of free improvisations on the guitar, based on the dataset of raw EMG from the basic soundproducing actions. The results provide evidence of similarities between body motion and sound in music performance, compatible with embodied music cognition theories. They also show the potential of using machine learning on recorded performance data in the design of new musical instruments.
MetadataShow full item record
Showing items with similar title or keywords.
Laurier, Cyril; Lartillot, Olivier; Eerola, Tuomas; Toiviainen, Petri (2009)In this paper, we present an analysis of the associations between emotion categories and audio features automatically extracted from raw audio data. This work is based on 110 excerpts from film soundtracks evaluated by 116 ...
Mito, Yuki; Kawakami, Hiroshi; Miura, Masanobu; Shinoda, Yukitaka (University of Jyväskylä, Department of Music, 2013)This study examined relations of the emotion and part of the upper body during the keyboard instrument performance. The study showed the trace from the lateral direction to watch movement. As a result, there was a difference ...
"I need your eyes to see myself" : on the inclusion of dialogues and an otherness of the other into psychology and clinical work : explored through studies of contexts where children live with violence in close relationships Flåm, Anna Margrete (Jyväskylän yliopisto, 2018)Violence in close relationships with children raises intriguing questions for our society. The sense making may go on in a fragile balance between possible false accusations and possible neglect of needed concerns. ...
Möttönen, Henriikka; Värri, Meri (2017)Katsekontaktin ja ihon sähkönjohtavuuden välistä yhteyttä on tutkittu aiemminkin, mutta tutkimusta ei ole tehty monitoimijaisessa terapiatilanteessa. Tämän tutkimuksen tarkoituksena oli tarkastella ihon sähkönjohtavuuden ...
Martínez, Isabel Cecilia; Epele, Juliette (2009)Embodied music cognition posits that there is a relationship between the emergent properties of a musical piece and the way musicians, dancers and listeners experience them in their body-minds. Musicological analyses assign ...