Musical Instruments, Body Movement, Space, and Motion Data: Music as an Emergent Multimodal Choreography
Visi, F., Coorevits, E., Schramm, R., & Miranda, E. R. (2017). Musical Instruments, Body Movement, Space, and Motion Data: Music as an Emergent Multimodal Choreography. Human Technology, 13 (1), 58-81. doi:10.17011/ht/urn.201705272518
Published inHuman Technology
© the Authors & the Agora Center, University of Jyväskylä, 2017. This is an open access article distributed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Music is a complex multimodal medium experienced not only via sounds but also through body movement. Musical instruments can be seen as technological objects coupled with a repertoire of gestures. We present technical and conceptual issues related to the digital representation and mediation of body movement in musical performance. The paper reports on a case study of a musical performance where motion sensor technologies tracked the movements of the musicians while they played their instruments. Motion data were used to control the electronic elements of the piece in real time. It is suggested that computable motion descriptors and machine learning techniques are useful tools for interpreting motion data in a meaningful manner. However, qualitative insights regarding how human body movement is understood and experienced are necessary to inform further development of motion-capture technologies for expressive purposes. Thus, musical performances provide an effective test bed for new modalities of human–computer interaction. ...
PublisherUniversity of Jyväskylä, Agora Center
ISSN Search the Publication Forum1795-6889
MetadataShow full item record
Except where otherwise noted, this item's license is described as © the Authors & the Agora Center, University of Jyväskylä, 2017. This is an open access article distributed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Showing items with similar title or keywords.
The Relation Between Emotional Valence and Performance Motion of the Keyboard Instrument Mito, Yuki; Kawakami, Hiroshi; Miura, Masanobu; Shinoda, Yukitaka (University of Jyväskylä, Department of Music, 2013)This study examined relations of the emotion and part of the upper body during the keyboard instrument performance. The study showed the trace from the lateral direction to watch movement. As a result, there was a difference ...
Motion in musical sound : the role of music performer bodily gesture in creating expressive sounding music Allingham, Emma (2018)The way that musicians move when they perform is closely linked with their communicative intent and artistic interpretation of the music. While research has shown that musicians’ bodily gesture conveys visually expressive ...
Proprioceptive response strength in the primary sensorimotor cortex is invariant to the range of finger movement Nurmi, Timo; Hakonen, Maria; Bourguignon, Mathieu; Piitulainen, Harri (Elsevier, 2023)Proprioception is the sense of body position and movement that relies on afference from the proprioceptors in muscles and joints. Proprioceptive responses in the primary sensorimotor (SM1) cortex can be elicited by stimulating ...
Revisiting the cross‐sectional and prospective association of physical activity with body composition and physical fitness in preschoolers : A compositional data approach Migueles, Jairo H.; Delisle Nyström, Christine; Leppänen, Marja H.; Henriksson, Pontus; Löf, Marie (Wiley, 2022)Background Information is limited for the benefits of physical activity (PA) in preschoolers. Previous research using accelerometer-assessed PA may be affected for multicollinearity issues. Objectives This study ...
Exploring relationships between effort, motion, and sound in new musical instruments Erdem, Çağrı; Lan, Qichao; Jensenius, Alexander Refsum (Jyväskylän Yliopisto, 2020)We investigated how the action–sound relationships found in electric guitar performance can be used in the design of new instruments. Thirty-one trained guitarists performed a set of basic sound-producing actions (impulsive, ...