Interaction of sight and sound in the perception and experience of musical performance
Vuoskoski, J. K., Thompson, M., Spence, C., & Clarke, E. F. (2016). Interaction of sight and sound in the perception and experience of musical performance. Music Perception, 33(4), 457-471. https://doi.org/10.1525/mp.2016.33.4.457
Published inMusic Perception
© 2016 by the Regents of the University of California. Published in this repository with the kind permission of the publisher.
Recently, Vuoskoski, Thompson, Clarke, and Spence (2014) demonstrated that visual kinematic performance cues may be more important than auditory performance cues in terms of observers’ ratings of expressivity perceived in audiovisual excerpts of piano playing, and that visual kinematic performance cues had crossmodal effects on the perception of auditory expressivity. The present study was designed to extend these findings, and to provide additional information about the roles of sight and sound in the perception and experience of musical performance. Experiment 1 investigated the relative contributions of auditory and visual kinematic performance features to participants’ subjective emotional reactions evoked by piano performances, while Experiment 2 was designed to explore the effect of visual kinematic cues on the perception of loudness and tempo variability. Experiment 1 revealed that visual performance cues seem to be just as important as auditory performance cues in terms of the subjective emotional reaction of the observer, thus highlighting the importance of non-auditory cues for music-induced emotions. The results of Experiment 2 revealed that visual kinematic cues only affected ratings of loudness variability, but not ratings of tempo variability. ...
PublisherUniversity of California Press
Publication in research information system
MetadataShow full item record
Showing items with similar title or keywords.
Dasovich-Wilson, Johanna N.; Thompson, Marc; Saarikallio, Suvi (SAGE Publications, 2022)Streaming music videos on the internet is an increasingly popular music listening activity that has remained virtually unexplored within music psychology. Studies of the role of music in film, as well as empirical research ...
Top-Down Predictions of Familiarity and Congruency in Audio-Visual Speech Perception at Neural Level Kolozsvári, Orsolya B.; Xu, Weiyong; Leppänen, Paavo H. T.; Hämäläinen, Jarmo A. (Frontiers Media, 2019)During speech perception, listeners rely on multimodal input and make use of both auditory and visual information. When presented with speech, for example syllables, the differences in brain responses to distinct stimuli ...
Which part of the conductor's body conveys most expressive information? A spatial occlusion approach Wöllner, Clemens (2008)This study investigated the perception of conductors' body movements under different viewing conditions with a multi-modal within-subjects design. Five conductors with different levels of experience each conducted four ...
All Eyes on Me : Behaving as Soloist in Duo Performances Leads to Increased Body Movements and Attracts Observers’ Visual Attention Küssner, Mats B.; Van Dyck, Edith; Burger, Birgitta; Moelants, Dirk; Vansteenkiste, Pieter (University of California Press, 2020)Duo musicians exhibit a broad variety of bodily gestures, but it is unclear how soloists’ and accompanists’ movements differ and to what extent they attract observers’ visual attention. In Experiment 1, seven musical duos’ ...
Variations of the perception of mood and tension of music excerpts depending on the visual context Payri, Blas (2009)We study the influence that image features may have on music tension and liveliness perception. 72 music excerpts from different genres and periods were selected, and 72 still shots were taken from different animation ...