Beatmatching in DJing : An analysis of temporal coordination using electroencephalogram (EEG), motion capture, and audio analysis
Galvis, D., Nijhuis, P., Karim, D., Sturman, R., & Witek, M. (2024). Beatmatching in DJing : An analysis of temporal coordination using electroencephalogram (EEG), motion capture, and audio analysis. In The Neurosciences and Music VIII : Wiring, re-wiring, and well-being : Helsinki, Finland & online, 13-16 June 2024 (pp. 120-121). Mariani Foundation for Paediatric Neurology. https://neuromusic.fondazione-mariani.org/app/uploads/2024/07/ONLINE-program_5-luglio-2024.pdf
Date
2024Copyright
© 2024 Mariani Foundation for Paediatric Neurology
DJing is a sophisticated musical skill involving complex temporal perception and active manipulation of multiple, often polyrhythmic patterns simultaneously. In the process of beatmatching, DJs synchronise two different records that are out of phase or playing at different tempo. This is an embodied, dynamic activity relying on a coordinated system of processes in the body, the brain, the turntables and the sonic patterns in the music. The aim of this work is to explore the interactions occurring between these dynamic processes and to compare them over a set of behaviours commonly exhibited during beatmatching. We collected 121 audio, EEG, and motion capture data from 28 DJs. The task was to beatmatch two tracks initially playing at different phases (shifted one sixth of a bar) or tempi (130 vs 135 bpm) using digital turntables with the automatic sync function turned off. We then extracted a phase representation for each dataset to study synchronisation between the two tracks and body movement. In initial analysis of the audio, we extracted the dynamic changes to the tracks over time, identifying windows of distinct behaviour. In the movement data, we identified associated windows of rhythmic movement locked to the beat. Together, these analyses provide a clear picture of the behavioural modes. Using these results, we then compared functional neural connectivity across different behavioural modes including slip cueing, nudging the platter, adjusting the pitch control, and monitoring the resulting mix. In this poster, we will present preliminary EEG analyses relating the combined audio and motor modes to features of the functional networks. This research has potential to improve understanding of the role of movement, brain states, and their interactions in coordinating the beatmatching process. More broadly, this work supports an embodied approach to studying how humans coordinate complex rhythmic behaviours to complex rhythmic stimuli in their environments.
...
Publisher
Mariani Foundation for Paediatric NeurologyConference
Neurosciences and MusicIs part of publication
The Neurosciences and Music VIII : Wiring, re-wiring, and well-being : Helsinki, Finland & online, 13-16 June 2024
Original source
https://neuromusic.fondazione-mariani.org/app/uploads/2024/07/ONLINE-program_5-luglio-2024.pdfPublication in research information system
https://converis.jyu.fi/converis/portal/detail/Publication/243700692
Metadata
Show full item recordCollections
License
Related items
Showing items with similar title or keywords.
-
Evaluation of 3D Markerless Motion Capture System Accuracy during Skate Skiing on a Treadmill
Torvinen, Petra; Ruotsalainen, Keijo S.; Zhao, Shuang; Cronin, Neil; Ohtonen, Olli; Linnamo, Vesa (MDPI AG, 2024)In this study, we developed a deep learning-based 3D markerless motion capture system for skate skiing on a treadmill and evaluated its accuracy against marker-based motion capture during G1 and G3 skating techniques. ... -
Relationships Between Audio and Movement Features, and Perceived Emotions in Musical Performance
Thompson, Marc R.; Mendoza, Juan Ignacio; Luck, Geoff; Vuoskoski, Jonna K. (SAGE Publications, 2023)A core aspect of musical performance is communicating emotional and expressive intentions to the audience. Recognition of the musician's intentions is constructed from a combination of visual and auditory performance cues, ... -
All Eyes on Me : Behaving as Soloist in Duo Performances Leads to Increased Body Movements and Attracts Observers’ Visual Attention
Küssner, Mats B.; Van Dyck, Edith; Burger, Birgitta; Moelants, Dirk; Vansteenkiste, Pieter (University of California Press, 2020)Duo musicians exhibit a broad variety of bodily gestures, but it is unclear how soloists’ and accompanists’ movements differ and to what extent they attract observers’ visual attention. In Experiment 1, seven musical duos’ ... -
The more you move, the more action you construct : a motion capture study on head and upper-torso movements in constructed action in Finnish Sign Language narratives
Jantunen, Tommi; De Weerdt, Danny; Burger, Birgitta; Puupponen, Anna (John Benjamins Publishing Company, 2021)This paper investigates, with the help of motion capture data processed on corpus principles, the characteristics of head and upper-torso movements in constructed action and regular narration (i.e., signing without constructed ... -
What Comes First : Combining Motion Capture and Eye Tracking Data to Study the Order of Articulators in Constructed Action in Sign Language Narratives
Jantunen, Tommi; Puupponen, Anna; Burger, Birgitta (European Language Resources Association, 2020)We use synchronized 120 fps motion capture and 50 fps eye tracking data from two native signers to investigate the temporal order in which the dominant hand, the head, the chest and the eyes start producing overt constructed ...