Identifying musical pieces from fMRI data using encoding and decoding models
Hoefle, S., Engel, A., Basilio, R., Alluri, V., Toiviainen, P., Cagy, M., & Moll, J. (2018). Identifying musical pieces from fMRI data using encoding and decoding models. Scientific Reports, 8, Article 2266. https://doi.org/10.1038/s41598-018-20732-3
Published in
Scientific ReportsAuthors
Date
2018Copyright
© the Authors, 2018. This is an open access article distributed under the terms of the Creative Commons License.
Encoding models can reveal and decode neural representations in the visual and semantic domains. However, a thorough understanding of how distributed information in auditory cortices and temporal evolution of music contribute to model performance is still lacking in the musical domain. We measured fMRI responses during naturalistic music listening and constructed a two-stage approach that first mapped musical features in auditory cortices and then decoded novel musical pieces. We then probed the influence of stimuli duration (number of time points) and spatial extent (number of voxels) on decoding accuracy. Our approach revealed a linear increase in accuracy with duration and a point of optimal model performance for the spatial extent. We further showed that Shannon entropy is a driving factor, boosting accuracy up to 95% for music with highest information content. These findings provide key insights for future decoding and reconstruction algorithms and open new venues for possible clinical applications.
...
Publisher
Nature Publishing GroupISSN Search the Publication Forum
2045-2322Keywords
Publication in research information system
https://converis.jyu.fi/converis/portal/detail/Publication/27895639
Metadata
Show full item recordCollections
License
Except where otherwise noted, this item's license is described as © the Authors, 2018. This is an open access article distributed under the terms of the Creative Commons License.
Related items
Showing items with similar title or keywords.
-
How personality modulates brain responses to emotion in music : a regions-of-variance approach
Oudyk, Kendra (2018)Background: Personality is related to emotional tendencies, and emotion is an important part of musical experiences. In particular, the personality traits Extraversion and Neuroticism have been respectively related to ... -
Aberrant brain functional networks in type 2 diabetes mellitus : A graph theoretical and support-vector machine approach
Lin, Lin; Zhang, Jindi; Liu, Yutong; Hao, Xinyu; Shen, Jing; Yu, Yang; Xu, Huashuai; Cong, Fengyu; Li, Huanjie; Wu, Jianlin (Frontiers Media SA, 2022)Objective: Type 2 diabetes mellitus (T2DM) is a high risk of cognitive decline and dementia, but the underlying mechanisms are not yet clearly understood. This study aimed to explore the functional connectivity (FC) and ... -
EEG-based study on musical groove and motor cortical beta power in the brain
Kuivamäki, Tommi (2023)Ihmisten taipumus liikkua tai tanssia musiikin tahtiin spontaanisti on laajalti tunnettu jokapäiväinen ilmiö. Kyseistä ilmiötä ei kuitenkaan olla perusteellisesti tutkittu EEG-tutkimuksissa musiikillisen grooven näkökulmasta. ... -
Dance on Cortex : Enhanced Theta Synchrony in Experts when Watching a Dance Piece
Poikonen, Hanna; Toiviainen, Petri; Tervaniemi, Mari (Wiley, 2018)When watching performing arts, a wide and complex network of brain processes emerge. These processes can be shaped by professional expertise. When compared to laymen, dancers have enhanced processes in observation of short ... -
Exploring Frequency-Dependent Brain Networks from Ongoing EEG Using Spatial ICA During Music Listening
Zhu, Yongjie; Zhang, Chi; Poikonen, Hanna; Toiviainen, Petri; Huotilainen, Minna; Mathiak, Klaus; Ristaniemi, Tapani; Cong, Fengyu (Springer, 2020)Recently, exploring brain activity based on functional networks during naturalistic stimuli especially music and video represents an attractive challenge because of the low signal-to-noise ratio in collected brain data. ...