Audiovisual Processing of Chinese Characters Elicits Suppression and Congruency Effects in MEG
Xu, W., Kolozsvari, O., Oostenveld, R., Leppänen, P. H., & Hämäläinen, J. (2019). Audiovisual Processing of Chinese Characters Elicits Suppression and Congruency Effects in MEG. Frontiers in Human Neuroscience, 13, Article 18. https://doi.org/10.3389/fnhum.2019.00018
Published inFrontiers in Human Neuroscience
DisciplinePsykologiaMonitieteinen aivotutkimuskeskusPsychologyCentre for Interdisciplinary Brain Research
© 2019 Xu, Kolozsvári, Oostenveld, Leppänen and Hämäläinen.
Learning to associate written letters/characters with speech sounds is crucial for reading acquisition. Most previous studies have focused on audiovisual integration in alphabetic languages. Less is known about logographic languages such as Chinese characters, which map onto mostly syllable-based morphemes in the spoken language. Here we investigated how long-term exposure to native language affects the underlying neural mechanisms of audiovisual integration in a logographic language using magnetoencephalography (MEG). MEG sensor and source data from 12 adult native Chinese speakers and a control group of 13 adult Finnish speakers were analyzed for audiovisual suppression (bimodal responses vs. sum of unimodal responses) and congruency (bimodal incongruent responses vs. bimodal congruent responses) effects. The suppressive integration effect was found in the left angular and supramarginal gyri (205–365 ms), left inferior frontal and left temporal cortices (575–800 ms) in the Chinese group. The Finnish group showed a distinct suppression effect only in the right parietal and occipital cortices at a relatively early time window (285–460 ms). The congruency effect was only observed in the Chinese group in left inferior frontal and superior temporal cortex in a late time window (about 500–800 ms) probably related to modulatory feedback from multi-sensory regions and semantic processing. The audiovisual integration in a logographic language showed a clear resemblance to that in alphabetic languages in the left superior temporal cortex, but with activation specific to the logographic stimuli observed in the left inferior frontal cortex. The current MEG study indicated that learning of logographic languages has a large impact on the audiovisual integration of written characters with some distinct features compared to previous results on alphabetic languages. ...
PublisherFrontiers Research Foundation
Publication in research information system
MetadataShow full item record
Related funder(s)European Commission; Academy of Finland
Funding program(s)Research profiles, AoF
The content of the publication reflects only the author’s view. The funder is not responsible for any use that may be made of the information it contains.
Additional information about fundingThis study was supported by the European Union H2020 Marie Skłodowska-Curie Actions (MSCA)-ITN-2014-ETN Programme, “Advancing brain research in children’s developmental neurocognitive disorders” project (ChildBrain, #641652), “Understanding and predicting developmental language abilities and disorders in multilingual Europe” project (Predictable, #641858) and the Academy of Finland (MultiLeTe, #292466). ...
Showing items with similar title or keywords.
Brain Responses to Letters and Speech Sounds and Their Correlations with Cognitive Skills Related to Reading in Children Xu, Weiyong; Kolozsvari, Orsolya; Monto, Simo; Hämäläinen, Jarmo (Frontiers Research Foundation, 2018)Letter-speech sound (LSS) integration is crucial for initial stages of reading acquisition. However, the relationship between cortical organization for supporting LSS integration, including unimodal and multimodal processes, ...
Xu, Weiyong; Kolozsvari, Orsolya Beatrix; Oostenveld, Robert; Hämäläinen, Jarmo Arvid (Elsevier, 2020)Learning to associate written letters with speech sounds is crucial for the initial phase of acquiring reading skills. However, little is known about the cortical reorganization for supporting letter-speech sound learning, ...
Nora, Anni; Karvonen, Leena; Renvall, Hanna; Parviainen, Tiina; Kim, Jeong-Young; Service, Elisabet; Salmelin, Riitta (Public Library of Science, 2017)It is commonly thought that phonological learning is different in young children compared to adults, possibly due to the speech processing system not yet having reached full native-language specialization. However, the ...
Top-Down Predictions of Familiarity and Congruency in Audio-Visual Speech Perception at Neural Level Kolozsvári, Orsolya B.; Xu, Weiyong; Leppänen, Paavo H. T.; Hämäläinen, Jarmo A. (Frontiers Media, 2019)During speech perception, listeners rely on multimodal input and make use of both auditory and visual information. When presented with speech, for example syllables, the differences in brain responses to distinct stimuli ...
Dynamics of morphological processing in pre-school children with and without familial risk for dyslexia Louleli, Natalia; Hämäläinen, Jarmo A.; Nieminen, Lea; Parviainen, Tiina; Leppänen, Paavo H.T. (Elsevier, 2020)Difficulties in phonological processing and speech perception are associated with developmental dyslexia, but there is considerable diversity across people with developmental dyslexia (e.g., dyslexics with and without ...