학술논문

Auditory Dominance in Processing Chinese Semantic Abnormalities in Response to Competing Audio-visual Stimuli.
Document Type
Article
Source
Neuroscience. Oct2022, Vol. 502, p1-9. 9p.
Subject
*AUDITORY perception
*CHINESE language
*SPEECH
*WRITTEN communication
*ORAL communication
Language
ISSN
0306-4522
Abstract
• A new character-speech materials is proposed to study the audio-visual competition. • Validating Mandarin has a modality advantages in processing audio-visual information. • Clarifying the dominance of auditory processing in Chinese audio-visual competition. Language is a remarkable cognitive ability that can be expressed through visual (written language) or auditory (spoken language) modalities. When visual characters and auditory speech convey conflicting information, individuals may selectively attend to either one of them. However, the dominant modality in such a competing situation and the neural mechanism underlying it are still unclear. Here, we presented participants with Chinese sentences in which the visual characters and auditory speech convey conflicting information, while behavioral and electroencephalographic (EEG) responses were recorded. Results showed a prominent auditory dominance when audio-visual competition occurred. Specifically, higher accuracy (ACC), larger N400 amplitudes and more linkages in the posterior occipital-parietal areas were demonstrated in the auditory mismatch condition compared to that in the visual mismatch condition. Our research illustrates the superiority of the auditory speech over the visual characters, extending our understanding of the neural mechanisms of audio-visual competition in Chinese. [ABSTRACT FROM AUTHOR]