Hearing words helps seeing words: A cross-modal word repetition effect

详细信息    查看全文

• 作者：Patrick van der Zande^a ; ^{P.Zande@gmail.com" class="auth_mail} ; Alexandra Jesse^b ; ^{AJesse@psych.umass.edu" class="auth_mail} ; Anne Cutler^c ; ^a ; ^{A.Cutler@uws.edu.au" class="auth_mail}
• 关键词：Speech perception ; Audiovisual speech ; Word repetition priming ; Cross-modal priming
• 刊名：Speech Communication
• 出版年：April, 2014
• 年：2014
• 卷：59
• 期：Complete
• 页码：31-43
• 全文大小：392 K

文摘

Watching a speaker say words benefits subsequent auditory recognition of the same words. In this study, we tested whether hearing words also facilitates subsequent phonological processing from visual speech, and if so, whether speaker repetition influences the magnitude of this word repetition priming. We used long-term cross-modal repetition priming as a means to investigate the underlying lexical representations involved in listening to and seeing speech. In Experiment 1, listeners identified auditory-only words during exposure and visual-only words at test. Words at test were repeated or new and produced by the exposure speaker or a novel speaker. Results showed a significant effect of cross-modal word repetition priming but this was unaffected by speaker changes. Experiment 2 added an explicit recognition task at test. Listeners鈥?lipreading performance was again improved by prior exposure to auditory words. Explicit recognition memory was poor, and neither word repetition nor speaker repetition improved it. This suggests that cross-modal repetition priming is neither mediated by explicit memory nor improved by speaker information. Our results suggest that phonological representations in the lexicon are shared across auditory and visual processing, and that speaker information is not transferred across modalities at the lexical level.