Temporal window of integration in auditory-visual speech perception

详细信息    查看全文

• 作者：Virginie van Wassenhove ; Ken W. Grant ; David Poeppel
• 关键词：McGurk illusion ; Multisensory ; Time ; Psychophysics ; Analysis-by-synthesis
• 刊名：Neuropsychologia
• 出版年：2007
• 出版时间：2007
• 年：2007
• 卷：45
• 期：3
• 页码：598-607
• 全文大小：612 K

文摘

Forty-three normal hearing participants were tested in two experiments, which focused on temporal coincidence in auditory visual (AV) speech perception. In these experiments, audio recordings of/pa/and/ba/were dubbed onto video recordings of /ba/or/ga/, respectively (A_pV_k, A_bV_g), to produce the illusory “fusion” percepts /ta/, or /da/ [McGurk, H., & McDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746–747]. In Experiment 1, an identification task using McGurk pairs with asynchronies ranging from −467 ms (auditory lead) to +467 ms was conducted. Fusion responses were prevalent over temporal asynchronies from −30 ms to +170 ms and more robust for audio lags. In Experiment 2, simultaneity judgments for incongruent and congruent audiovisual tokens (A_dV_d, A_tV_t) were collected. McGurk pairs were more readily judged as asynchronous than congruent pairs. Characteristics of the temporal window over which simultaneity and fusion responses were maximal were quite similar, suggesting the existence of a 200 ms duration asymmetric bimodal temporal integration window.