The McGurk effect: An investigation of attentional capacity employing response times

详细信息    查看全文

• 作者：Nicholas Altieri ; Jennifer J. Lentz…
• 刊名：Attention, Perception, & Psychophysics
• 出版年：2016
• 出版时间：August 2016
• 年：2016
• 卷：78
• 期：6
• 页码：1712-1727
• 全文大小：883 KB
• 刊物主题：Cognitive Psychology;
• 出版者：Springer US
• ISSN：1943-393X
• 卷排序：78

文摘

This paper proposes a novel approach to assess audiovisual integration for both congruent and incongruent speech stimuli using reaction times (RT). The experiments are based on the McGurk effect, in which a listener is presented with incongruent audiovisual speech signals. A typical example involves the auditory consonant/b/combined with a visually articulated/g/, often yielding a perception of/d/. We quantify the amount of integration relative to the predictions of a parallel independent model as a function of attention and congruency between auditory and visual signals. We assessed RT distributions for congruent and incongruent auditory and visual signals in a within-subjects signal detection paradigm under conditions of divided versus focused attention. Results showed that listeners often received only minimal benefit from congruent auditory visual stimuli, even when such information could have improved performance. Incongruent stimuli adversely affected performance in divided and focused attention conditions. Our findings support a parallel model of auditory-visual integration with interactions between auditory and visual channels.KeywordsSpeech perceptionAttention: SelectiveReaction time methods