Accumulation and decay of visual capture and the ventriloquism aftereffect caused by brief audio-visual disparities

详细信息    查看全文

• 作者：Adam K. Bosen ; Justin T. Fleming ; Paul D. Allen…
• 关键词：Visual capture ; Ventriloquism ; Ventriloquism aftereffect ; Auditory ; Visual ; Cross ; modal
• 刊名：Experimental Brain Research
• 出版年：2017
• 出版时间：February 2017
• 年：2017
• 卷：235
• 期：2
• 页码：585-595
• 全文大小：
• 刊物类别：Biomedical and Life Sciences
• 刊物主题：Neurosciences; Neurology;
• 出版者：Springer Berlin Heidelberg
• ISSN：1432-1106
• 卷排序：235

文摘

Visual capture and the ventriloquism aftereffect resolve spatial disparities of incongruent auditory visual (AV) objects by shifting auditory spatial perception to align with vision. Here, we demonstrated the distinct temporal characteristics of visual capture and the ventriloquism aftereffect in response to brief AV disparities. In a set of experiments, subjects localized either the auditory component of AV targets (A within AV) or a second sound presented at varying delays (1–20 s) after AV exposure (A2 after AV). AV targets were trains of brief presentations (1 or 20), covering a ±30° azimuthal range, and with ±8° (R or L) disparity. We found that the magnitude of visual capture generally reached its peak within a single AV pair and did not dissipate with time, while the ventriloquism aftereffect accumulated with repetitions of AV pairs and dissipated with time. Additionally, the magnitude of the auditory shift induced by each phenomenon was uncorrelated across listeners and visual capture was unaffected by subsequent auditory targets, indicating that visual capture and the ventriloquism aftereffect are separate mechanisms with distinct effects on auditory spatial perception. Our results indicate that visual capture is a ‘sample-and-hold’ process that binds related objects and stores the combined percept in memory, whereas the ventriloquism aftereffect is a ‘leaky integrator’ process that accumulates with experience and decays with time to compensate for cross-modal disparities.