Detection of auditory (cross-spectral) and auditory??????visual (cross-modal) synchrony
详细信息 查看全文
- 作者：Grant ; Ken W. ; Wassenhove ; Virginie van ; Poeppel ; David
- 关键词：Spectro-temporal asynchrony ; Cross-modal asynchrony ; auditory??????visual speech processing
- 刊名：Speech Communication
- 出版年：2004
- 出版时间：October, 2004
- 年：2004
- 卷：44
- 期：1-4
- 页码：43-53
- 全文大小：365 K
文摘
Detection thresholds for temporal synchrony in auditory and auditoryaaavisual sentence materials were obtained on normal-hearing subjects. For auditory conditions, thresholds were determined using an adaptive-tracking procedure to control the degree of temporal asynchrony of a narrow audio band of speech, both positive and negative in separate tracks, relative to three other narrow audio bands of speech. For auditoryaaavisual conditions, thresholds were determined in a similar manner for each of four narrow audio bands of speech as well as a broadband speech condition, relative to a video image of a female speaker. Four different auditory filter conditions, as well as a broadband auditoryaaavisual speech condition, were evaluated in order to determine whether detection thresholds were dependent on the spectral content of the acoustic speech signal. Consistent with previous studies of auditoryaaavisual speech recognition which showed a broad, asymmetrical range of temporal synchrony for which intelligibility was basically unaffected (audio delays roughly between aaa40ms and +240ms), auditoryaaavisual synchrony detection thresholds also showed a broad, asymmetrical pattern of similar magnitude (audio delays roughly between aaa45ms and +200ms). No differences in synchrony thresholds were observed for the different filtered bands of speech, or for broadband speech. In contrast, detection thresholds for audio-alone conditions were much smaller (between aaa17ms and +23ms) and symmetrical. These results suggest a fairly tight coupling between a subjectaaas ability to detect cross-spectral (auditory) and cross-modal (auditoryaaavisual) asynchrony and the intelligibility of auditory and auditoryaaavisual speech materials.