Auditory navigation with a tubular acoustic model for interactive distance cues and personalized head-related transfer functions

详细信息    查看全文

• 作者：Michele Geronazzo ; Federico Avanzini…
• 刊名：Journal on Multimodal User Interfaces
• 出版年：2016
• 出版时间：September 2016
• 年：2016
• 卷：10
• 期：3
• 页码：273-284
• 全文大小：1,965 KB
• 刊物类别：Computer Science
• 刊物主题：User Interfaces and Human Computer Interaction
  Signal,Image and Speech Processing
  Image Processing and Computer Vision
  Communications Engineering and Networks
  Computer Imaging, Vision, Pattern Recognition and Graphics
  
• 出版者：Springer Berlin Heidelberg
• ISSN：1783-8738
• 卷排序：10

文摘

This paper presents a novel spatial auditory display that combines a virtual environment based on a Digital Waveguide Mesh (DWM) model of a small tubular shape with a binaural rendering system with personalized head-related transfer functions (HRTFs) allowing interactive selection of absolute 3D spatial cues of direction as well as egocentric distance. The tube metaphor in particular minimizes loudness changes with distance, providing mainly direct-to-reverberant and spectral cues. The proposed display was assessed through a target-reaching task where participants explore a 2D virtual map with a pen tablet and hit a sound source (the target) using auditory information only; subjective time to hit and traveled distance were analyzed for three experiments. The first one aimed at assessing the proposed HRTF selection method for personalization and dimensionality of the reaching task, with particular attention to elevation perception; we showed that most subjects performed better when they had to reach a vertically unbounded (2D) rather then an elevated (3D) target. The second experiment analyzed interaction between the tube metaphor and HRTF showing a dominant effect of DWM model over binaural rendering. In the last experiment, participants using absolute distance cues from the tube model performed comparably well to when they could rely on more robust, although relative, intensity cues. These results suggest that participants made proficient use of both binaural and reverberation cues during the task, displayed as part of a coherent 3D sound model, in spite of the known complexity of use of both such cues. HRTF personalization was beneficial for participants who were able to perceive vertical dimension of a virtual sound. Further work is needed to add full physical consistency to the proposed auditory display.KeywordsHead-related transfer functionAuditory distance renderingDigital waveguide meshPerceptual model individualizationTarget-reaching taskHuman spatial navigationAuditory display