运用三维音效的多目标告警系统研究
|
摘要
近年来,随着计算机、多媒体、信息处理技术等的快速发展,视频与音频信息的应用都取得了长足的进步。除了可视信息外,充分地利用语音与丰富的音频表达信息一直是研究的热点课题。用3D音效模拟音源的位置与运动的技术,是物理运动学、物理声学、人的生理声学、心理声学等的研究成果与现代数字信号处理、多媒体等技术结合的结果,是一种虚拟实现技术。
三维音效模拟作为人-机-环境的多维信息交互技术,近些年来,已逐步应用到多媒体与虚拟现实系统中,进入到各种计算机游戏、科学研究,以及各种消费电子领域。多维信息交互能提高信息传递效率,将会是一个必然的发展方向。在国防应用中,很多国家的军队采用模拟器和真实装备结合训练士兵。
对飞机驾驶员的目标告警,可以通过模拟器可以虚拟听觉场景,为飞行员提供敌方目标的距离、运动特性、方位等信息,起到辅助导航与告警的作用,减轻了飞行员仅依靠视觉获取信息的压力。
本文以飞机驾驶员的目标告警作为潜在的应用背景,研究了音频定位的理论、HRTF(头部相关传递函数)技术及其实验数据库;分析了头相关传输函数HRTF或头相关脉冲响应HRIR的特性;探讨了多种基本音源信号应用效果。HRTF数据是因人而异的“个人数据",不同试验者的HRTF数据具有差异,如果将某个试验者的数据应用于其他试验者,HRTF定位效果将会下降,针对这种情况,还进行了HRTF的个性化的技术研究,获得了一些有益的改进措施。
为了多目标告警的模拟需要,讨论了多音频叠加的实施方法,提出了一种多目标的告警机制,以及合理、有效地融合多个目标的各种主要信息的合成方案;该方案可以充分利用3D音效技术特性,综合传递目标的主要特征信息。
最后,本论文基于CIPIC实验室测量的HRTF数据库,设计并搭建了多目标的3D音效告警实验系统。为了方便实验需要,系统还包括空中目标简单模拟单元,用于实时提供目标幅度、方位等参数,以及多目标信息汇集与分析单元。通过仿真实验与感知测试,验证了技术与提出方案的可行性。
With the rapid development of computer, multimedia and information processing technology, video and audio information applications are making great progress. Besides the visible information, speech and rich audio expression is the hot research topic for long. Simulation of audio location and movement with 3D effect is a virtual reality (VR) technique, which is based on the kinematics, acoustics, physiological and psychological acoustics, modern digital signal processing and multimedia technology.
As the interactive technology on multi-dimensional information for man-machine–environment, 3D audio effect is gradually applied in various multimedia systems and VR systems, which are found in the fields of computer games, scientific researches and entertainment. Interaction on multi-dimensional information increases the efficiency of the communication and will be a direction of future development. In defense application, many nations and armies train their soldiers with both simulator and real equipments. Simulation of audible scene could be used as an auxiliary measurement of navigation and alarming, instead of visible approach, which helps pilots on obtaining targets’distances, movements, locations and etc.
With the target alarming for pilots as the potential background of this thesis, audible location theory, HRTF (Head related transfer function) and its experiment database have been researched. Analysis on characteristics of HRTF and HRIR, exploration on the effects of multiple audio elements are carried out. With the nature of personal data, HRTF is different among peoples. When an unmatched data used as the HRTF, the location results will decrease. Research on this problem is also done and improvement is obtained.
For alarming of multiple targets, supposition of multi-sound is discussed in the thesis. An alarming scheme for multiple targets is also proposed to effectively integrate various information for using in the 3D sounds.
Finally, based on the CIPIC’s test HRTF database, an experimental 3D-sound alarming system for multiple targets is designed and installed. The system includes a simple target simulation unit to provide the amplitude, location and other target parameters, and a collection and analysis unit for multiple targets’parameters. Experiments and perceptive tests of the system verified the techniques and schemes proposed in the thesis.
三维音效模拟作为人-机-环境的多维信息交互技术,近些年来,已逐步应用到多媒体与虚拟现实系统中,进入到各种计算机游戏、科学研究,以及各种消费电子领域。多维信息交互能提高信息传递效率,将会是一个必然的发展方向。在国防应用中,很多国家的军队采用模拟器和真实装备结合训练士兵。
对飞机驾驶员的目标告警,可以通过模拟器可以虚拟听觉场景,为飞行员提供敌方目标的距离、运动特性、方位等信息,起到辅助导航与告警的作用,减轻了飞行员仅依靠视觉获取信息的压力。
本文以飞机驾驶员的目标告警作为潜在的应用背景,研究了音频定位的理论、HRTF(头部相关传递函数)技术及其实验数据库;分析了头相关传输函数HRTF或头相关脉冲响应HRIR的特性;探讨了多种基本音源信号应用效果。HRTF数据是因人而异的“个人数据",不同试验者的HRTF数据具有差异,如果将某个试验者的数据应用于其他试验者,HRTF定位效果将会下降,针对这种情况,还进行了HRTF的个性化的技术研究,获得了一些有益的改进措施。
为了多目标告警的模拟需要,讨论了多音频叠加的实施方法,提出了一种多目标的告警机制,以及合理、有效地融合多个目标的各种主要信息的合成方案;该方案可以充分利用3D音效技术特性,综合传递目标的主要特征信息。
最后,本论文基于CIPIC实验室测量的HRTF数据库,设计并搭建了多目标的3D音效告警实验系统。为了方便实验需要,系统还包括空中目标简单模拟单元,用于实时提供目标幅度、方位等参数,以及多目标信息汇集与分析单元。通过仿真实验与感知测试,验证了技术与提出方案的可行性。
With the rapid development of computer, multimedia and information processing technology, video and audio information applications are making great progress. Besides the visible information, speech and rich audio expression is the hot research topic for long. Simulation of audio location and movement with 3D effect is a virtual reality (VR) technique, which is based on the kinematics, acoustics, physiological and psychological acoustics, modern digital signal processing and multimedia technology.
As the interactive technology on multi-dimensional information for man-machine–environment, 3D audio effect is gradually applied in various multimedia systems and VR systems, which are found in the fields of computer games, scientific researches and entertainment. Interaction on multi-dimensional information increases the efficiency of the communication and will be a direction of future development. In defense application, many nations and armies train their soldiers with both simulator and real equipments. Simulation of audible scene could be used as an auxiliary measurement of navigation and alarming, instead of visible approach, which helps pilots on obtaining targets’distances, movements, locations and etc.
With the target alarming for pilots as the potential background of this thesis, audible location theory, HRTF (Head related transfer function) and its experiment database have been researched. Analysis on characteristics of HRTF and HRIR, exploration on the effects of multiple audio elements are carried out. With the nature of personal data, HRTF is different among peoples. When an unmatched data used as the HRTF, the location results will decrease. Research on this problem is also done and improvement is obtained.
For alarming of multiple targets, supposition of multi-sound is discussed in the thesis. An alarming scheme for multiple targets is also proposed to effectively integrate various information for using in the 3D sounds.
Finally, based on the CIPIC’s test HRTF database, an experimental 3D-sound alarming system for multiple targets is designed and installed. The system includes a simple target simulation unit to provide the amplitude, location and other target parameters, and a collection and analysis unit for multiple targets’parameters. Experiments and perceptive tests of the system verified the techniques and schemes proposed in the thesis.
引文
[1] 周锦荣,谢志文,谢菠荪.计算机虚拟立体声像软件的研究.电声技术,2001,1:3-5
[2] 罗福元,王行仁。声音渲染技术及其在虚拟环境中的应用.系统仿真学报,11(5):364-367,1999
[3] 刘光明,刘夕,窦维蓓.对虚拟环绕声产生的研究与简单实现.电声技术,2003,4:43-47
[4] 谢菠荪,管善群.虚拟声技术及其应用(上).应用声学,2004,2:43-47
[5] 王炳锡编著.语音编码.西安:西安电子科技大学出版社,2002,18-23
[6] Keith Dana Martin. A Computational Model of Spatial Hearing, Department of Electrical Engineering and Computer Science. 1995,Mar 18: 9-13
[7] 赵自力,黄成伟. HRTF 在虚拟 3D 立体声中的应用及实验.自然科学版,2001,41(11):74-76
[8] 刘新华,李方敏,旷海兰等.基于数字语音教室的多路混音算法及应用.微计算机信息,2005,21(10):34-36
[9] 梁军. 3D 运动声源仿真原理.电声技术,2000,4:8-9
[10] S. Carlile, The physical basis and psychophysical basis of sound localization, in Virtual Auditory space: Generation and Applications, 1996
[11] Michael A. Blommer, Gregory H. Wakefiele. Pole-Zero Approximations for Head-Related Transfer Functions Using a Logarithmic Error Criterion, IEEE Transactions on Speech and Audio Processing. 1997
[12] Huopaniemi J, Zacharov N. Objective And Subjective Evaluation of Head-related Function Filter Design, J. Audio. Eng. soc, 1999.47(4):218-239
[13] 钟小丽,谢波荪.头相关传输函数的研究进展(二).电声技术,2005,01:42-45
[14] Gardner W G, K. D. Matin, HRTF Measurements of A KEMAR. J.Acoust. Soc.Am, 1995,97(6): 3907-3908
[15] Malcolm Slaney, Michele Covell, Bud Lassiter, Automatic Audio Morphing, Speech and Signal Processing, 1996,May 7-10
[16] 谢菠荪 虚拟声技术及其应用(上) 电声技术 2004/04
[17] 程启东 虚拟现实技术与虚拟座舱 电光与控制 1994/04
[18] 任东 有广阔发展前景的虚拟现实技术 科技信息 1994/01
[19] V. R. Algazi, R. O. Duda, D.M.Thomapson, The CIPIC HRTF Database, IEEE Workshop on Application of Signal Processing to Audio and Acoustics. 2001, October 21-24
[20] Takanori Nishino, Shoji Kajita, Kazuya Takeda, et al. Interpolation Head Related Transfer Function in the Median Plane, IEEE Workshop on Application of Signal Processing to Audio and Acoustics. 1999,October 17-20
[2] 罗福元,王行仁。声音渲染技术及其在虚拟环境中的应用.系统仿真学报,11(5):364-367,1999
[3] 刘光明,刘夕,窦维蓓.对虚拟环绕声产生的研究与简单实现.电声技术,2003,4:43-47
[4] 谢菠荪,管善群.虚拟声技术及其应用(上).应用声学,2004,2:43-47
[5] 王炳锡编著.语音编码.西安:西安电子科技大学出版社,2002,18-23
[6] Keith Dana Martin. A Computational Model of Spatial Hearing, Department of Electrical Engineering and Computer Science. 1995,Mar 18: 9-13
[7] 赵自力,黄成伟. HRTF 在虚拟 3D 立体声中的应用及实验.自然科学版,2001,41(11):74-76
[8] 刘新华,李方敏,旷海兰等.基于数字语音教室的多路混音算法及应用.微计算机信息,2005,21(10):34-36
[9] 梁军. 3D 运动声源仿真原理.电声技术,2000,4:8-9
[10] S. Carlile, The physical basis and psychophysical basis of sound localization, in Virtual Auditory space: Generation and Applications, 1996
[11] Michael A. Blommer, Gregory H. Wakefiele. Pole-Zero Approximations for Head-Related Transfer Functions Using a Logarithmic Error Criterion, IEEE Transactions on Speech and Audio Processing. 1997
[12] Huopaniemi J, Zacharov N. Objective And Subjective Evaluation of Head-related Function Filter Design, J. Audio. Eng. soc, 1999.47(4):218-239
[13] 钟小丽,谢波荪.头相关传输函数的研究进展(二).电声技术,2005,01:42-45
[14] Gardner W G, K. D. Matin, HRTF Measurements of A KEMAR. J.Acoust. Soc.Am, 1995,97(6): 3907-3908
[15] Malcolm Slaney, Michele Covell, Bud Lassiter, Automatic Audio Morphing, Speech and Signal Processing, 1996,May 7-10
[16] 谢菠荪 虚拟声技术及其应用(上) 电声技术 2004/04
[17] 程启东 虚拟现实技术与虚拟座舱 电光与控制 1994/04
[18] 任东 有广阔发展前景的虚拟现实技术 科技信息 1994/01
[19] V. R. Algazi, R. O. Duda, D.M.Thomapson, The CIPIC HRTF Database, IEEE Workshop on Application of Signal Processing to Audio and Acoustics. 2001, October 21-24
[20] Takanori Nishino, Shoji Kajita, Kazuya Takeda, et al. Interpolation Head Related Transfer Function in the Median Plane, IEEE Workshop on Application of Signal Processing to Audio and Acoustics. 1999,October 17-20