虚拟环绕声技术研究与系统实现
摘要
标准的环绕声系统需要使用多个扬声器进行声音重放,同时对扬声器的质量也有较好的要求,大多数的普通消费者无法承担高品质扬声器的价格。而虚拟环绕声技术可以很好的解决这一问题,该技术利用头部相关传递函数HRTF(Head-Related Transfer Function)对声音数据进行数字信号处理,通过耳机或者两个扬声器重放放出来,能够让人感觉到环绕声的效果,使听着感觉声音来自某个特定的方向或者被声音环绕。
本论文首先介绍了虚拟环绕声技术的发展以及国内外研究现状,在此基础上分析了虚拟听觉空间相关的理论知识,其中包括影响声源定位的因素与头部相关传递函数。接下来,论文介绍了HRTF数据的获取方法及数据测量概述,并结合多个公开的数据库对HRTF数据进行了特性分析。在第四章中,论文详细阐述了一种基于耳机重放的三维虚拟环绕声系统设计方法,该方法在三维空间中对声音数据进行处理。第五章主要介绍了虚拟环绕声系统在Android手机平台上的实现,其中包括Android系统框架以及音频处理流程的分析,系统实现的软件处理流程与提高实时性处理的措施,并且对系统进行了主观的音频测试,测试结果表明,最终实现的系统具有很好的虚拟环绕声效果。
Standard surround sound system requires multiple speakers for the playback, while the speakers are always of high quality and the majority of ordinary consumers cannot afford the price of the high-quality speakers.But virtual surround sound system can be a good solution to this problem,this technology does some digital signal processing of sound data by using head-related transfer function(HRTF), people can feel the virtual surround sound effect or will locate the sound source from a particular direction when the sound is played with headphones or two speakers.
This paper first introduces the development of virtual surround sound technology, research actuality. Based on that, this paper analyzes the related theoretical knowledge of virtual sound space, including the elements that matters to locate sound source correctly and head-related transfer function. In the next part, this paper focuses on the method of how we can get the HRTF data and the introduction theory of measuring HRTF, and analyzes the characteristics of HRTF data set by using several public HRTF databases.The fourth chapter elaborates the details of the implementation of virtual surround sound system in three-dementional space based on headphone playbacks.This implementation focuses on three-dimentional space to do the sound data processing.The fifth chaper mainly introduces the implementation of virtual surround sound on Android platform, including the analysis of Android frameworks and audio processing flow, the software processing flow and the methods that accelerate the speed of real-time processing. This paper also completes the subjective tests on audio effects of the system. The test result shows that the implemented system can obtain good virtual surround sound effect.
本论文首先介绍了虚拟环绕声技术的发展以及国内外研究现状,在此基础上分析了虚拟听觉空间相关的理论知识,其中包括影响声源定位的因素与头部相关传递函数。接下来,论文介绍了HRTF数据的获取方法及数据测量概述,并结合多个公开的数据库对HRTF数据进行了特性分析。在第四章中,论文详细阐述了一种基于耳机重放的三维虚拟环绕声系统设计方法,该方法在三维空间中对声音数据进行处理。第五章主要介绍了虚拟环绕声系统在Android手机平台上的实现,其中包括Android系统框架以及音频处理流程的分析,系统实现的软件处理流程与提高实时性处理的措施,并且对系统进行了主观的音频测试,测试结果表明,最终实现的系统具有很好的虚拟环绕声效果。
Standard surround sound system requires multiple speakers for the playback, while the speakers are always of high quality and the majority of ordinary consumers cannot afford the price of the high-quality speakers.But virtual surround sound system can be a good solution to this problem,this technology does some digital signal processing of sound data by using head-related transfer function(HRTF), people can feel the virtual surround sound effect or will locate the sound source from a particular direction when the sound is played with headphones or two speakers.
This paper first introduces the development of virtual surround sound technology, research actuality. Based on that, this paper analyzes the related theoretical knowledge of virtual sound space, including the elements that matters to locate sound source correctly and head-related transfer function. In the next part, this paper focuses on the method of how we can get the HRTF data and the introduction theory of measuring HRTF, and analyzes the characteristics of HRTF data set by using several public HRTF databases.The fourth chapter elaborates the details of the implementation of virtual surround sound system in three-dementional space based on headphone playbacks.This implementation focuses on three-dimentional space to do the sound data processing.The fifth chaper mainly introduces the implementation of virtual surround sound on Android platform, including the analysis of Android frameworks and audio processing flow, the software processing flow and the methods that accelerate the speed of real-time processing. This paper also completes the subjective tests on audio effects of the system. The test result shows that the implemented system can obtain good virtual surround sound effect.
引文
[1]洪炳熔,蔡则苏.虚拟现实及其应用[M].北京：国防工业出版社,2005.
[2]唐芸.空间听觉模型中的HRIR基向量提取方法研究[学位论文].东南大学,2005.
[3]BEGAULT D R.3D Sound for Virtual Reality and Multimedia[M]. London:Academic Press,1994.
[4]Begault D. R, Erbe T. Multichannel spatial auditory display for speech communications[J]. Audio Eng. Soc.,1994,42(10),820-825.
[5]Ken'iti Kido. Acousitics and Information Science[C]. Proceeding of WESTPRAC VII, Japan,2000,3-12.
[6]王生九.虚拟听觉空间和虚拟环绕声技术的研究及其DSP实现[学位论文].东南大学,2006.
[7]马浩.基于空间听觉的声源定位和三维声再现技术研究[学位论文].东南大学,2008.
[8]谢菠荪.头相关传输函数与虚拟听觉重放[J].中国科学：G辑.2009,39(9),1268-1285.
[9]Gardner W G, Martin K D. HRTF measurements of a KEMAR[J]. Acoust Soc Am,1995,97(6),3907-3908.
[10]吴杰.基于中国人工头模的HRTF数据库设计与实现[J].计算机与现代化.2011,(12),92-96.
[11]谢菠荪,钟小丽,饶丹.头相关传输函数数据库及其特性分析[J].中国科学：G辑.2006,36(5),464-479.
[12]董政武SRS-3D技术和SRS5250解析[J].电声技术.1997,(10),20-25.
[13]罗颖.浅析虚拟扬声器技术[J].演艺科技.2011,(8),16-19.
[14]黄采伦.AV系统音频数字化虚拟设计[J].音响技术.1994,(4),45-47.
[15]张超鹏.双声道三维虚拟声系统的研究与实现[学位论文].东南大学,2009.
[16]卢海涛.基于小波神经网络的HRTF非线性函数逼近的研究[学位论文].燕山大学,2005.
[17]彭建新.可视化技术在室内音质设计中的应用[J].电声技术.2000,(5),18-20.
[18]谢菠荪.头相关传递函数与虚拟听觉[M].北京：国防工业出版社,2008.
[19]职新卫.虚拟环绕声技术分析与仿真实现[学位论文].东南大学,2009.
[20]Wikipedia. Interaural time difference[EB/OL]. http://en.wikipedia.org/wiki/Interaural_time_difference#cite_note-0.
[21]陆静艳.虚拟3D声音技术研究和基于DSP技术的实时系统实现[学位论文].华东师范大学,2007.
[22]叶蓉.数字电视音频后处理的研究与实现[学位论文].天津大学,2008.
[23]Blauert J. Spatial Hearing, The Psychophysics of Human Sound Localization[M]. MA:MIT Press,1997.
[24]赵蕊.听觉传输型音频定位系统研究[学位论文].电子科技大学,2006.
[25]曾芬芳.虚拟现实技术[M].上海：上海交通大学出版社,1997.
[26]张璐.用HRTF实现3D声场报警系统的研究[学位论文].电子科技大学,2007.
[27]Sang Jin Cho, Alexander Ovcharenko, Ui-Pil Chong. Front-Back Confusion Resolution in 3D Sound Localization with HRTF Databases. Strategic Technology, The 1st International Forum on.2006,239-243.
[28]齐娜.中国成年人耳廓形态测量及分类[J].声学技术.2010,29(5),518-522.
[29]Wallach, H. The role of head movements and vestibular and visual cues in sound localization[J]. Journal of Experimental Psychology.1940,27(4), 339-368.
[30]Durand R. Begault.3-D Sound for Virtual Reality and Multimedia[M]. San Diego, CA:Academic Press Professional, Inc,2000.
[31]Wright D, Hebrank JH, Wilson B. Pinna reflections as cue localization[J]. Acoust. Soc. Am.1974,56(3),957-962.
[32]Algazi VR, Avendano C, Duda RO. Elevation localization and head-related transfer function analysis at low frequencies[J]. Acoust. Soc. Am.2001,109(3),1110-1122.
[33]谢菠荪.头相关传输函数相位特性及双耳时间差的意义[J].电声技术.2006,(11),40-45.
[34]杨飞然.基于HRTF的虚拟声源定位系统研究以及ARM平台实现[学位论文].东南大学,2008.
[35]谢菠荪.头相关传递函数与虚拟听觉重放[J].中国科学：G辑.2009,39(9),1268-1285.
[36]Mengqiu Zhang, Wen Zhang, Rodney A. Kennedy. HRTF measurement on KEMAR manikin. Proceedings of ACOUSTICS 2009 23-25 November 2009, Adelaide.
[37]Bill Gardner, Keith Martin. HRTF Measurement of a KEMAR Dummy-Head Microphone. Technical Report #280. MIT,1994.
[38]张杰.虚拟听觉空间实现中与头相关传递函数的特征分析和高效建模[学位论文].东南大学,2006.
[39]VR Algazi, RO Duda, DP Thompson, C Avendano. The CIPIC HRTF database[C]. Proceedings of 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics.
[40]谭红艳.外耳参数对HRTF的影响研究及虚拟听觉空间的仿真[学位论文].东南大学,2005.
[41]Wikipedia. Android(operation System)[EB/OL]. http://en.wikipedia.org/wiki/Android_(operating_system).
[42]单李旺.Android操作平台的研究与应用[学位论文].南开大学,2009.
[43]陈昱.基于Google Android平台的移动开发研究[J].福建电脑.2008,(11),156-157.
[44]栗学丽.“数字信号处理”中分段卷积的教学探讨[J].电气电子教学学报.2011,33(2),102-104.
[45]谢菠荪.环绕声的设计思路与音质评价问题[J].电声技术.1999,(8),12-15.
[2]唐芸.空间听觉模型中的HRIR基向量提取方法研究[学位论文].东南大学,2005.
[3]BEGAULT D R.3D Sound for Virtual Reality and Multimedia[M]. London:Academic Press,1994.
[4]Begault D. R, Erbe T. Multichannel spatial auditory display for speech communications[J]. Audio Eng. Soc.,1994,42(10),820-825.
[5]Ken'iti Kido. Acousitics and Information Science[C]. Proceeding of WESTPRAC VII, Japan,2000,3-12.
[6]王生九.虚拟听觉空间和虚拟环绕声技术的研究及其DSP实现[学位论文].东南大学,2006.
[7]马浩.基于空间听觉的声源定位和三维声再现技术研究[学位论文].东南大学,2008.
[8]谢菠荪.头相关传输函数与虚拟听觉重放[J].中国科学：G辑.2009,39(9),1268-1285.
[9]Gardner W G, Martin K D. HRTF measurements of a KEMAR[J]. Acoust Soc Am,1995,97(6),3907-3908.
[10]吴杰.基于中国人工头模的HRTF数据库设计与实现[J].计算机与现代化.2011,(12),92-96.
[11]谢菠荪,钟小丽,饶丹.头相关传输函数数据库及其特性分析[J].中国科学：G辑.2006,36(5),464-479.
[12]董政武SRS-3D技术和SRS5250解析[J].电声技术.1997,(10),20-25.
[13]罗颖.浅析虚拟扬声器技术[J].演艺科技.2011,(8),16-19.
[14]黄采伦.AV系统音频数字化虚拟设计[J].音响技术.1994,(4),45-47.
[15]张超鹏.双声道三维虚拟声系统的研究与实现[学位论文].东南大学,2009.
[16]卢海涛.基于小波神经网络的HRTF非线性函数逼近的研究[学位论文].燕山大学,2005.
[17]彭建新.可视化技术在室内音质设计中的应用[J].电声技术.2000,(5),18-20.
[18]谢菠荪.头相关传递函数与虚拟听觉[M].北京：国防工业出版社,2008.
[19]职新卫.虚拟环绕声技术分析与仿真实现[学位论文].东南大学,2009.
[20]Wikipedia. Interaural time difference[EB/OL]. http://en.wikipedia.org/wiki/Interaural_time_difference#cite_note-0.
[21]陆静艳.虚拟3D声音技术研究和基于DSP技术的实时系统实现[学位论文].华东师范大学,2007.
[22]叶蓉.数字电视音频后处理的研究与实现[学位论文].天津大学,2008.
[23]Blauert J. Spatial Hearing, The Psychophysics of Human Sound Localization[M]. MA:MIT Press,1997.
[24]赵蕊.听觉传输型音频定位系统研究[学位论文].电子科技大学,2006.
[25]曾芬芳.虚拟现实技术[M].上海：上海交通大学出版社,1997.
[26]张璐.用HRTF实现3D声场报警系统的研究[学位论文].电子科技大学,2007.
[27]Sang Jin Cho, Alexander Ovcharenko, Ui-Pil Chong. Front-Back Confusion Resolution in 3D Sound Localization with HRTF Databases. Strategic Technology, The 1st International Forum on.2006,239-243.
[28]齐娜.中国成年人耳廓形态测量及分类[J].声学技术.2010,29(5),518-522.
[29]Wallach, H. The role of head movements and vestibular and visual cues in sound localization[J]. Journal of Experimental Psychology.1940,27(4), 339-368.
[30]Durand R. Begault.3-D Sound for Virtual Reality and Multimedia[M]. San Diego, CA:Academic Press Professional, Inc,2000.
[31]Wright D, Hebrank JH, Wilson B. Pinna reflections as cue localization[J]. Acoust. Soc. Am.1974,56(3),957-962.
[32]Algazi VR, Avendano C, Duda RO. Elevation localization and head-related transfer function analysis at low frequencies[J]. Acoust. Soc. Am.2001,109(3),1110-1122.
[33]谢菠荪.头相关传输函数相位特性及双耳时间差的意义[J].电声技术.2006,(11),40-45.
[34]杨飞然.基于HRTF的虚拟声源定位系统研究以及ARM平台实现[学位论文].东南大学,2008.
[35]谢菠荪.头相关传递函数与虚拟听觉重放[J].中国科学：G辑.2009,39(9),1268-1285.
[36]Mengqiu Zhang, Wen Zhang, Rodney A. Kennedy. HRTF measurement on KEMAR manikin. Proceedings of ACOUSTICS 2009 23-25 November 2009, Adelaide.
[37]Bill Gardner, Keith Martin. HRTF Measurement of a KEMAR Dummy-Head Microphone. Technical Report #280. MIT,1994.
[38]张杰.虚拟听觉空间实现中与头相关传递函数的特征分析和高效建模[学位论文].东南大学,2006.
[39]VR Algazi, RO Duda, DP Thompson, C Avendano. The CIPIC HRTF database[C]. Proceedings of 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics.
[40]谭红艳.外耳参数对HRTF的影响研究及虚拟听觉空间的仿真[学位论文].东南大学,2005.
[41]Wikipedia. Android(operation System)[EB/OL]. http://en.wikipedia.org/wiki/Android_(operating_system).
[42]单李旺.Android操作平台的研究与应用[学位论文].南开大学,2009.
[43]陈昱.基于Google Android平台的移动开发研究[J].福建电脑.2008,(11),156-157.
[44]栗学丽.“数字信号处理”中分段卷积的教学探讨[J].电气电子教学学报.2011,33(2),102-104.
[45]谢菠荪.环绕声的设计思路与音质评价问题[J].电声技术.1999,(8),12-15.