摘要
本文首先从心理学的角度，分析了使用可听化的原因和优势：介绍了可听化系统的结构，讨论了参数化合成声音的原理和方法；分析了可听化处理过程中的关键技术。研究了非语音信号表述离散和连续信息的方法和使用可听化表述医学图象的可能性，建立了一个参数化声音发生平台，该平台提供频率、响度、均衡和时长4今参数控制维度。在该平台的基础上，对一维变量、简单二维变量和复杂二维变量等信息使用了多种不同的映射算法进行了试验。我们比较了这些结果，最后总结了一般的映射准则，希望通过使用听觉通道这种方式，使人对数据的本能或自发的感知。
In The paper, firstly, we analyzed the reason of somfication from psycholo gical viewpoint .Introduce the constitute of somficational system ,the key procession of sonification, the theory of parameter-controlled-synthesizing sound and it抯 princip le of applications of both discrete and sequential signal presentation.
Secondly ,on such theoretical base ,We design a parameters-controlled protot ypal sound generator .These parameters are frequency ,intensive, balance and duratio
n.
Finally, with such sound generator ,We investigate the ability of non-speech sound presenting the information which is discrete or sequential information. Speciall y we research the probability of sonification on medical image. Because of it's comp lexity ,various mapping algorithms are studied to fulfill the different information ma pping ,such information is grayscale ,grads and curvilinear-scale. We compared their differences and the results. Then summarized the principles of general mapping to ac hieve the goal that we can comprehend the datum instinctively with audition.
引文
[A.Darvishi 1994] A.Darvishi, E. Munteanu, V.Guggiana, H.Schauer :Automatic Impact Sound Generation For Using in Non-Visual Interfaces. The first annual ACM conference on assistive technologies(ASSETS'94) New York : pp100-106．
[Blattner, 1996] Blattner, M.M.; Glinert, E.P. Multimodal integration IEEE Multimedia Fall 1996 Volume: 3 3 , Page(s): 14-24
[Blattner, 1994] Merra M.Blattner , In our Image: InterFace Design in the 1990s IEEE Multimedia Spring 1994 Volume: 1 1, Page(s): 25-36
[Blattner 1989] M.M.Blatmer, D.A.Sumikawa,and R.M. Greenberg, "Earcons and Icons: Their Structure and Common Design Principles" Human Computer Interaction, Vol.4, No. 1,1989, pp. 11-44
[E.S.Yeung 1980] E.S.Yeung Pattern Recognition by Audio Representation of Multivariate Analytical Data . Analytical Chemistry 52(7) , 1980
[Foley 1990] Foley J.D.et al., Computer Graphics. Principles and Practice, Addison-Wesley, 1990
[Francioni 1992] Francioni, J.M.; Rover, D.T. Visual-aural representations of performance for a scalable application program Scalable High Performance Computing Conference, 1992． SHPCC-92, Proceedings. 1992 , Page(s): 433-440
[Gaver 1986] W.W.Gaver," Auditory Icons : Using Sound in Computer Interfaces,"Human-Computer Interaction, Vol.2, No.2 ,1986 ,pp. 167-177
[Glinert, 1996] Glinert, E.P; Blattner, M.M. Multimodal Interaction IEEE Multimedia Fall 1996 Volume: 3 3 , Page(s): 13-13
[Gregory 2000] Gregory Leplatre and Stephen A. Brewster : Designing Non-Speech Sounds to Support Navigation in Mobile Phone Menus, In Proceedings of ICAD2000 (Atlanta, USA), ICAD,pp 190-199．
[Greg Kramer 1996] Greg Kramer :Mapping a Single Data Stream to Multiple Auditory Variables: A Subjective Approach to Creating a Compelling Design. The Procedding of ICAD'96
[Jovanov,1999] Jovanov, E.; Wegner, K.; Radivojevic, V; Starcevic, D.; Quinn, M.S.; Karron, D.B. Tactical audio and acoustic rendering in biomedical applications Information Technology in Biomedicine, IEEE Transactions on June 1999 Volume: 3 2 , Page(s): 109-118
[Keller 1993] Keller,P.K.; Keller,M.M.; Visual Cues: Practical Data Visualization , IEEE CS Press, 1993
[Kramer, 1996] Greg Kramer, "Introduction: Transition " The Proceedings of ICAD'96
[Kramer 1996] Greg Kramer:,Mapping a Single Data Stream to Multiple Auditory Variables: A Subjective Approach to Creating a Compelling Design. The Procedding of ICAD'96
[Lehnert,1991] Lehnert, H.; Blauert, J. Virtual auditory environment Advanced Robotics, 1991． "Robots in Unstructured Environments', 91 ICAR., Fifth International Conference 1991,Page(s):211-216vol.l
[McCormick 1987] McCormick, B. H. DeFanti, T.A., Brown, M.D., Visualization in Scientific Computing, Computer Graphics, 21(6) , 1987
[Murphy 1996] R.R.Murphy, "Biological and cognitive foundations of intelligent data fusion," Systems, Man and Cybernetics, Part A, IEEE Transactions on Jan. 1996 Volume: 26 , Page(s): 42-51
[Murray 1998] Murray Crease & Stephen Brewster :Making Progress With Sounds-The Design & Evaluation of An Audio Progress Bar . In Proceedings of ICAD'98 (Glasgow, UK), British Computer Society
[Nicolay 1995] Nicolay Mirenkov Visualization and Sonification Method IEEE 1995 pp63-71
[Princeton 2001] : www.cs.princeton.edu/course/archieve/fall2001/cs436/audisply
[Riecken 1991] Riecken, R.D. Auditory adaptation Systems, Man, and Cybernetics, 1991． Decision Aiding for Complex Systems, Conference Proceedings., 1991 EEEE International Conference , Page(s): 1121-1126 vol.2
[Salvador 1998] Salvador, V.C.L.; Minghim, R.; Pacheco, M.L. Sonification to support visualization tasks Computer Graphics, Image Processing, and Vision, 1998． Proceedings. SIBGRAPI '98． 1998 , Page(s): 150-157
[Sharma, 1998] Rajeev Sharma, Vladimir I. Pavlovic and Thomas S.Huang Toward Multimodal Human-Computer Interface. Proceedings of the IEEE Published: May 1998 Volume: 86 5 , Page(s): 853-869
[Shi, J. Y. 1991 ]Shi,J,Y. ,On Integration of 3D Visual and Acoustical Rendering, Technical Report No.FAGD-91:06 of FhG-IGD in Darmstadt, 1991
[Stephen 2000] Stephen Brewster , Andrew Crossan and Murray Crease: Automatic Volume Control for Auditory Interface. In Volume Ⅱ Proceedings of BCS HCI2000 (Sunderland, UK), pp 17-18
[Stephen 1999] Stephen A. Brewster and Murray G Crease : Correcting Menu Usability Problems with Sound. Behavior and Information Technology 18(3) , 165-177
[Stephen 1998] Stephen A. Brewster :Using Non-Speech Sounds to Provide Navigation Cues ACM Transactions on Computer-Human Interaction, 5(2) , pp 224-259．
[Stephen 1997] Stephen A. Brewster . Using Non-Speech Sound to Overcome Information Overload Displays, Special issue on multimedia displays, 17, pp 179-189．
[Stephen 1996] Stephen A. Brewster. Veli-Pekka Raty & Atte Kortekangas: Enhancing Scanning Input With Non-Speech Sounds, Proceedings of ACM ASSETS'96 (Vancouver, Canada), ACM Press, pp 10-14
[Stephen 1995a]Stephen A. Brewster, Peter C. Wright, Alan J.Dix and Alistair D.N. Edwards: The Sonic Enhancement of Graphical Buttons In K. Nordby, P. Helmersen, D. Gilmore, & S. Amesen (Ed.), Proceedings of Interact'95, Lillehammer, Norway: Chapman & Hall, pp. 43-48．
[Stephen 1995b]Stephen A. Brewster , Peter C. Wright, Alistair D.N. Edwards:Parallel Earcons: Reducing the Length of Audio Messages International Journal of Human-Computer Studies, 43(2) , pp. 153-175
[Stephen 1994] Brewster, S.A., Wright, PC. & Edwards, A.D.N. (1994) . The design and evaluation of an auditory-enhanced scrollbar. In B. Adelson, S. Dumais, & J. Olson (Eds.), Proceedings of CHI'94, Boston, Massachusetts: ACM Press, Addison-Wesley, pp. 173-179．
[Stephen 1993] Stephen A. Brewster, Peter C. Wright, Alistair D.N. Edwards. An Evaluation of Ecacons for Use in Auditory Human-Computer Interfaces. Proceedings of InterCHI'93, Amsterdam: ACM Press, Addison-Wesley, pp. 222-227．
[Ulrike Axen 1996] Ulrike Axen, Insook Choi Investigating Geometric Data with
Sound In Proceedings of ICAD'96
[Wolf 1993] Wolf, R. S.; Yaeger, L., Visualization of Nature Phenomena, Springer-Verlag, 1993
[朱祖祥 1990] 朱祖祥主编 工程心理学 华东师范大学出版社 1990年
[朱祖祥 1994] 朱祖祥主编 人类工效学 浙江教育出版社 1994年。
[石教英 1996] 石教英 蔡立文 科学计算可视化算法与系统 科学出版社 1996年
[张爱东 1996] 张爱东 石教英 潘志庚 虚拟环境中真实感空间声合成 软件学报 1996年 1996，7(ADD)．pp120-126
[方志刚，1997] 方志刚 吴晓波 徐新民 金文光 非语音声音在人机交互技术中的应用 计算机科学 1997 vol．24 No．6 pp62-65
[陈建 1997] 陈健 孙兰凤 陆达 虚拟现实技术的现状与展望 天津纺织工学院学报 1998年第17卷第2期 pp91-96
[曾向阳 1998] 曾向阳 陈克安 厅常音质设计可听化技术 电声技术．1998，(7)．-5-9
[夏良正 1999] 夏良正主编 数字图象处理 东南大学出版社 1999年
[张琼 1999] 张琼 宋哲 石教英 可听化技术综述 计算机辅助设计与图形学学报 1999年3月第11卷 第2期 pp189-192
[罗福元 1999] 罗福元 王行仁，彭晓源 声音渲染技术及其在虚拟环境中的应用 系统仿真学报 1999年10月 第11卷第5期 pp364-367
[董士海 1999] 董士海，王坚，戴国忠，人机交互和多通道用户界面。科学出版社 1999年
[Bradley 1999] [美]Bradley Bargen PeterDonnelly著 希望图书创作室 译DirectX入门到精通(Inside DirectX)北京希望电脑公司 1999年
[高文 1999] 马继涌 高文 陈熙霖 多通道信息融合的改进乘积规则 电子学报 1999年 第8期vol27 pp1-4
[董士海 2000] 董士海，肖斌，汪国平．基于Internet的多通道用户界面．计算机学报．2000 23(12)：1270-1275．
[傅宇旭 2000] 傅宇旭编著 DirectX7.0高级编程 科学出版社 2000年
[阎建国 2000] 阎建国 高亮 卢京潮 图象处理技术在车牌识别中的应用 电子技术运用 2000，26(1)．-17-18
[普建涛 2001] 普建涛，秦镜，王霄楠，汪国平，董士海 多通道用户界面研究 计算机应用 2001年5月 第21卷 pp4-6