基于超声波和视觉信息融合的语音提示技术研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
随着世界盲人数量的不断增加和盲人群体受关注程度的不断提高,各种助盲设备也应运而生。而电子行走辅助系统凭借其携带方便,结构简单,易使用的优势,正日益成为助盲技术研究的主流。
     传统的助盲系统传达给盲人的信息只有障碍物的方位和位置信息,而无法将障碍物的具体特征告知盲人形成视觉重现。针对这一缺陷,本文构建了基于超声波和视觉信息融合的语音提示系统,充分利用盲人的先验知识,很好的实现了外界环境障碍物信息的实时再现。
     在图像识别方面,为了克服在外界环境变化时单一图像特征有可能失效的缺陷,采用超声波和视觉信息相融合的方法来进行图像识别。运用超声波阵列探测,根据最小距离判定法则,判断出最近障碍物的方位。从而驱动摄像头旋转一定角度拍摄图像,滤波后,提取出图像的颜色和形状特征。根据不同物体的颜色、形状特征对于不同物体的敏感程度不同,先用支持向量机对提取出来的单一特征进行分类识别,得出特征权重计算因子,从而定义特征权重计算方法。引入到K近邻分类器距离函数中,将颜色、形状特征融合起来,结合图像数据库,能够很好的实现物体识别。
     在语音提示方面,事先将要播放的语音内容分段录制在语音芯片中,并由LCD显示单元读出分段内容所处的地址。上位机将图像识别的结果传输给语音提示电路中的单片机,通过触发不同的语音地址,从而实现语音的连续播放。单片机中的程序在KEIL C软件中编写并调试,并通过运行STC_ISP软件将程序下载到单片机中。完成下载后,单片机自动运行程序。
     在上述研究基础上搭建语音提示系统平台,并就图像的声音提示效果进行了测试和评估。实验证明,在盲人有先验知识的前提下,该语音提示系统能很好的帮助盲人实现视觉再现。
With the increasing number of the world’s blind and more attention to them, a variety ofdevices came into being to help the blind. Electronic travel aid system, with its easy to carry,simple structure, easy to use advantages, is increasingly becoming the mainstream technology tohelp the blind.
     The traditional system to help the blind to convey to the blind only obstacle locationinformation and location information, can not inform the blind of specific characteristics of theobstacle to form visual reproduction. For this defect, we construct a voice prompts system basedon ultrasonic and visual information fusion. It fully utilizes the prior knowledge of the blind, andrealized the external environment obstacle information real-time reappearance.
     In image recognition, in order to overcome the defect that single feature may fail when theexternal environment change, we use the approach of the fusion of ultrasonic and visualinformation to image recognition. Using the ultrasonic wave array survey, according to theminimum range determination principle, judges the orientation of the recent obstacles. That drivethe rotation angle shoted images, filtered, withdrawed the image the color and the shapecharacteristic. According to the object color, shape features in different objects have differentsensitivities, first uses support vector machines to the sole characteristic which withdraws carrieson the classified recognition, and obtains the characteristic weight computation factor, therebydefining feature weighting methods. K nearest neighbor classifier is introduced into the distancefunction, integrated the color and shape features, combined with image database, can achieve theobject recognition.
     In the voice prompt aspect, the pronunciation content partition record which is going tobroadcast beforehand on the voice chip by segment LCD display unit to read out the contents ofwhich the address. PC will transfer the image recognition results to the voice promptsmicrocontroller circuit, and realize a continuous playback of voice by triggering different voiceaddresses. The procedure was compiled and debuged in KEIL C software, and was downloadedto the microcontroller by running STC-ISP software. Completed, the microcontroller automatically run the program.
     Based on these studies to bulid the voice prompt system platform, and the voice prompts forthe image effects were tested and evaluated. Experiments show that a prior knowledge in theblind context, the voice prompts system to help blind people achieve good visual representation.
引文
[1]守天.主流网站实现奥运信息服务无障碍.中国残疾人, 2008, 30-35
    [2]秦笃列.盲人的助视器vOICe——视觉-听觉-成像信号转换的革命.中国医疗器械信息, 2004, 10(3):40-42
    [3]张竹茂,刘捷,赵瑛等.基于手指的触觉替代视觉系统的设计与实现.中国医学物理学杂志, 2009,26(4): 1293-1298
    [4] Liu JH, Sun XY. A survey of vision aids for the blind. Intelligent Control and Automation, 2006. WCICA2006: 4312-4316
    [5] Dobelle WH. Artificial vision for the blind by connecting a television camera to the visual cortex. ASAIOJ, 2000, 46(1): 3-9
    [6] Perez Fornos A, Sommerhalder J, Pittard A, er al.. Simulation of artificial vision:IV.Visual informationrequired to achieve simple pointing and manipulation tasks.Vision Res. 2008, 48(16): 1705-1718
    [7] Chai X, Li L, Wu K, et al.. C-sight visual prostheses for the blind. IEEE Eng Med Biol Mag, 2008, 27(5):20-28
    [8] Ivanova ME, Gordeev SA, Ortmann VV, et al.. Evaluation of cortical visual prostheses microelectrodearray function. Description of behavioral feline model. Conf Proc IEEE Eng Med Biol Soc, 2008,3371-3374
    [9] Shi P, Qiu YH, Zhu YS. Research of artificial visual prosthesis. Shengwu Yixue Gongchengxue Zazhi.2008, 25(3): 734-737
    [10]罗四维.视觉感知系统信息处理理论.北京:电子工业出版社, 2006
    [11] Ando B. Electronic sensor systems for the visually impaired. IEEE Instrumentation & MeasurementMagazine, 2003, 6(2): 62-67
    [12]张丽红.基于听觉显示的电子行走辅助技术研究: [硕士学位论文].浙江:浙江大学, 2005
    [13] D Bolgiano, EJ Meeks. A laser cane for the blind. IEEE Journal of Quanturn Electronic, 1997, 3(6):268-268
    [14] R Nagarajan, S Yaccob, G Sainarayanan. Role of object identification in sonification system for visuallyimpaired. Conf on Convergent Technologies for Aisa-Pacific Region, 2003, 735-739
    [15] K Sawa, K Magatani, K Yanashima. Development of a navigation system for visually impaired by usingoptical beacon. In 24th Annual EMBS/BMES Conf, toka, 2002: 2426-2427
    [16] R Fish. Auditory display for the blind. USA, 3800082, 2002, 3
    [17] Kaluwahandi S, et al.. Portable traveling support system using image processing for the visually impaired.IEEE International Conf.on Image Processing, 2003, 1(7-9): 337-340
    [18] Y. Kawai, F. Tomita. A support system for visually impaired persons to understand three-dimensionalvisual information using acoustic interface. IEEE 16th International Conference on Pattern Recognition.2002, 3(11-15): 974-977
    [19] Ram S, et al.. The People Sensor: A mobility aid for the visually impaired. IEEE Second InternationalSymposium Wearable Computers, 2002: 166-167
    [20] N Boutbakis, et al.. An intelligent assistant for navigation of visually impaired people. Proceedings of theIEEE 2nd International Symposium on Bioinformatics and Bioengineering Conference, 2003: 230-235
    [21] Thorsten Maucher. The heidelberg tactile vision subbstitution system, 6th International Conference onTactile Aids, Hearing Aids and Cochlear Implants, ISA2000, Exeter, May 2000 and at the InternationalConference on Computers Helping People with Special Needs, ICCHP2000, Karlarunhe, July 2000
    [22] Meijer P. Image-Audio transformation system. US Patent No. 5097326, March 2002
    [23] Shoval S, Uirich I, Borenstein J. Navbelt and the guide-cane[obstacle-avoidance systems for the blind andvisually impaired], Robotics&Automation Magazine, 2003, 10(1): 9-20
    [24]王和平,耿生群.超声波盲人导航系统的研究与应用.电子测量与仪器学报, 2004年增刊,1156-1160
    [25]孙文红,孟延,李新等.盲人智能探路手杖的研究.中国医学物理学杂志, 2005, 22(5): 674-676
    [26]王军.便携式智能导游终端系统的人性化设计与开发: [硕士学位论文].浙江:浙江大学, 2007
    [27]杨丹,张福梅,徐彬等.基于听觉通路的盲人无损视觉补偿系统.东北大学学报, 2008, 29(2):181-184
    [28] Liufang, Zhang Zhen, Chen Wen-chao. Design of infrared detecting intelligent guiding equipment basedon man-maching interaction. Journal of clinical Rehabilitative Tissue Engineering Research, 2008, 12(44):8784-8787
    [29]舒海燕.图像目标识别技术的研究与应用: [硕士学位论文].西安:西北工业大学, 2002
    [30]汪勇旭.图像目标识别算法研究: [博士学位论文].西安:西北工业大学, 2003
    [31]何东健.数字图像处理.西安:西安电子科技大学出版社, 2003
    [32]杨帆.数字图像处理与分析.北京:北京航空航天大学出版社. 2007: 309-312
    [33]张新峰,沈兰荪.模式识别及其在图像处理中的应用.测试技术, 2004, 23(5): 28-32
    [34]四维科技,胡小峰,赵辉. Visual C++/Matlab图像处理与识别实用案例精选.北京:人民邮电出版社, 2004
    [35]边肇祺,张学工.模式识别(第二版).北京:清华大学出版社, 2000
    [36]张金华.基于矩特征傅立叶描述的目标形状识别: [硕士学位论文].上海:上海交通大学, 2009
    [37] K.S.Fu. Syntactic. Pattern recognition applications. Springer Verlag. Basel, 1998
    [38]周新丰.基于图像处理的空中目标识别技术研究: [博士学位论文].南京:南京航空航天大学, 2004
    [39]肖斌,段承先,阎高伟.多传感器信息融合及其在工业中的应用综述.电脑开发与应用, 2007,20(10): 27-29
    [40]康耀红.数据融合理论与应用.西安电子科技大学出版社, 2002
    [41]郁文贤,雍少为,郭桂蓉.多传感器信息融合技术评述.国防工业大学学报, 2004, 16(3): 1-11
    [42] Arie J B, Nandy D. A volumetric/iconic frequency domain representation for objects with applicationfor pose invariant face recognition. ITPAMI, 2003, 20(5): 449-457
    [43]时德钢,刘晔,王峰等.超声波测距仪的研究.计算机测量与控制, 2002, 10(7): 480-482
    [44]余成波.数字图像处理及MATLAB实现.重庆大学出版社, 2006
    [45]杨枝灵,王开. Visual C++数字图像获取处理及实践应用.北京:人民邮电出版社, 2003: 134-137
    [46]张国亮,谢宗武,蒋再男等.模糊化多视觉信息融合的视觉跟踪策略.西安交通大学学报, 2009,43(8): 33-37
    [47]赵荣椿.数字图像处理导论.西安:西北工业大学出版社, 2008
    [48]王鹏,郑光宇,宋开亮.一种新的基于图像识别技术的信号灯识别算法.兵工自动化, 2009, 28(3):73-75
    [49]周正杰.基于形状的目标识别方法研究: [硕士学位论文].长沙:国防科技大学, 2005
    [50] Jim Mutch, David G. Lowe. Object class recognition and localization using sparse features with limitedreceptive fields. International Journal of Computer Vision, 2007: 45-57
    [51] K. Grauman, T. Darrell. Pyramid match kernel:discriminative classification with sets of image features.ICCV 2005. Tenth IEEE International Conference, 2005, 2: 1458-1465
    [52]丁艳,金伟其,窦建伟.基于支持向量机的自动目标识别算法.光学技术, 2008, 34(5): 791-793
    [53] Augusto Santiago Cerqueira, Danton Diego Ferreira, Moises Vidal Ribeiro, et al.. Power quality eventsrecognition using a SVM-based method. Electric Power Systems Research, 2008: 1543-1552
    [54] Kramer, G. An Introduction to Auditory Display. Sonification, auditication, and auditory interfaces.Santa Fe Institute, Addison Wesley, 2002: 1-77
    [55] Osmanovic, N, et al.. A testbed for auralization of graphic art. IEEE Region 5, 2003 Annual TechnicalConference. 2003: 45-49
    [56] Kramer G, Walke B, Cook P, et al.. Sonification report:status of the field and research agenda. 2004:30-35
    [57]陈育伟.基于参数化声音的信息可听化技术研究: [硕士学位论文].杭州:浙江大学, 2002
    [58]徐义东,方志刚,张丽红等.可听化研究综述.计算机辅助设计与图形学学报, 2004, 16(1): 14-18
    [59] Krishnan S, Rangayyan RM, Bell GD, et al.. Sonification of knee-joint vibration signals. Proc of the 22ndAnnual Int Conf of the IEEE, 2004: 1995-1998
    [60] Keith VN, Stephen B. Evaluation of a multimodal sonification and visualization of depth of market stockdata. Proc of the 2003 Int Conf.on Auditory Display, ICAD, 2003: 1-6
    [61] R Nagarajan, S Yaccob, G Sainarayanan. Fuzzy based human vision properties in stereo sonificationsystem for visually impaired. Proceedings of SPIE, 2002, 4572: 525-534
    [62] R Nagarajan, S Yaccob, G Sainarayanan. Role of object identification in sonification system for visuallyimpaired. Conf on Convergent Technologies for Aisa-Pacific Region, TENCON, 2003: 735-739
    [63] Capelle C, Trullemans C, Arno P, et al.. A real-time experimental prototype for enhancement of visionrehabilitation using auditory substitution. IEEE Transactions on Biomedical Engineering, 2005, 45(10):1279-1293
    [64] Milios E, Kapralos B, Kopinska A, et al.. Sonification of range information for 3-D space perception.IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2003, 11(4): 416-421
    [65]张琼,宋哲,石教英.可听化技术综述.计算机辅助设计与图形学学报, 2002, 11(2): 189-192
    [66]张琼,石教英.分布式虚拟环境中的三维音频支持.计算机辅助设计与图形学学报, 2002, 14(12):1152-1155
    [67]曾向阳,郭晓元,陈克安等.三维空间宽带音质可听化仿真.计算机仿真, 2003, 20(1): 62-64
    [68]袁静萍,历荣卫.一种智能录放音系统的设计与实现.江苏大学学报, 2005, 11(6): 44-47
    [69] G. Kinoshita, Y Ikhsan and H. O. Location based on sensor fusion of vision and sensing tactual AdvancedRobotics, 2002, 13(6): 633-646
    [70] F. Azuaje, W. Dubitzky, N.Black, et al.. Improving clinical decision support through case based datafusion. IEEE Transaction on Biomedical Engineering, 2003, 46(10): 1181-1185

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700