基于双目视觉及DSP的农田障碍物检测与路径识别方法研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
农田移动机器人属于机器人研究领域内的热点之一。在农田移动机器人相关研究中,农田障碍物检测与路径识别是机器人能够正常工作的关键,也是实现其真正智能化和完全自主移动的核心技术。利用双目视觉技术实现农田障碍物检测,具有探测范围广、检测精度高等特点,利用DSP技术实现路径的识别,具有实时性好、处理速度快、体积小、功耗低等优势,因此开展本论文的研究具有重要的理论意义和实用价值。
     本文围绕农业机器人的自动导航,提出了一种基于双目视觉及DSP技术的农田障碍物检测与路径识别方法,研究出一种农田障碍物的快速检测方法,并实现了基于DSP的路径识别软、硬件系统的搭建,主要包括以下工作:
     (1)建立了双目视觉的成像模型,采集多组不同位姿的标定物图像进行摄像机标定,利用计算方法和几何变换得出摄像机的内、外部参数,经过多次实验,得出标定的像素误差基本在0.2个像素范围内,满足系统的要求,可用于后续的计算。
     (2)介绍了基于双目视觉技术的多种农田障碍物检测方法,从图像获取、双目校正、立体匹配和深度测量四个方面进行讨论,首先利用标定结果对田间图像对进行去畸变,然后利用Bouguet算法进行校正,接着采用基于绝对差值和的局部匹配算法获得了较理想的视差图,最后通过三角测量计算障碍物的深度信息。编写程序代码,并在实验室与农田环境中进行大量实验,可实现多种障碍物的检测,如人、砖块、铁锹、陷坑等,实验证明,当检测范围在2000mm以内时,检测结果误差较小,具有较好的稳定性和鲁棒性。
     (3)介绍了基于DSP的路径识别方法。搭建了以北京合众达公司的SEED-VPM642为核心的硬件实验平台,该硬件平台采用专用于视频处理的高性能DSP作为处理核心,研究过程中采用了模块化的思想,其中包括DSP系统(CSL库函数、EMIFA接口、EDMA、视频编解码芯片等)初始化模块、视频图像的输入与输出模块、DSP核心图像处理算法模块等,完成了整个DSP系统的仿真与测试,实验表明,该方法处理速度快、实时性较好,满足系统的要求。
Agricultural mobile robot research is one of the hotpots in the robot research field.Inrelated research of agricultural mobile robot,obstacle detection and path identification are notonly the key of realizing robot to work, but also the core technology to achieve the realintelligent and autonomous move. Obstacle detection based on binocular stereo vision has theadvantage of wide range of detection and high accuracy, path identification based on DSPtechnology has the advantage of good real-time, fast processing speed,small size, low powerconsumption, and so on, so the research of this paper has important theoretical significanceand practical value.
     This paper focuses on the autonomous navigation of agricultural robots, developed arapid obstacle detection method in farmland based on binocular vision and path identificationmethod based on DSP technology, and setted up the software and hardware system, includingthe following work:
     (1) Established the imaging model of binocular vision, finished camera calibration withgroups of object images in different position, got the camera internal and external parametersby calculation methods and geometric transformations, after many experiments, the pixelerror of calibration was within0.2pixels, it can meet the requirement of the system and canbe used in subsequent calculations.
     (2) Introduced a variety of obstacles detection method in farmland based on binocularvision. technology, focus on the real-time inages acquisition, binocular camera calibration,binocular correction, stereo matching and depth measurement and so on, firstly the imagesreseived should be distorted by the result of camera calibration, and then used Bouguetalgorithm rectified the image pairs, then striked the disparity map using the local matchingalgorithm based on absolute difference, finally calculated the depth information of theobstacles by triangulation method. Programmed the code, and took a large number ofexperiments in the laboratory and field environment, we can achieve the detection of a varietyof obstacles, such as people, bricks, shovels, crater, etc. Experiments showed that when the detection range was less than2000mm, the errors were less,it showed that the method hasgood stability and robustness.
     (3) Introduced a path identification method based on DSP technology. Setted up thehardware experiment platform, it's core is the SEED-VPM642which is developed by BeijingHezhongda company, the hardware platform used a dedicated high-performance DSP as theprocessing core, using the idea of modular while the research process, including DSP system(CSL library functions, EMIFA interface, the EDMA, video codec chip, etc.)initialization,the input and output of video, the DSP core image processing algorithms, etc., completed thesimulation and testing of the entire DSP system. Experiments showed that the method had fastprocessing speed and better real-time, can meet the requirement of the system.
引文
白荣侠.2010.基于立体视觉的三维重建关键算法研究与应用.[硕士学位论文].西安:西安电子科技大学
    毕昆,赵馨,侯瑞锋,王成.2011.机器人技术在农业中的应用方向和发展趋势.中国农学通报,27(04):469~473
    曹倩,王库,杨永辉,史小磊.2009.基于TMS320DM642的农业机器人视觉导航路径检测.农业机械学报,40(7):171~175
    丁幼春,王书茂,陈红.2009.农用车辆作业环境障碍物检测方法.农业机械学报,40(增刊):23~27
    侯学贵.2007.除草机器人杂草识别与视觉导航技术研究.[硕士学位论文].南京:南京林业大学
    
    何东健,耿楠,张义宽.2003.数字图像处理.西安:西安电子科技大学出版社
    何金伊,杨福增,徐秀栋.2011.山地履带式遥控微耕机控制系统设计.拖拉机与农用运输车,38(2):19~22合众达电子.2007.SEED-VPM642用户指南.北京:北京合众达电子技术有限责任公司
    胡天翔,郑加强,周宏平.2010.基于双目视觉的树木图像测距方法.农业机械学报,41(11):158-162
    姜国权,杜尚丰,赵翠君,司永胜.2010.用于视觉导航中的摄像机标定方法研究.中国科学_信息科学,40(增刊):143~151
    蒋焕煜,彭永石,申川,应义斌.2008.基于双目立体视觉技术的成熟番茄识别与定位.农业工程学报,24(8):279~283
    江思敏,刘畅.2005.TMS320C6000DSP应用开发教程.北京:机械工程出版社:5~12
    李建平,林妙玲.2006.自动导航技术在农业工程中的应用研究进展.农业工程学报,22(9):232~236
    李宇.2007.基于双目视觉的障碍物识别研究.[硕士学位论文].武汉:武汉理工大学
    刘金颂,袁思聪,张庆阳,刘道华.2008.双目立体视觉中的摄像机标定技术研究.计算机工程与应用,44(6):237~239
    刘瑞祯,于仕琪.2008.OpenCV教程.北京:北京航空航天大学出版社
    马颂德,张正友.1998.计算机视觉——理论与算法基础.北京:科学出版社
    弥丽丽.2010.基于双目视觉的复杂背景下运动目标三维信息重建.[硕士学位论文].西安:西北大学
    潘华,郭戈.2004.立体视觉研究的进展.计算机测量与控制,12(12):1121~1124
    斯内尔,鲍尔美,刘彦博.2009.Visual Studio技术大全.北京:人民邮电出版社
    王勇.2007.棉花收获机器人视觉系统的研究.[博士学位论文].南京:南京农业大学
    王跃宗,刘京会.2009.TMS320DM642DSP应用系统设计与开发.北京:人民邮政出版社
    夏永泉.2007.计算机视觉中双目匹配相关技术研究.[博士学位论文].南京:南京理工大学
    行麦玲.2003.大视场短焦距物镜CCD摄像系统畸变测量技术研究.[硕士毕业论文].北京:北京理工大学
    徐秀栋,杨福增,姚垚,徐建,苏乐乐.2010.微型果园机械远程控制系统的研究与实现.农机化研究,(3):111~114
    杨敏丽.2007.中级阶段农机化发展的需要和趋势.http://www.jsnj.gov.cn/html/njhsd/132959.shtml[2010-01-11]
    于仕琪,刘瑞祯.2009.学习OpenCV.中文版.北京:清华大学出版社
    张方明,应义斌.2005.机器视觉在农业车辆导航系统中的研究进展.农业机械学报,36(5):133~136
    张广军.2005.机器视觉.北京:科学出版社
    张凯良,杨丽,张铁中.2011.草莓收获机器人采摘执行机构设计与试验.农业机械学报,42(9):155~161
    张磊,王书茂,陈兵旗,刘志刚.2007.基于双目视觉的农田障碍物检测.中国农业大学学报,12(4):70~74
    张瑞合,姬长英,沈明霞,曹坤.2001.计算机视觉技术在番茄收获中的应用.农业机械学报,32(5):50~58
    张雄伟,陈亮,徐光辉.2003.DSP芯片的原理与开发应用.第3版.北京:电子工业出版社:15~22,35~46
    章毓晋.2006.图像工程(上册)图像处理.第2版.北京:清华大学出版社
    张铮,王艳平,薛桂香.2010.数字图像处理与机器视觉.北京:人民邮电出版社
    赵春江,杨亮,郭新宇,陆声链,肖伯祥.2010.基于立体视觉的玉米植株三维骨架重建.农业机械学报,41(4):157~162
    赵晓霞,张铁中,陈兵旗,乔军,杨会华.2009.自然环境下桃子图像分割算法.农机化研究,(2):107~111
    朱磊磊.2010.果园管理机器人平台的自动导航系统研究.[硕士学位论文].西安:西北农林科技大学
    Francisco Rovira-Más.2003.Applications of stereoscopic vision to agriculture.Ph.D thesis,University ofIllinois
    Hague T.,N.D.Tillett.2001.A bandpass filter-based approach to crop row location and tracking.Mechatronics.(11):l~12
    Hannan M W,Burks T F,Bulanon D M.2007.A real-time machine vision algorithm for robotic citrusharvesting[A].St.Joseph,Mich.:ASAE,2007,ASAE Paper No.073125
    Harris C,Stephens M.1998.A Combined Corner and Edge Deteetion.Image Vision Computing,6:121~127
    Hartley R I.1992.Estimation of relative camera position for uncalibrated cameras.In:Proceedings of theECCV’92.Italy:Santa Margherita Ligure.579~587
    Jiangping Hua,Qingming Liao.2000.Wavelet-based multiscale corner detection.Proceedings of ICSP.2000
    Keicher R., Seufert H.2000.Automatic guidance for agricultural vehicles in Europe.Computers and
    Electronics in Agriculture.25:169~194
    M.Kise,Q.Zhang,F.Rovira Mas.2005.A stereovision-based Crop Row Detection Method for
    Tractor-automated Guidance.Biosystems Engineering,90(4),357~367
    Mackworth A K.1973.Interpreting pictures of polyhedral scenes.Artificial Intelligence,4(2):121~137
    Marr D.1982.Vision:A computational investigation into the human representation and processing of visualinformation.W.H.San Francisco:Freeman and Company.
    Murakami N,Otsuka K,lnoue K,et al.1997.Image processing algorithm for developing selective harvester ofcabbage.JSAM,59:65~72
    Philips.2002.SAA7120H/SAA7121H Digital video encoder,October2002
    Reid John F., Zhang Qin,Noguchi Noboru,Dickson Monte.2000.Agricultural automatic guidance researchin North America. Computers and Electronics in Agriculture.25:155~167
    Roberts L G.1965.Machine perception of three-dimensional solids.In:Optical and Electro-optical
    Information Processing.Cambridge:MIT Press,159~197
    R.Y.Tsai.1986.An efficient and accurate camera calibration technique for3D machine vision,Proceedingsof IEEE Conference On Computer Vision and Pattern Recognition,1986,364~374
    Stefano Mattoccia.2009.Stereo vision:algorithms and applications.Enschede:University of Twente
    Stentz A.2001.Robotic Technologies for Outdoor Industrial Vehicles.Proceedings of SPIE AeroSense2001
    Texas Instruments.2001a.TMS320C6000Peripherals reference guide,Feb.2001
    Texas Instruments.2001b.TMS320C64x technical overview,Jan.2001
    Texas Instruments.2003.TMS320C64x Image/Video Processing Library.October2003
    Texas Instruments.2004a.TMS320DM642video/imaging fixed-point digital signal processor, Aug.2004
    Texas Instruments.2004b.TMS320C6000DSP external memory interface (EMIF)reference guide.Apr.2004
    Texas Instruments.2004c.TMS320C64X DSP video port/VCXO interpolated control(VIC) port referenceGuide,Aug.2004
    Texas Instruments.2004d.TVP5150A/TVP5150AM1Uitralow Power NTSC/PAL/SECAM Video DecoderWith Robust Sync Detector,May2004
    TillettN.D,HaugeT.1999.Computer-Vision-based Hoe Guidance for Cereals an InitialTrial.Agric.Engng.Res.1999,(74):225~236
    Tillett N.D.,T.Hauge,S.J.Miles.2002.Inter-row vision guidance for mechanical weed control in sugarbeet.Computers and Electronics in Agriculture,(33):163~177
    Vallerand,S.,M.Kanbara,and N.Yokoya.2003Binocular vision-based augmented reality system with anincreased registration depth using dynamic correction of feature positions.IEEE Virtual Reality2003.Proceedings,Las Vegas:p.271~272.
    Van Henten E J,Van Tuijl B A J,Hemming J,et al.2003a.Field test of an autonomous cucumber pickingrobot.Biosyst Eng,86:305~313
    Van Henten E J,Hemming J,Van Tuijl B A J,et al.2003b.Collision-free motion planning for a cucumberpicking robot.Biosyst Eng,86:135~144
    Young R E.1976.Possibilities for producing course signals for the automatic steering of farmvehicles.Automatic Guidance of Farm Vehicles:A Monograph.Auburn,AL
    Zhang Z.2000.A flexible new technique for camera calibration.IEEE Trans. Pattern Analysis and MachineIntelligence,22(11):1330~1334
    有马诚一,近藤直,芝野保德.キユウリ收获ロボットの研究(第1报).农业机械学会志,1994,56:55--64
    有马诚一,近藤直,芝野保德.キユウリ收获ロボットの研究(第2报).农业机械学会志,1994,56:69--76
    有马诚一,近藤直,芝野保德.キユウリ收获ロボットの研究(第3报).农业机械学会志,1995,57:51--58

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700