基于ARM的苹果图像果实识别与定位关键技术研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
苹果果实图像特征的实时精确提取、果实目标的快速识别与定位是提高苹果采摘机器人采摘速度的关键问题。论文针对目前苹果采摘机器人视觉系统中存在的系统资源消耗大、效率低等问题,结合嵌入式系统及实时数字图像处理技术等领域的最新研究成果,研究基于ARM的苹果图像果实识别与定位系统,以使处理速度满足实时要求,果实定位准确,为设计开发苹果采摘机器人提供技术依据。论文主要研究内容和结论如下:
     (1)在分析影响苹果采摘机器人作业效率原因的基础上,深入研究了机器视觉及实时数字图像处理技术,详细分析了嵌入式系统开发流程和设计准则及基于ARM的嵌入式系统实现方法,结合苹果图像果实识别与定位的应用需求,提出一种基于ARM7TDMI+μC/OS-Ⅱ架构的苹果图像果实识别与定位系统方案,并对系统的开放性进行评价。
     (2)在分析比较的基础上,对苹果果实图像识别与定位系统实现的硬件平台进行了设计和选择,构建了基于ARM7TDMI微处理器为基础的硬件方案,完成了以键盘输入、LCD显示等模块硬件电路的实现和调试。
     (3)对比多种嵌入式操作系统的优缺点,分析系统的软件体系架构,结合系统硬件平台的特性,建立以μC/OS-Ⅱ操作系统为基础的软件平台,实现Bootloader的移植和相关驱动程序的开发。
     (4)研究了自然条件下采集苹果图像的预处理方法,针对中值滤波法不能直接应用于彩色图像的问题,采用了一种改进的中值滤波方法对图像进行预处理,并对受遮挡果实的识别与定位算法进行研究,由于Hough变换技术对于图像中噪声及信息缺失的不敏感性,该算法可以实现遮挡果实的有效精确识别,同时对Hough变换中存在的检测速度问题进行了改进,并将该算法在嵌入式系统予以实现、移植。
     (5)测试结果表明,本文设计实现的苹果果实识别与定位系统可以实现苹果果实图像的快速准确定位,系统整体运行稳定,能够适应苹果采摘机器人视觉系统的要求,对今后苹果采摘机器人的实用化有着积极的意义。
The speed that harvest robot picks apples is an important issue in apple harvest robot fields. To improve this speed, the key is extracting the apple fruit quickly and accurately, and then locating the apple rapidly from an image. Considering the shortcomings of apple fruit image recognition and location system, on the basis of analyzing and improving the algorithms of real-time image processing, this paper combines the latest achievements of embedded system in the technology of real-time image processing. Under the terms of utilizing software and hardware resources rationally, we regard ARM as the platform, research and implement an apple fruit image recognition and location system which obtains good performance and high speed. This provides technical sustain for designing quicker apple fruit harvest robot. The major research contents and conclusions of the paper are as follows:
     (1) We analyze the reasons why apple harvest robot is inefficient, study the technology of computer vision and real-time digital image processing deeply, and analyze the flow of embedded system development, the design principle and the way to implement the embedded system for ARM. Considering the application needs of apple fruit image recognition and location system, we propose a scheme based on the structure of ARM7TDMI+μC/OS-Ⅱ, and then evaluate the open characteristic of the system.
     (2) Through analysis and comparison, we design and select the hardware platform, construct the hardware scheme based on ARM7TDMI microprocessor, implement and debug keyboard and LCD.
     (3) We compare the advantages and disadvantages of many embedded operating systems, analyze the structure of software scheme. Considering the characters of hardware platform, we build a software platform based onμC/OS-Ⅱ, transplant Bootloader and implement device driver.
     (4) We study the pretreatment method of apple images which are collected under natural scenes, in order to overcome the problem that median filter can not be used in the color image directly, we improve it to suitable for the pretreatment.For the advantage of its insensitivity to the noise, Hough transform can recognize and locate the apple fruits rapidly and effectively. Then we improve the Hough transform to overcome the disadvantage of comparative low speed. In the end, we transplant all algorithms into the embedded system.
     (5) The test results show that the apple fruit image recognition and location system can locate the apple fruit rapidly and accurately, this system is stable, reliable, and suitable for the vision system of apple harvest robot, it is beneficial to accelerating industrialization of apple harvest robot.
引文
[1]徐丽明,张铁中.果蔬果实收获机器人的研究现状及关键问题和对策[J].农业工程学报,2004,20(5): 38-41.
    [2]赵匀.农业机器人的研究进展及存在的问题[J].农业工程学报.2003,19(1):20-24.
    [3] Ceres R.,Pons J.L., Jiménez A.R.,et al.Agribot:A Robot for Aided Fruit Harvesting[J].Indus-tria1 Robot, 1998,25(5):337-46.
    [4]方建军.移动式采摘机器人研究进展[J].农业工程学报,2004,20(2):273-278.
    [5]沈明霞,姬长英.农业机器人的开发背景及技术动向[J].农机化研究,2002,(5):31-35.
    [6]张铁中,林宝龙,高锐.水果采摘机器人视觉系统的目标提取[J].中国农业大学学报,2004,9(2):68-72.
    [7]崔玉洁,张祖立,白晓虎.采摘机器人的研究进展与现状分析[J].农机化研究,2007,(2):4-7.
    [8]赵金英,张铁中,杨丽.西红柿采摘机器人视觉系统的目标提取[J].农业机械学报,2006,37(10): 200-203.
    [9]李绍民.嵌入式图像采集及自主足球机器人视觉系统[J].吉林大学学报(信息科学版),2004,6(22): 579-582.
    [10]夏靖波等.嵌入式系统原理与开发[M].西安:西安电子科技大学出版社,2006.
    [11] Jamal Boukerroui,J.Alison Noble,Michael Brady.On the Choice of Band-Pass Quadrature Filters[J]. Journal of Mathematical Imaging and Vision,2004,21(1):53-80.
    [12] Jeremy Yirmeyahu Kaminski,Mina Teicher.A General Framework for Trajectory Triangulation[J]. Journal of Mathematical Imaging and Vision,2004,21(1)27-41.
    [13] Loong-Fah Cheong,Chin-Hwee Peh.Depth distortion under calibration uncertainty[J]. Computer Vision and Image Understanding,2004,93(3):221-244.
    [14] Hanzi Wang,David Suter. MDPE:A Very Robust Estimator for Model Fitting and Range Image Segmentation[J].International Journal of Computer Vision,2004,59(2):139-166.
    [15] Vittorio Ferrari,Tinne Tuytelaars,Luc Gool.Simultaneous Object Recognition and Segmentation from Single or Multiple Model Views[J].International Journal of Computer Vision,2006,67(2):159-188.
    [16] Andrew Fitzgibbon,Yonatan Wexler,Andrew Zisserman.Image-Based Rendering Using Image-Based Priors[J].International Journal of Computer Vision,2005,63(2):141-151.
    [17] Paul Viola,Michael J.Jones,Daniel Snow. Detecting Pedestrians Using Patterns of Motion and Appearance[J].International Journal of Computer Vision,2005,63(2):153-161.
    [18] Pedro F.Felzenszwalb,Daniel P.Huttenlocher.Pictorial Structures for Object Recognition[J]. International Journal of Computer Vision,2005,61(1):55-79.
    [19] Michael D.Grossberg,Shree K.Nayar. The Raxel Imaging Model and Ray-Based Calibration[J]. International Journal of Computer Vision,2005,61(2):119-137.
    [20] Zhigang Zhu,Guangyou Xu,Xueyin Lin.Efficient Fourier-based approach for detecting orientations and occlusions in epipolar plane images for 3D scene modeling [J].International Journal of Computer Vision, 2005,61(3):233-258.
    [21] Martin David Levine,Yingfeng Yu.Face recognition subject to variations in facial expression, illumination and pose using correlation filters[J].Computer Vision and Image Understanding,2006,104(1):1-15.
    [22] Cristian Sminchisescu,Atul Kanaujia,Dimitris Metaxas.Conditional models for contextual human motion recognition[J].Computer Vision and Image Understanding,2006,104(2):210-220.
    [23] Alper Yilmaz, Mubarak Shah.Matching actions in presence of camera motion[J].Computer Vision and Image Understanding,2006,104(2):211-231.
    [24] Neil Robertson,Ian Reid.A general method for human activity recognition in video[J].Computer Vision and Image Understanding,2006,104(2):232-248.
    [25] Thang V. Pham,Arnold W.M.Smeulders.Object recognition with uncertain geometry and uncertain part detection[J].Computer Vision and Image Understanding,2005,99(2):241-258.
    [26] Manolis I.A.Lourakis,Antonis A.Argyros.Efficient,causal camera tracking in unprepared environments[J]. Computer Vision and Image Understanding,2005,99(2):259-290.
    [27] Frank Y.Shih,Yi-Ta Wu.Decomposition of binary morphological structuring elements based on genetic algorithms[J].Computer Vision and Image Understanding,2005,99(2):291-302.
    [28] Yves Dufournaud,Cordelia Schmid,Radu Horaud.Image matching with scale adjustment[J].Computer Vision and Image Understanding,2004,93(2):175-194.
    [29] Alberto Ortiz,Gabriel Oliver.On the use of the overlapping area matrix for image segmentation evaluation: A survey and new performance measures[J].Pattern Recognition Letters,2006,27(16): 1916-1926.
    [30] Xiaoxun Zhang,Yunde Jia.Face recognition with local steerable phase feature[J].Pattern Recognition Letters,2006,27(16):1927-1933.
    [31] Yonggang Wang,Jie Yang,Yuchou Chang.Color-texture image segmentation by integrating directional operators into JSEG method[J].Pattern Recognition Letters, 2006,27(16):1983-1990.
    [32] Uri Lipowezky.Grayscale aerial and space image colorization using texture classification[J].Pattern Recognition Letters,2006,27(4):275-286.
    [33] Kyung-Seok Seo,Jung-Hwa Lee,Heung-Moon Choi.An efficient detection of vanishing points using inverted coordinates image space[J].Pattern Recognition Letters,2006,27(2):102-108.
    [34] Shih-Hsuan Chiu,Jiun-Jian Liaw.An effective voting method for circle detection[J].Pattern Recognition Letters,2005,26(2):121-133.
    [35] Marshall F.Tappen,William T.Freeman,Edward H.Adelson. Recovering Intrinsic Images from a Single Image[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2005,27(9):1459-1472.
    [36] Nikhil Balakrishnan,Karthik Hariharakrishnan,Dan Schonfeld. A New Image Representation Algorithm Inspired by Image Submodality Models, Redundancy Reduction, and Learning in Biological Vision [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2005,27(9): 1367-1378.
    [37] Graziano Chesi,Y.S.Hung.Image Noise Induced Errors in Camera Positioning[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2007,29(8):1476-1480.
    [38] Deva Ramanan,David A.Forsyth,Kobus Barnard.Building Models of Animals from Video[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2006,28(8):1319-1334.
    [39] Bulanon D M,Kataoka T,Ota Y,etal.A segmentation algorithm for the automatic recognition of Fuji Apples at harvest[J].Biosystems Engineering,2002,83(4):405-412.
    [40] Jiménez A R,Ceres R,Pons J L.Automatic fruit recognition:A survey and new results usingrange-attenuation images[J].Pattern Recog,1999,32:1719-1736.
    [41]徐惠荣,叶尊忠,应义斌.基于彩色信息的树上柑橘识别研究[J].农业工程学报,2005,21(5):98-101.
    [42]张瑞合,姬长英,沈明霞等.计算机视觉技术在番茄收获中的应用[J].农业机械学报,2001,32(5): 50-52,58.
    [43]张铁中,林宝龙,高锐.水果采摘机器人视觉系统的目标提取[J].中国农业大学学报,2004,9(2): 68-72.
    [44]袁国勇,张铁中.温室黄瓜果实的模式识别与分割-利用Bayes分类判别模型[J],农机化研究,2006,(7):150-153
    [45]谢志勇,张铁中.基于RGB彩色模型的草莓图像色调分割算法[J].中国农业大学学报,2006,1l(1): 84-86.
    [46]宁纪锋,何东健,张海亮,龙满生.基于图像形态学的球形果实品质检测研究[J],农机化研究,2001,(3): 28-29,47.
    [47]赵静,何东健.果实形状的计算机识别方法研究[J],农业工程学报,2001,17(2):165-167.
    [48]汤建华,陈树人.番茄收获机器人中视觉目标的自动分割与识别[D],江苏大学硕士学位论文,2005.
    [49]吴明晖等.基于ARM的嵌入式系统开发与应用[M].北京:人民邮电出版社,2004.
    [50]黎洪生,董军.μC/OS-Ⅱ在数据采集中的应用[J].仪器仪表用户,2004,11(3):54-55.
    [51]黄元峰,李育清,姜生元.基于μC/OS的嵌入式系统应用开发研究[J].2006,22(2-2):100-102.
    [52]石世光,陈云洽,叶奇明.嵌入式操作系统μC/OS的运行机制[J].计算机技术与发展,2006,16(8): 85-87.
    [53]王劲松.嵌入式操作系统μC/OS的内核实现[J].现代电子技术,2003,(8):48-49.
    [54]罗蕾.嵌入式实时操作系统及应用开发[M].北京:北京航空航天出版社,2005.
    [55]王克星.实时多任务操作系统的开发与应用[J].计算机工程与应用,2003,(5):132-134.
    [56]邵贝贝.源码公开的实时嵌入式操作系统[M].北京:中国电力出版社,2001.
    [57]崔树林.嵌入式系统通用的应用软件结构研究[J].单片机与嵌入式系统应用,2003(8):9-10.
    [58]林宝龙.基于三维视觉的水果采摘机器人技术研究[D].中国农业大学硕士学位论文,2004.
    [59]赵金英.基于三维视觉的西红柿采摘机器人技术研究[D].中国农业大学博士学位论文,2006.
    [60]陈利红.机器人视觉系统的研究与开发[D].浙江大学硕士学位论文,2003.
    [61]吕朝辉,陈晓光,吴文福等.基于双目立体视觉的秧苗直立度自动测定系统[J].农业机械学报,2002, 33(1):60-62.
    [62]赵鹏,赵德安.双目立体视觉在果树采摘机器人中的应用[J].农机化研究,2009,(1):212-214.
    [63]隋婧,金伟其.双目立体视觉技术的实现及其进展[J].电子技术应用,2004,(10):4-6,12.
    [64]何东健等.数字图像处理(第二版)[M].西安:西安电子科技大学出版社,2008.
    [65]井上诚喜等.C语言使用数字图像处理[M].北京:科学出版社,2003.
    [66]万海军.实时图像处理算法研究及FPGA实现[D].西北农林科技大学硕士学位论文,2008.
    [67]王雅琴,高华.自然环境下水果图像分割与定位研究[J].计算机工程,2004,30(13):128-129,162.
    [68]汤海缨,庄天戈.计算机彩色模型在图像显示与分割中的应用[J].计算机学报,1999, 22(4):375-382.
    [69]蔡健荣,赵杰文.自然场景下成熟水果的计算机视觉识别[J].农业机械学报,2005,36(2):61-64.
    [70]古辉,芦亚亚,丁维龙等.自然场景下果实目标的识别和定位[J].浙江工业大学学报,2007,35(3): 267-273.
    [71]徐大宏,吴敏,曹卫华.一种新的实时彩色目标分割方法[J].计算机工程与应用,2003,(22):75-77.
    [72]王磊,段会川.Otsu方法在多阈值图像分割中的应用[J].计算机工程与设计,2008,29(11):2844-2845,2972.
    [73]李彬,田联房,毛宗源.基于人工免疫的灰度图像多阈值自动分割[J].计算机工程与设计,2002,23(1): 106-108.
    [74]王祥科,郑志强.Otsu多阈值快速分割算法及其在彩色图像中的应用[J].计算机应用,2006,26: 14-15.
    [75]殷蔚明,王典洪.Otsu法的多阈值推广及其快速实现[J].中国体视觉与图像分析,2004,9(4):219-223.
    [76]岳振军,邱望成,刘春林.一种自适应的多目标图像分割方法[J].中国图象图形学报,2004,9(6): 674-678.
    [77]付忠良.图像阈值选取方法-Otsu方法的推广[J].计算机应用,2000,20(5):37-39.
    [78]蔡晋辉,蒋庆,周泽魁等.圆检测HOUGH变换的改进算法研究[J].模式识别与人工智能,2004,17(1): 72-76.
    [79]陈燕新,戚飞虎.基于随机Hough变换的快速圆检测方法[J].上海交通大学学报,1998,32(10):17-20.
    [80]刘勋,毋立芳,林娟.一种改进的Hough变换提取圆的方法术[J].信号处理,2004,20(6):623-627.
    [81]蔡健荣,赵杰文.基于圆形Hough变化的遮挡果实特征提取[C].中国农业机械学会2006年学术年会论文集,2006,1333-1337.
    [82]邱文华,吴建华,王平.一种快速的圆检测方法[J].计算机技术与发展,2007,17(1):117-118,122.
    [83]符意德.嵌入式系统设计原理及应用[M].北京:清华大学出版社,2004.
    [84]慕春棣.嵌入式系统的构建[M].北京:清华大学出版社,2004.
    [85]张大波等,嵌入式系统原理、设计与应用[M].北京:机械工业出版社,2005.
    [86]周立功等.ARM嵌入式系统基础教程[M].北京:北京航空航天大学出版社,2005.
    [87]马忠梅等.ARM嵌入式处理器结构与应用基础[M].北京:北京航空航天大学出版社,2002.
    [88]梁修如,严国萍.嵌入式视频监控服务器系统典型方案及其性能分析[J].电视技术,2005,1(10): 93-96.
    [89]肖政宏,韩秋凤,朱丽群.基于ARM和DSP的远程视频监控系统的设计与实现[J].计算机工程与科学,2006,28(9):53-55.
    [90]戚继忠,王自强.基于ARM7TDMI实现CF卡存储的文件系统设计[J].微处理机,2007,1(1):114-115.
    [91]沈连丰,宋铁成,叶芝慧.嵌入式系统及其开发[M].北京:电子工业出版社,2005.
    [92]金鑫,陈锋,虞鹤松.S3C44BOX下的Bootloader开发[J].工业控制计算机,2005,18(8):51-52,55.
    [93]胡修林,余凯军.基于arms3c44box处理器的Bootloader设计和实现[J].计算机应用,2006,26(7): 1727-1729.
    [94]马学文,朱明日,程小辉.嵌入式系统中Bootloader的设计与实现[J].计算机工程,2005,31 (7):96-98.
    [95]秦培龙,李国,李艳红.基于S3C44B0X的Bootloader设计与实现[J].微计算机信息,2008,(2): 153-155.
    [96]郭瑛,李树华,铁勇等.基于S3C44BOX的嵌人式系统Bootloader设计与实现[J].内蒙古大学学报(自然科学版),2008,39(5):555-559.
    [97]俊航,邱辉.Bootloader的分析和设计[J].微处理机,2006,(4):83-84.
    [98]严国清,熊建设,徐洪梅.S3C44B0X中BootLoader的实现[J].信息技术与信息化,2004,(6):40-41.
    [99]田国华,何东健,杨青.实时操作系统μC/OS-II在LPC2210上的移植研究与实现[J].微计算机信息,2005,21(12-2),33-36.
    [100]潘宁,邓燕妮.基于S3C44B0X的嵌入式机器视觉系统设计[J].机械与电子,2006,(10):52-54.
    [101]沈文斌.嵌入式硬件系统设计与开发实例详解[M].北京:电子工业出版社,2005.
    [102]彭天玲,王江晴.嵌入式实时操作系统μC/OS-II在s3c44box上的移植[J].中南民族大学学报(自然科学版),2007,26(1):70-73.
    [103]陆强,戴文,吴士涛.基于ARM和μC/OS嵌入式系统移植的研究[J].山东科技大学学报(自然科学版),2006,25(4):83-86.
    [104]谢志勇,张铁中,赵金英.基于Hough变换的成熟草莓识别技术[J].农业机械学报,2007,38(3): 106-109.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700