自然场景下果蔬识别定位系统的关键技术研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
果蔬采收是一项劳动密集型的工作,在很多国家,随着劳动力的高龄化和人力资源的缺乏,人工采收的成本在果蔬的整个生产成本中占了很大的比例。而我国是一个农业大国,果蔬产量多,品种丰富,出口量大。但是,现阶段的采收基本依靠人力,成本高、效率低。因此,实现果蔬采收的自动化迫在眉睫。
     利用计算机视觉系统对自然场景下的果蔬进行分割识别是实现机器人自动化采摘关键的一步。但是,自然场景下生长的果蔬具有极高的随机性,要实现一个完整的果蔬识别系统,必须解决六大问题,包括实现果实在自然光照条件下、阴影下、被遮挡情况下以及与背景色相似情况下的有效识别;解决果实中心点和采摘点的准确定位问题。
     针对上述六大难题,本文主要的工作有:
     (1)根据各颜色模型的特点,提出了两种新的颜色模型LHM和YNM。在分析其实验结果后选用LHM模型作为本文的颜色模型。依据分类识别的原理和LHM的聚类性成功解决了被遮挡、自然光照下和阴影下的果蔬识别问题。
     (2)研究和利用灰度共生矩阵提取纹理特征,得到可区分果实和背景的两大纹理特征:熵和能量。然后,综合颜色特征和纹理特征,解决了果实和背景颜色相似的识别问题。
     (3)构造了果蔬模型,解决了定位果蔬中心的难点;给出了几何校正和果蔬采摘的新理念,解决了被遮挡的、自然下垂生长的和非自然下垂生长的果蔬采摘点的定位问题。
Fruit harvesting is a labor-concentrated job. In many countries, withthe senility and lack of labor, the cost of manual harvesting takes a lion'sshare within the total cost of yielding the fruit and vegetables. Yet, ourcountry is a great agricultural country, is rich in yield, variety and exportquantity. But generally speaking, nowadays, the harvesting of the fruitand vegetables mostly depends on the manpower that is high cost but lowefficiency. So, the realization of automatic harvesting is extremely urgent.
     It is a crucial step in realizing the robotic harvesting by using thecomputer vision to segment and recognize the fruit under nature scenes.However, due to the fact that the growth of the fruit under nature scenesbear high randomcity, thus, in order to implement an intact recognitionsystem, we need to resolve six problems including the efficientrecognition of the fruit object under nature illumination, in shadows, when the fruit object partially occluded or similar background colorpossessed; as well as the precise location of the fruit object center andabscission point.
     Aimed at the puzzles mentioned above, the main tasks we have doneare as follows:
     (1) Put forward two new color models LHM and YNM according tothe characteristics of each model, adopted the LHM model afteranalyzing the experimental result. By the principal of the classificationand the clustering characteristic of LHM, we settled the recognition of thefruit partially occluded, under nature illumination or shadow successfully.
     (2) Got two texture features: entropy and energy which candistinguish the fruit and the background by making use of the Gray levelco-occurrence matrix. Integrating the color and texture features as thefollowing step, we solved the recognition of the fruit whose color issimilar to the background.
     (3) Constructed geometry models for the fruit and vegetables, workout the difficulty of locating the center of the fruit; Brought forward thenovel conception of geometrical emendation and fruit harvesting,resolved the location of the fruit which covered the situation that the fruitare partially occluded, develop naturally hang and unnaturally hang.
引文
1.宋健,张铁中,张宾,张红霞.农业机器人的研究现状与发展展望[J].潍坊学院学报,2005,5(4):1-5.
    2.张立彬,计时鸣,胥芳,张宪,万跃华,郑欣荣.农业机器人的主要应用领域和关键技术[J].浙江工业大学学报,2002,30(1):36-41.
    3.王树才.农业机器人的应用领域、特点及支撑技术[J].华中农业大学学报,2005,24:86-90.
    4. Edan Y., Rogozin D., Flash T., Gaines E.. Robotic melon harvesting[J]. IEEE transactions on robotics and automation, 2000, 16(6): 831-834.
    5.应义斌,傅宾忠,蒋亦元,赵匀.机器视觉技术在农业生产自动化中的应用[J].农业工程学报,1999,15(3):199-203.
    6. Edan Y., Miles G. E.. Systems engineering of agricultural robot design[J]. IEEE Transactions on Systems, Man and Cybernetics, 1994, 24(8): 1259-1265.
    7. Sario Y.. Robotics of fruit harvesting: a state-of-the-art review[J]. Journal of Agricultural Engineering Research, 1993, 54(3): 265-280.
    8. Van Kollenburg-Crisan L M, Bontsema J, Wennekes P. Mechatronic system for automatic harvesting of cucumbers[A]. IFAC Control Applications and Ergonomics in Agriculture[C]. Athens, Greece: 1998, 289-293.
    9.汤修映,张铁中.果蔬收获机器人研究综述[J].机器人,2005,27(1):90-96.
    10.赵匀,武传宇,胡旭东,俞高红.农业机器人的研究进展及存在的问题[J].农业工程学报,2003,19(1):20-24.
    11.史光瑚.我国水果业的发展和几点建议[J].果树科学,1998,15(2):1-5.
    12.潘伟光.中韩两国水果业生产成本及价格竞争力的比较[J].国际贸易问题,2005,(10):49-53.
    13. Burks T., Villegas F., Hannan M., Flood S., Sivaraman B. Engineering and horticultural aspects of robotic fruit harvesting: opportunities and constraints[J], HortTechnology, 2003, 15(1): 79-87.
    14. Jimenez A. R., Jain A.K., Ceres R., Pons J.L.. Automatic fruit recognition: A survey and new results using Range/Attenuation images[J]. Pattern Recognition, 1999, 32(10): 1719-1736.
    15.徐丽明,张铁中.果蔬果实收获机器人的研究现状及关键问题和对策[J].农业工程学报,2004,20(5):38-42.
    16. Schertz C. E., Brown G.. K.. Basic considerations in mechanizing citrus harvest[J]. Transactions of the ASAE, 1968, 11(2): 343-346.
    17. Grand D'Esnon A., Rabatel G.., Pellenc R.. A self-propelled robot to pick apples[J]. ASAE paper, 1987, 46(3): 353-358.
    18. Rabatel G.. A vision system for "magali", the fruit picking robot[J]. Int. Conf. Agricultural Engineering, 1988:1-10.
    19. Whittaker A D, Miles G E, Mitchell O R, Gaultney L D. Fruit location in a partially occluded image[J]. Transactions of the ASAE, 1987, 30(3): 591-597.
    20. Tillett RD, Batchelor B J. An algorithm for locating mushrooms in a growing bed[J]. Computers and Electronics in Agriculture, 1991, (6): 191-200.
    21.徐崇庶,张博玲.欧美国家中的农业机器人[J].机器人技术与应用,1998,(3):11-13.
    22.周增产,Bontsema J.,Van Kollenburg-Crisan L..荷兰黄瓜收获机器人的研究开发[J].农业工程学报,2001,17(6):77-80.
    23. Miyanaga T, Fukumo I. Technical report of the institute of agricultural machinery[R]. Omiya, Saitama, Japan, 1998.
    24. Jimenez A R., Ceres R., Pons J. L.. A survey of computer vision methods for locating fruit on trees[J]. Transaction of ASAE, 2000, 43(6): 1911-1920.
    25. Slaughter D. C, Harrel R. Discriminating fruit for robotic harvest using color in natural outdoor scenes[J]. Transactions of the ASAE, 1989, 32(2): 757-763.
    26. Alessio P., Giorgio G... Localization of spherical fruits for robotic harvesting[J]. Machine Vision and Applications, 2001, 13(2): 70-79.
    27.应义斌,章文英,蒋亦元,赵匀.机器视觉技术在农产品收获和加工自动化中的应用[J].农业机械学报,2000,31(3):112-115.
    28.沈维政,张长利,刘振恒.基于计算机视觉的田间杂草识别方法研究[J].农 机化研究,2006,(7):163-165.
    29.胥芳,张立斌,计时鸣.农业机器人视觉传感系统的实现与应用研究[J].农业工程学报,2002,18(4):180-184.
    30.蔡健荣,赵杰文.自然环境下成熟水果的计算机视觉识别[J].农业机械学报,2005,36(2):61-64.
    31.周云山,李强,李红英,王荣本.计算机视觉在蘑菇采摘机器人上的应用[J].农业工程学报,1995,11(4):27—32.
    32.王玲,姬长英.农业机器人采摘棉花的前景展望与技术分析[J].棉花学报,2006,18(2):124-128.
    33.William K.Pratt.数字图像处理[M].第三版.北京:机械工业出版社.2005.
    34.Milan Sonka,Vaclav Hlavac,Roger Boyle.图像处理、分析与机器视觉[M].第二版.北京:人民邮电出版社,2003.
    35.何斌,马天予,王运坚,朱红莲.Visual C++数字图像处理[M].第二版.北京:人民邮电出版社,2003.
    36.王建卫.彩色图像的中值滤波算法的改进与应用[J].哈尔滨商业大学学报(自然科学版),2006,22(4):67-69.
    37.林福宗.多媒体技术基础[M].北京:清华大学出版社,2002.
    38.Heam D,Baker M.P.计算机图形学[M].第二版.北京:电子工业出版社,2003.
    39.贾云德.机器视觉[M].北京:科学出版社,2000.
    40. Deshmukh K.S., Shinde G.N. An Adaptive Color Image Segmentation[J]. Electronic Letters on computer vision and Image Analysis, 2005, 5(4): 12-23.
    41. Reyes-Aldasoro C. C., Bhalerao A.. The Bhattacharyya space for feature selection and its application to texture segmentation[J]. Pattern recognition, 2006, 39(1): 812-826.
    42. Wilbur C.K.W, Albert C.S.C. Bayesian Image Segmentation Using Local Iso-intensity Structural Orientation[J]. IEEE Transactions on Image Processing, 2005, 14(10): 1512-1523.
    43.林开颜,吴军辉,徐立鸿.彩包图像分割方法综述[J].中国图象图形学报,2005,10(1):1-10.
    44.常发俩,刘静,乔谊正.基于自组织神经网络的彩色图像自适应聚类分割[J].控制与决策,2006,21(4):449-452.
    45.任靖,李春平.最小距离分类器的改进算法—加权最小分类距离分类器[J].计算机应用,2005,25(5):992-994.
    46. Pham T D. Image Segmentation using Probabilistic Fuzzy C-Means Clustering[J]. Proceedings of International Conference on Image processing, 2001, 21(3): 722-725.
    47. Arivazhagan S, Ganesan L. Texture Segmentation Using Wavelet Transform[J]. Pattern Recognition Letters, 2003, 24(16): 3197-3203.
    48.赵锋,赵荣椿.纹理分割及特征提取方法综述[J].中国体视学与图像分析,1998,3(4):238-245.
    49.杨淑莹,胡军,曹作良.基于图像纹理分析的目标物体识别方法[J].天津理工学院学报,2001,17(4):31-33.
    50. Zhao Jun, Tow Joel, Jayantha Katupitiya. On -tree fruit recognition using texture properties and color data[J]. IEEE/RSJ International Conference on Intelligent robots and systems, 2005: 3993-3998.
    51. Mena J.B., Malpica J.A.. Color image segmentation based on three levels of texture statistical evaluation[J]. Applied mathematics and computation, 2005, 161: 1-17.
    52. Hammouche K., Diaf M., Postaire J.-G.. A clustering method based on multidimensional texture analysis[J]. Pattern recognition, 2006, 39: 1265-1277.
    53. Materka A., Strzelecki M.. Texture Analysis Methods—A Review[J]. COST B11 report, Brussels, 1998:1-33.
    54.薄华,马缚龙,焦李成.图像纹理的灰度共生矩阵计算问题的分析[J].电子学报,2006,34(1):155-158.
    55.周宇,覃征.聚类分析中特征选择的研究[J].计算机应用研究,2006,(5):55-58.
    56. Cheng H.D, Jiang X H, Sun Y., Wang J.. Color image segmentation: advances and prospects[J]. Pattern Recognition, 2001, (34): 2259-2281.
    57.郎锐.数字图像处理学Visual C++实现[M].北京:希望电子出版社,2003.
    58. Nevatia. A color edge detector and its use in scene segmentation[J]. IEEE Transactions on Systems, man and Cybemetics[J]. 1977, 7(11): 820-826.
    59. Zeno S D. A note on the gradient of a multi-image[J]. Computer Vision and Image Processing, 1986, 33(1): 116-128.
    60. Shizaki A. Edge extraction using entropy operator[J]. Computer Vision and Image Processing, 1986, 33(1): 1-9.
    61. Fan J, Aref W G, Hacid M, Elmagarmid A K. An improved automatic isotropic color edge detection technique[J]. Pattern Recognition Letters, 2001, 22(13): 1419-1429.
    62.杨敏,王金庭.肤色检测中的颜色空间[J].福建电脑,2006,(7):48-49.
    63.王雅琴,高华.自然环境下水果图像分割与定位研究[J].计算机工程,2004,30(13):128-129.
    64.赵俊娟,尹京苑,单新建.基于形状特征的高分辨率遥感影像目标分割[J].测绘通报,2005,(1):10-13.
    65.杨育彬,陈世福,林珲.一种基于颜色连通的图像纹理检索新方法[J].电子学报,2005,33(1):57-62.
    66.张伟,毛罕平,李萍萍,夏志军.缺素叶片图像颜色和纹型特征参数提取的研究[J].农机化研究,2003,(2):60-63.
    67.于铂,郑丽敏,田立军.基于颜色和纹理特征提取彩色图像的有意义区域[J].计算机工程,2006,32(3):206-211.
    68.徐德启,汪志华.综合纹理和颜色的图像分割方法[J].计算技术与自动化,2002,21(3):77-83.
    69.郭捷,施鹏飞.基于颜色和纹理分析的车牌定位方法[J].中国图象图形学报,2002,7(5):472-476.
    70. Jolly M.P.D., Gupta A.. Color and texture fusion: application to aerial image segmentation and GIS updating[J]. Image and vision computing, 2000, 18(10): 823-832.
    71.刘忠伟,章毓晋.综合利用颜色和纹理特征的图像检索[J].通信学报,1999,20(5):36-40.
    72.黄元元,郭丽,杨静宇.基于目标区域颜色与纹理特征的图像检索[J].南京 理工大学学报,2003,27(3):286-289.
    73. Ranganathan N, Mehrotra R, Subramanian S. A High Speed Systolic Architecture for Labeling Connected Components in an Image[J]. IEEE Transactions on Systems, man, and Cybernetics, 1995, 25(3): 415-423.
    74. Yang Yang, Zhang David. A Novel Scan clustering algorithm for identifying connected components in digital images[J]. Image and Vision computing, 2003, 21: 459-472.
    75.徐利华,陈早生.二值图像中的游程编码区域标记[J].光电工程,2004,31(6):63-65.
    76.王晶,张艳宁,骆剑承,明冬萍.针对高分辨率遥感影像分割的改进连通域标记方法[J].计算机工程和应用,2005,10:37-39.
    77.王雅琴,高华.类圆形物体的特征描述[J].计算机工程,2004,30(1):158-162.
    78.曹茂永,孙农亮,郁道银.几种边界特征描述方法的比较研究[J].光学技术,2003,29(3):284-287.
    79. Freeman H., Shapira R.. Determining the minimum-area encasing rectangle for an arbitrary closed curve[J]. Communications of the ACM, 1975, 18(7): 409-413.
    80. Pei S C, Horng JH. Circular arc detection based on Hough transform[J]. Pattern recognition letters, 1995, 16(6): 615-625.
    81. Ioannou D, Huda W, Laine A F. Circle recognition through a 2D Hough Transform and radius histogramming [J].Image and vision computing. 1999, 17(1): 15-26.
    82. Kim H S, Kim J H. A two-step circle detection algorithm from the intersecting chords[J]. Pattern recognition letters, 2001, 22(6): 787-798.
    83. Lei Y, Wong K C. Ellipse detection based on symmetry[J]. Pattern recognition letters, 1999, 20: 41-47.
    84. Chen The-chun, Chung Kuo-liang. An Efficient Randomized Algorithm for Detecting Circles[J]. Computer vision and image understanding, 2001, 83(2): 172-191.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700