基于图像的昆虫分类识别研究综述
|
摘要
近年来,在自动化识别昆虫技术中,基于图像的昆虫分类识别研究逐渐发展起来。本文在查阅了近20年来具有代表性文章的基础上,对基于图像的昆虫分类识别研究的进展进行综述,介绍了图像获取、图像处理、分类方法三方面,并分析了现有方法的优缺点。最后展望了基于图像的昆虫分类识别研究的研究趋势和发展方向。
In recent years,for automatic insect recognition technology,image-based insect classification and recognition has been gradually developed. This paper reviews the research progress of image-based insect classification and recognition technology from three aspects consisting of image acquisition,image processing and classification,and analyzes the advantages and disadvantages of the existing methods. Finally,the research trend and development direction of image-based insect classification and recognition are prospected.
In recent years,for automatic insect recognition technology,image-based insect classification and recognition has been gradually developed. This paper reviews the research progress of image-based insect classification and recognition technology from three aspects consisting of image acquisition,image processing and classification,and analyzes the advantages and disadvantages of the existing methods. Finally,the research trend and development direction of image-based insect classification and recognition are prospected.
引文
[1]阎锡海,王延锋,李延清.昆虫起源、进化及其原因模糊性研究[J].延安大学学报(自然科学版),2003,22(1):81-84.
[2] YANG Heping,MA Chunsen,WEN Hui,et al. A tool for developing an automatic insect identification system based on w ing outlines[J]. Scientific Reports,2015,5:12786.
[3] ZAYAS I Y,FLINN P W. Detection of insects in bulk wheat samples w ith machine vision[J]. Transactions of the ASAE,1998,41(3):883-888.
[4]YAO Qing,LV Jun,LIU Qingjie,et al. An insect imaging system to automate rice light-trap pest identification[J]. Journal of Integrative Agriculture,2012,11(6):978-985.
[5]吕军,姚青,刘庆杰,等.基于模板匹配的多目标水稻灯诱害虫识别方法的研究[J].中国水稻科学,2012,26(5):619-623.
[6]杨红珍,张建伟,李湘涛,等.基于图像的昆虫远程自动识别系统的研究[J].农业工程学报,2008,24(1):188-192.
[7]冼鼎翔,姚青,杨保军,等.基于图像的水稻灯诱害虫自动识别技术的研究[J].中国水稻科学,2015,29(3):299-304.
[8]邱道尹,张红涛,陈铁军,等.基于机器视觉的储粮害虫智能检测系统软件设计[J].农业机械学报,2003,34(2):83-85.
[9]WEEKS P J D,O'NEILL M A,GASTON K J,et al. Automating insect identification:Exploring the limitations of a prototype system[J]. Journal of Applied Entomology,2003,123(1):1-8.
[10] ARBUCKLE T, SCHRDER S, STEINHAGE V, et al.Biodiversity informatics in action:Identification and monitoring of bee species using ABIS[C]//Proc. 15thInternational Symposium Informatics for Environmental Protection. Zürich:CiteSeer,2001:425-430.
[11]FAVRET C,SIERACKI J M. Machine vision automated species identification scaled tow ards production levels[J]. Systematic Entomology,2016,41(1):133-143.
[12] WEN Chenglu, GUYER D. Image-based orchard insect automated identification and classification method[J]. Computers and Electronics in Agriculture,2012,89(3):110-115.
[13]WEN Chenglu,GUYER D E,LI Wei. Local feature-based identification and classification for orchard insects[J]. Biosystems Engineering,2009,104(3):299-307.
[14]LARIOS N,DENG Hongli,ZHANG Wei,et al. Automated insect identification through concatenated histograms of local appearance features[C]//IEEE Workshop on Applications of Computer Vision. Austin,Texas:IEEE,2007:26.
[15]SARPOLA M J,PAASCH R K,MORTENSEN E N,et al. An aquatic insect imaging system to automate insect classification[J].Transactions of the Asabe,2008,51(6):2217-2225.
[16]YALCIN H. Vision based automatic inspection of insects in pheromone traps[C]//2015 Fourth International Conference on Agro-Geoinformatics. Istanbul,Turkey:IEEE,2015:333-338.
[17] SOLIS-SNCHEZ L O, CASTAEDA-MIRANDA R,GARCA-ESCALANTE J J, et al. Scale invariant feature approach for insect monitoring[J]. Computers and Electronics in Agriculture,2011,75(1):92-99.
[18]杨信廷,刘蒙蒙,许建平,等.自动监测装置用温室粉虱和蓟马成虫图像分割识别算法[J].农业工程学报,2018,34(1):164-170.
[19] XIE Chengjun, ZHANG Jie, LI Rui, et al. Automatic classification for field crop insects via multiple-task sparse representation and multiple-kernel learning[J]. Computers&Electronics in Agriculture,2015,119:123-132.
[20]张永玲,姜梦洲,俞佩仕,等.基于多特征融合和稀疏表示的农业害虫图像识别方法[J].中国农业科学,2018,51(11):2084-2093.
[21]陈月华,胡晓光,张长利.基于机器视觉的小麦害虫分割算法研究[J].农业工程学报,2007,23(12):187-191.
[22]甄彤,范艳峰,邹炳强,等.谷物害虫图像识别中特征值提取技术的研究[J].微电子学与计算机,2004,21(12):111-115.
[23]GASSOUMI H,PRASAD R,ELLINGTON J. Neural networkbased approach for insect classification in cotton ecosystems[C]//International Conference on Intelligent Technologies(In Tech 2000).Bangkok,Thailand:Kluwer Academic Publishers,2000:1-7.
[24]AL-SAQER S M,HASSAN G M. Artificial neural networks based red palm Weevil(Rynchophorus Ferrugineous,Olivier)recognition system[J]. American Journal of Agricultural&Biological Science,2011,6(3):356-364.
[25]程曦,吴云志,张友华,等.基于深度卷积神经网络的储粮害虫图像识别[J].中国农学通报,2018,34(1):154-158.
[26]RUSSELL K N,DO M T,HUFF J C,et al. Introducing SPIDAWeb:Wavelets,neural netw orks and internet accessibility in an image-based automated identification system[M]//MACLEOD N.Automated Taxon identification in systematics:Theory,approaches and applications.New York:CRC Press,2007:131-152.
[27]FRANCOY T M,WITTMANN D,DRAUSCHKE M,et al.Identification of Africanized honey bees through w ing morphometrics:Tw o fast and efficient procedures[J]. Apidologie,2008,39(5):488-494.
[28]WANG Jiangning,LIN Congtian,JI Liqiang,et al. A new automatic identification system of insect images at the order level[J]. Knowledge-Based Systems,2012,33(3):102-110.
[29]WANG Jiangning, JI Liqiang, LIANG Aiping, et al. The identification of butterfly families using content-based image retrieval[J]. Biosystems Engineering,2012,111(1):24-32.
[30]FAITHPRAISE F,BIRCH P,YOUNG R,et al. Automatic plant pest detection and recognition using k-means clustering algorithm and correspondence filters[J]. International Journal of Advanced Biotechnology and Research,2013,4(2):189-199.
[31]MAYO M,WATSON A T. Automatic species identification of live moths[J]. Know ledge-Based Systems,2007,20(2):195-202.
[32]LECUN Y. What's wrong with deep learning?[EB/OL].[2015-06-10]. http://www. pamitc. org/cvpr15/files/lecun-20150610-cvpr-keynote.pdf,2015.
[33]TOFILSKI A. Draw Wing,a program for numerical description of insect w ings[J]. Journal of Insect Science,2004,4(1):17.
[34]LEOW L K,CHEW L L,CHONG V C,et al. Automated identification of copepods using digital image processing and artificial neural netw ork[J]. Bmc Bioinformatics, 2015, 16(S18):S4.
[35]LU An,HOU Xinwen,CHEN Xiaolin,et al. Insect species recognition using sparse representation[C]//Proceedings of the British M achine Vision Conference. Aberystw yth, UK:British M achine Vision Association,2010,108:1-10.
[36]LU An,HOU Xinwen,LIU Chenglin,et al. Insect species recognition using discriminative local soft coding[C]//2012 21st International Conference on Pattern Recognition. Tsukuba,Japan:IEEE,2012:1221-1224.
[37]LYTLE D A,MARTNEZ-MUOZ G,ZHANG W,et al.Automated processing and identification of benthic invertebrate samples[J]. Journal of the North American Benthological Society,2010,29(3):867-874.
[38]LOWE D G. Object recognition from local scale-invariant features[C]//Proceedings of the Seventh IEEE International Conference on Computer Vision(ICCV). Corfu,Greece:IEEE,1999:1150.
[39]WEN Chenglu,WU Daoxi,HU Huosheng,et al. Pose estimationdependent identification method for field moth images using deep learning architecture[J]. Biosystems Engineering,2015,136:117-128.
[40]HAN J,KAMBER M. Data mining concept and techniques[M].San M eteo,California:M organ Kaufmann,2006.
[41]BERSON A,SMITH S,THEARLING K. Building data mining applications for CRM[M]. New York:M c Graw-Hill,Inc,2000.
[42]Da SILVA F L,SELLA M L G,FRANCOY T M,et al.Evaluating classification and feature selection techniques for honeybee subspecies identification using w ing images[J].Computers and Electronics in Agriculture,2015,114(C):68-77.
[43]BONIECKI P,KOSZELA K,PIEKARSKA-BONIECKA H,et al. Neural identification of selected apple pests[J]. Computers and Electronics in Agriculture,2015,110:9-16.
[44]刘德营,王家亮,林相泽,等.基于卷积神经网络的白背飞虱识别方法[J].农业机械学报,2018,49(5):51-56.
[45]周爱明,马鹏鹏,席天宇,等.基于深度学习的蝴蝶科级标本图像自动识别[J].昆虫学报,2017,60(11):1339-1348.
[46]谢娟英,侯琦,史颖欢,等.蝴蝶种类自动识别研究[J].计算机研究与发展,2018,55(8):1609-1618.
[47]樊景超.基于MobileNets的果园害虫分类识别模型研究[J].天津农业科学,2018,24(9):11-13,26.
[2] YANG Heping,MA Chunsen,WEN Hui,et al. A tool for developing an automatic insect identification system based on w ing outlines[J]. Scientific Reports,2015,5:12786.
[3] ZAYAS I Y,FLINN P W. Detection of insects in bulk wheat samples w ith machine vision[J]. Transactions of the ASAE,1998,41(3):883-888.
[4]YAO Qing,LV Jun,LIU Qingjie,et al. An insect imaging system to automate rice light-trap pest identification[J]. Journal of Integrative Agriculture,2012,11(6):978-985.
[5]吕军,姚青,刘庆杰,等.基于模板匹配的多目标水稻灯诱害虫识别方法的研究[J].中国水稻科学,2012,26(5):619-623.
[6]杨红珍,张建伟,李湘涛,等.基于图像的昆虫远程自动识别系统的研究[J].农业工程学报,2008,24(1):188-192.
[7]冼鼎翔,姚青,杨保军,等.基于图像的水稻灯诱害虫自动识别技术的研究[J].中国水稻科学,2015,29(3):299-304.
[8]邱道尹,张红涛,陈铁军,等.基于机器视觉的储粮害虫智能检测系统软件设计[J].农业机械学报,2003,34(2):83-85.
[9]WEEKS P J D,O'NEILL M A,GASTON K J,et al. Automating insect identification:Exploring the limitations of a prototype system[J]. Journal of Applied Entomology,2003,123(1):1-8.
[10] ARBUCKLE T, SCHRDER S, STEINHAGE V, et al.Biodiversity informatics in action:Identification and monitoring of bee species using ABIS[C]//Proc. 15thInternational Symposium Informatics for Environmental Protection. Zürich:CiteSeer,2001:425-430.
[11]FAVRET C,SIERACKI J M. Machine vision automated species identification scaled tow ards production levels[J]. Systematic Entomology,2016,41(1):133-143.
[12] WEN Chenglu, GUYER D. Image-based orchard insect automated identification and classification method[J]. Computers and Electronics in Agriculture,2012,89(3):110-115.
[13]WEN Chenglu,GUYER D E,LI Wei. Local feature-based identification and classification for orchard insects[J]. Biosystems Engineering,2009,104(3):299-307.
[14]LARIOS N,DENG Hongli,ZHANG Wei,et al. Automated insect identification through concatenated histograms of local appearance features[C]//IEEE Workshop on Applications of Computer Vision. Austin,Texas:IEEE,2007:26.
[15]SARPOLA M J,PAASCH R K,MORTENSEN E N,et al. An aquatic insect imaging system to automate insect classification[J].Transactions of the Asabe,2008,51(6):2217-2225.
[16]YALCIN H. Vision based automatic inspection of insects in pheromone traps[C]//2015 Fourth International Conference on Agro-Geoinformatics. Istanbul,Turkey:IEEE,2015:333-338.
[17] SOLIS-SNCHEZ L O, CASTAEDA-MIRANDA R,GARCA-ESCALANTE J J, et al. Scale invariant feature approach for insect monitoring[J]. Computers and Electronics in Agriculture,2011,75(1):92-99.
[18]杨信廷,刘蒙蒙,许建平,等.自动监测装置用温室粉虱和蓟马成虫图像分割识别算法[J].农业工程学报,2018,34(1):164-170.
[19] XIE Chengjun, ZHANG Jie, LI Rui, et al. Automatic classification for field crop insects via multiple-task sparse representation and multiple-kernel learning[J]. Computers&Electronics in Agriculture,2015,119:123-132.
[20]张永玲,姜梦洲,俞佩仕,等.基于多特征融合和稀疏表示的农业害虫图像识别方法[J].中国农业科学,2018,51(11):2084-2093.
[21]陈月华,胡晓光,张长利.基于机器视觉的小麦害虫分割算法研究[J].农业工程学报,2007,23(12):187-191.
[22]甄彤,范艳峰,邹炳强,等.谷物害虫图像识别中特征值提取技术的研究[J].微电子学与计算机,2004,21(12):111-115.
[23]GASSOUMI H,PRASAD R,ELLINGTON J. Neural networkbased approach for insect classification in cotton ecosystems[C]//International Conference on Intelligent Technologies(In Tech 2000).Bangkok,Thailand:Kluwer Academic Publishers,2000:1-7.
[24]AL-SAQER S M,HASSAN G M. Artificial neural networks based red palm Weevil(Rynchophorus Ferrugineous,Olivier)recognition system[J]. American Journal of Agricultural&Biological Science,2011,6(3):356-364.
[25]程曦,吴云志,张友华,等.基于深度卷积神经网络的储粮害虫图像识别[J].中国农学通报,2018,34(1):154-158.
[26]RUSSELL K N,DO M T,HUFF J C,et al. Introducing SPIDAWeb:Wavelets,neural netw orks and internet accessibility in an image-based automated identification system[M]//MACLEOD N.Automated Taxon identification in systematics:Theory,approaches and applications.New York:CRC Press,2007:131-152.
[27]FRANCOY T M,WITTMANN D,DRAUSCHKE M,et al.Identification of Africanized honey bees through w ing morphometrics:Tw o fast and efficient procedures[J]. Apidologie,2008,39(5):488-494.
[28]WANG Jiangning,LIN Congtian,JI Liqiang,et al. A new automatic identification system of insect images at the order level[J]. Knowledge-Based Systems,2012,33(3):102-110.
[29]WANG Jiangning, JI Liqiang, LIANG Aiping, et al. The identification of butterfly families using content-based image retrieval[J]. Biosystems Engineering,2012,111(1):24-32.
[30]FAITHPRAISE F,BIRCH P,YOUNG R,et al. Automatic plant pest detection and recognition using k-means clustering algorithm and correspondence filters[J]. International Journal of Advanced Biotechnology and Research,2013,4(2):189-199.
[31]MAYO M,WATSON A T. Automatic species identification of live moths[J]. Know ledge-Based Systems,2007,20(2):195-202.
[32]LECUN Y. What's wrong with deep learning?[EB/OL].[2015-06-10]. http://www. pamitc. org/cvpr15/files/lecun-20150610-cvpr-keynote.pdf,2015.
[33]TOFILSKI A. Draw Wing,a program for numerical description of insect w ings[J]. Journal of Insect Science,2004,4(1):17.
[34]LEOW L K,CHEW L L,CHONG V C,et al. Automated identification of copepods using digital image processing and artificial neural netw ork[J]. Bmc Bioinformatics, 2015, 16(S18):S4.
[35]LU An,HOU Xinwen,CHEN Xiaolin,et al. Insect species recognition using sparse representation[C]//Proceedings of the British M achine Vision Conference. Aberystw yth, UK:British M achine Vision Association,2010,108:1-10.
[36]LU An,HOU Xinwen,LIU Chenglin,et al. Insect species recognition using discriminative local soft coding[C]//2012 21st International Conference on Pattern Recognition. Tsukuba,Japan:IEEE,2012:1221-1224.
[37]LYTLE D A,MARTNEZ-MUOZ G,ZHANG W,et al.Automated processing and identification of benthic invertebrate samples[J]. Journal of the North American Benthological Society,2010,29(3):867-874.
[38]LOWE D G. Object recognition from local scale-invariant features[C]//Proceedings of the Seventh IEEE International Conference on Computer Vision(ICCV). Corfu,Greece:IEEE,1999:1150.
[39]WEN Chenglu,WU Daoxi,HU Huosheng,et al. Pose estimationdependent identification method for field moth images using deep learning architecture[J]. Biosystems Engineering,2015,136:117-128.
[40]HAN J,KAMBER M. Data mining concept and techniques[M].San M eteo,California:M organ Kaufmann,2006.
[41]BERSON A,SMITH S,THEARLING K. Building data mining applications for CRM[M]. New York:M c Graw-Hill,Inc,2000.
[42]Da SILVA F L,SELLA M L G,FRANCOY T M,et al.Evaluating classification and feature selection techniques for honeybee subspecies identification using w ing images[J].Computers and Electronics in Agriculture,2015,114(C):68-77.
[43]BONIECKI P,KOSZELA K,PIEKARSKA-BONIECKA H,et al. Neural identification of selected apple pests[J]. Computers and Electronics in Agriculture,2015,110:9-16.
[44]刘德营,王家亮,林相泽,等.基于卷积神经网络的白背飞虱识别方法[J].农业机械学报,2018,49(5):51-56.
[45]周爱明,马鹏鹏,席天宇,等.基于深度学习的蝴蝶科级标本图像自动识别[J].昆虫学报,2017,60(11):1339-1348.
[46]谢娟英,侯琦,史颖欢,等.蝴蝶种类自动识别研究[J].计算机研究与发展,2018,55(8):1609-1618.
[47]樊景超.基于MobileNets的果园害虫分类识别模型研究[J].天津农业科学,2018,24(9):11-13,26.