摘要
本文将现代光学测试技术、计算机技术和光电子技术相结合,研究了基于面阵CCD、成像物镜和微机的微小尺寸检测系统。检测系统将被测工件图像通过CCD相机成像,该模拟信号经过图像采集卡的A/D转换,转换为数字信号后,送入微机存储在内存中,再通过编写的程序对工件图像进行图像处理。本文解决了非线性平滑、阈值确定和边缘提取等关键技术,利用边缘轮廓跟踪的方法获取工件的边缘轮廓图像,系统可精确的确定工件的边缘轮廓曲线。本系统进行了大量的实验,以微米级工件、圆形工件和矩形工件等工件测量为例,说明了编写工件测量程序的思想,方法简单,实现了二维尺寸的高精度、非接触、实时自动检测。系统结构简单,易于操作,对环境要求宽松。
在二维尺寸非接触自动测试的基础上,基于双目立体视觉技术本文研究了三维尺寸的非接触自动检测,对双目立体视觉技术的摄像机标定、特征提取和特征立体匹配等内容做了详尽的研究。
在摄像机标定部分,本文提出了对Tsai两步法的改进算法,完成了对双目视觉摄像机的标定。在介绍立体视觉三维测量的基本原理的基础上,研究摄像机标定算法,运用RAC"两步法”标定技术,利用Levenberg-Marquardt非线性优化算法,并对CCD摄像机进行了标定实验。
在特征提取部分,对Harris角点提取算法、SUSAN角点提取算法和SIFT特征提取算法进行了分析。通过不同图片对上述三种特征点提取算法进行比较和分析,实验表明SIFT特征提取算法提取的特征点数目较多,有利于作为匹配基元进行下一步的立体匹配,并且图片发生旋转时,SIFT特征提取算法检测出来的特征点在位置和数目上几乎没有变化。
在立体匹配部分,对完全可见的物体表面和部分可见的物体表面进行特征匹配分别进行了研究,得到对应的匹配公式。分别实现了Harris角点匹配和SIFT匹配算法,并对这两种方法的匹配结果进行比较和分析。实验结果表明基于SIFT特征点的匹配算法要优于基于Harris角点匹配算法。
本系统以VisualC++为开发平台结合图像处理的OpenCV库函数合理地构建了一个逻辑清晰、工作稳定的软件框架,满足了系统测试要求。在所开发的实验系统上,分别以书包和花瓶图片为例,开展了三维测量实验,完成了测量任务。
In this paper modern optical test technique, computer technique and photoelectric technique are combined and micro-size detection based on the CCD matrix, imaging objective and computer is researched. The detection system images the measured workpiece by the CCD camera, the analog signal is transferred to the digital signal by the A/D converter on the image collector, the digital signal is stored in the memory and the workpiece image is processed by the compiled program. The paper solves the key technologies of non-linearity smooth, the threshold value selection and edge abstraction. the edge contour curve of workpiece can be precisely determined with the method of the edge contour tracking to obtain the edge contour image of workpiece. The system carried out experiments and explained the program ideas with the example of the nanoscale workpiece, circular workpiece and rectangle workpiece. It's easy to realize 2-D high accuracy, non-contact, real time and automatic measurement. The system has a simple structure and can be easily operated without the strict requests for environment.
In this paper non-contact automatic measurement of three dimension is researched based on non-contact automatic measurement of two-dimension and binocular stereo vision technology. The paper studies the camera calibration, feature extraction and feature stereo matching of binocular stereo vision technology in detail.
In the part of camera calibration, improved algorithm of Tsai-two-step method is proposed to achieve the binocular vision camera calibration. The paper researched the camera calibration algorithm based on the stereovision 3-D measurement principles and carried out the calibration experiments by employing the RAC two-step calibration technology and Levenberg-Marquardt nonlinear optimal algorithm.
In the part of feature extraction, the paper analyses the Harris corner extraction algorithm and SUSAN corner extraction algorithm and SIFT feature extraction algorithm. The three feature extraction algorithms of different pictures are compared and analyzed. Experimental results show that the extracted feature points of SIFT feature extraction algorithm are more than other methods and it's beneficial to realize the further stereo matching of the matched base unit. When the picture is revolved, the position and number of the detected feature points are hardly changed.
In the part of stereo matching, the objective surfaces of full-visible and part-visible are feature matched respectively and the matching formulas are obtained. The Harris corner matching and SIFT matching algorithms are implemented and the matching results of the two methods are compared and analyzed. Experiment results show that the performance of the SIFT matching algorithm is better than that of the Harris algorithm.
A software framework with clear logic and stable performance based on the image processing library function OpenCV in the Visual C++ development platform is constructed. The system measurement demand is satisfied. In the developed experiments system,3-D measurement experiments are carried out with the examples of schoolbag and vase and performed the measurement tasks.
引文
[1]罗宇华.计算机视觉.北京:人民邮电出版社,1990
[2]章毓晋.图像分割.北京:科学出版社,2001
[3]贾云得.机器视觉.北京:科学出版社,2000
[4]段发阶,张洪涛,叶声华.视觉技术在电子网板检测中的应用研究,光电子.激光,2001,12(19)
[5]Davies.E.R. Design of cost-effective systems for the inspection of certain food products during manufacture. Proceediings forth International Conference on Robot Vision.1984
[6]Manbir.S, Sodhi and KHALIL. Surface roughness monitoring using computer vision. Mach Tools Manufact.1985, vol. 36(7)
[7]张书慧,陈晓光.苹果、桃等农副产品品质检测与分级图像处理系统的研究.农业工程学报,1999,15(1)
[8]王丰元,周一鸣.种子形状参数检测的计算机图像处理技术.农业工程学报,2001,16(1)
[9]Trika S N, Kashyap R L. Geometric Reasoning for Extraction of Manufacturing Features in Orented Polyhedrons[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,1994,16(11):1087-1100
[10]Tsai Du Ming, Chen Jeng Jong, Chen Jeng Fung. Vision system for surface roughness assessment using neural networks [J]. International Journal of Advanced Manufacturing Technology,1998,14(6):412-422
[11]Miura J, Ikeuchi K. Task oriented generation of visual sensing strategies in assembly tasks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,1998.20(2):126-138
[12]Jennings R B, Bright G Machine vision and intelligence incorporating motion control[J]. Assembly Automation, 1999,19(1):55-58
[13]Franci Lahajnar, Stanislav Kovacic. Machine vision system forpositioning and partverification of gas oil filters based on eigenimages[C]. Proceedings of SPIE. San Jose,2000(3966):220-227
[14]Fabrice Meriaudeau, Anne, Claire Legrand. Machine vision systems in the metallurgy industry [C]. Proceedings of SPIE. San Jose,2000(3966):228-237.
[15]Bradley C, Wong Y S. Surface Texture Indicators of Tool Wear-A Machine Vision Approach [J]. The International Journal of Advanced Manufacturing Technology,2001(4):435-443
[16]Gupta Mano, J Raman Shivakumar. Machine vision assisted characterization of machined surfaces [J]. International Journal of Production Research,2001,39 (4):759-784
[17]Lahajnar F, Bernard R, Pernus F, Kovacic S. Machine vision system for inspecting electric plates [J]. Computers in Industry,2002,47(1):113-122
[18]Pierrick Bourgeat, Fabrice Meriaudeau. Defect detection and classification on metallic parts[C]. Proceedings of SPIE. San Jose,2002(4664):182-189
[19]Yan Jiajun, De Sam Lazaro, Anthony. Reverse Engineering of Sheet Metal Parts Using Machine Vision[C].2003 ASME Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Chicago, IL,United States:2003
[20]Eladawi A E, Gadelmawla E S, Elewa IM. An application of computervision forprogramming computer numerical control machines [J]. Proceedings of the Institution of Mechanical Engineers.2003,217 (9):1315-1324
[21]O Leary Paul. Machine vision for feedback control in a steel rollingmill [J]. Computers in Industry,2005,56(8): 97-1004
[22]David Kerr, James Pengilley, Robert Garwood. Assessment and visualization of machine tool wear using computer vision [J]. The International Journal of Advanced Manufacturing Technology,2006,28 (7-8):781-791
[23]Jackson M J, Robinson G M, Hyde L J, Rhodes R. Neural image processing of the wear of cutting tools coated with thin films[J]. Journal of Materials Engineering and Performance,2006,15(2):223-229
[24J廖强,周忆,米林,徐宗俊.机器视觉在精密测量中的应用[J].重庆大学学报(自然科学版).2002(25)6:1-4
[25]张志云.基于图像处理的高精密视觉检测系统[D].广州:广东工业大学,2006
[26]王桂棠,朱妙贤,吴黎明等.基于机器视觉的活塞环闭口间隙自动检测[J].现代制造工程,2005(11):80-82
[27]雷良育,周晓军,潘明清.基于机器视觉的轴承内外径尺寸检测系统[J].农业机械学报,2005(3):131-134
[28]商俊敏,宫闽军等.基于机器视觉的在线轴承检测系统[J].组合机床与自动化加工技术,2004,18(8)
[29]雷良育,李秀莲,商俊敏,吴瑞明.齿轮外表视觉检测系统设计[J].机床与液压,2004(6):155-157
[30]唐宇慧,杨敏,叶邦彦等.基于机器视觉的圆轴直径精密检测[J].现代制造工程,2004(9):67-69
[31]刘中坡,杜宝江,张杰.基于机器视觉的零件尺寸自动测量系统[J].机械设计与制造,2006,166(2):47-49
[32]高飞,石米娜等.基于机器视觉的机械零件自动精密测量[J].试验技术与试验机,2006,24(2):29-32
[33]刘兆妍,马翠红,刘兆妮.基于机器视觉的机械零件测量技术[J].机械设计与制造,2005,34(7):144-146
[34]张悦,孔谅,王钟炜等.防松垫片质量在线图像监控[J].现代制造工程,2006(7):85-87
[35]吴春凌.生产线零件编号检测系统的计算机视觉研究[J].现代制造工程,2006(4):101-103
[36]胡兴军,唐向阳,张勇.机器视觉技术及其在汽车制造质量检测中的应用[J].现代零部件,2005(11):96-101
[37]赵颖全,杨军.西门子机器视觉系统在PET饮料瓶缺陷检测中的应用[J].E时代自动化行业应用,2006(4):123-124
[38]郭建强.BGA全自动植球机视觉检测和自动对准控制技术研究[D].合肥:合肥工业大学,2006
[39]左建中,张新荣,王刚,张钢.集成电路芯片管脚尺寸自动检测的研究与实现[J].制造业自动化,2000,22(9):28-30
[40]龙腾宇.基于PC的钻尖磨床数控系统及钻头视觉定位检测研究[D].长沙:湖南大学,2004
[4 1 ]毛锋,莫健华等.基于计算机视觉的机床自寻位在无模渐进成形设备中的实现[J].锻压技术,2005,30(6):33-36
[42]王全义.基于机器视觉的金属板材数控渐进成形加工轨迹坐标对位研究[D].武汉:华中科技大学,2005
[43]王全义,莫健华等.金属板材数控渐进成形技术及加工轨迹坐标对位研究[J].锻压装备与制造技术,2005,40(3)
[44]武琳璞.基于计算机视觉的凸轮磨削自动定位与在线检测技术研究[D].秦皇岛:燕山大学,2005
[45]刘华波.机器视觉技术在PCB V割机上的应用研究[D].重庆:重庆大学,2005
[46]滕靖.基于数字图像的无夹具定位的技术研究[D].武汉:武汉理工大学,2006
[47]张少军,苟中魁,李庆利等.利用数字图像处理技术测量直齿轮几何尺寸.光学精密工程.2004,12
[48]T.Kanade. Development of a video-rate stereo machine. Image Understanding Workshop,1994:549-557
[49]YANG Yuxiao, XIONG Kaili, ZHOU Jian, et al. New Method for 2D Image-detection in Layer-layer 3D Testing System Semiconductor Photonics and Technology Nov.2003,9(4):256-259,
[50]许昌,周铭,骆瑞伦等.基于面阵CCD成像技术的测量仪器系统的研制.仪器仪表学报.2001,22(4):218~220
[51]刘成忠.刘健强.数字图像处理技术在面阵CCD自动检测系统中的应用.电脑开发与应用.2003,16(3):23-26
[52]劲峰,陈清,韩晓日等.数字图像处理技术在蔬菜叶面积测中的应用.农业工程学报.18(4):155-159
[53]洪海涛,赵辉.图像技术用于零件尺寸测量的研究.仪器仪表学报.2006,22(3):213~215
[54]刘丽梅,孙玉荣,李莉.中值滤波技术发展研究.云南师范大学学报.2004,24.(1):23-27
[55]H. Hwang, R. A. Haddad. Adaptive Median Filters:New Algorithms and Results. IEEE Transactions on image processing.1995,4(4):49-9502
[56]Xiahua Yang, Peng Seng Toh. Adaptive Fuzzy Multilevel Median Filter. IEEE Transactions on image processing, May 1995.4(5):680-682
[57]李江,程健,周鑫.数字图像处理中多窗口下的自适应中值滤波.计算机工程.2003,17(29):154-156
[58]杨淑莹.VC++图像处理程序设计.北京:清华大学出版社,2005:143-151
[59]Xiahua Yang, Peng Seng Toh. Adaptive Fuzzy Multilevel Median Filter. IEEE Transactions on image processing, May 1995,4(5):680-682
[60]何斌,马天予,运坚等.Visual C++数字图像处理.北京:人民邮电出版社,2001:78-80
[61]王茜蓓,彭中,刘莉.一种基于自适应阈值的图像分割算法.北京理工大学学报.2003,23(4):521-524
[62]YANG Yu-xiao, XIONG Kai-li. ZHOU Jian, et al. New Method for 2D Image-detection in Layer-layer 3D Testing System Semiconductor Photonics and Technology Nov.2003,.9(4):256-259
[63]于继龙,张铁强,郑咏梅.实时计算CCD成像图像面积的研究.光学仪器.1996,18(6):16-19
[64]张勇,王国栋,冯红梅.用Visual C++实现PLC实时监控.青岛科技大学学报.2004,25(4):354-358
[65]朱训生,王超.各种球度测量方法的分析与展望.机械制造.2003,41(469):34-36
[66]刘东月,姜淑华,陈方涵,王文生.玻璃微珠球度测试研究.长春理工大学学报.2008,31(1)
[67]S.Birchfield, C.Tomas. Depth discontinuities by pixel-to-pixel stereo. International Journal of Computer Vision.1999, 35(3):269-293
[68]唐志健.基于立体视觉的深度信息恢复技术研究:[硕士学位论文].黑龙江大庆:大庆石油学院,2006
[69]姜淑华,任延俊,王文生.玻璃微珠球度自动测试.光学学报.2008,28(12).EI收录
[70]姜淑华,刘东月,王文生.基于显微透镜-面阵CCD的微孔自动测试研究.仪器仪表学报.2008,29(4)
[71]Jiang shuhua, Wang wensheng, Li mingqiu,et al. Study on the system of the internal stereoscopic inspecting. ISTM/2005. ISTP收录
[72]Shuhua Jiang, Dongyue Liu, Wensheng Wang. Area testing study of arbitrary Shape plane object based on CCD. SPIE/2008. EI收录
[73]马颂德,张正友.计算机视觉理论与算法基础.科学出版社.1998
[74]邱茂林等.计算机视觉中摄像机定标综述.自动化学报,2000,26(1)
[75]Barnard. S, et al. Computational stereo. ACM Computing Surveys,1982,14:553-572
[76]Slama C C. Manual of Photogrammetry.4th ed, American society of Photorrammetry.1980
[77]陈宝林.最优化理论与方法.北京:清华大学出版社,1989
[78]GFalk. Interpretation of imperfect line data as a three-dimensional scene. AI, Vol.3,1972
[79]A.K.Machworth. Interpreting pictures of polyhedral scenes. AI. Vol.4,1973
[80]吕强.基于特征点提取单目视觉里程计的研究:[硕士学位论文].杭州:浙江大学,2007
[81]A.Guzman. Decomposition of a visual scene into three-dimensional bodies. Fall joint computer conference,1968
[82]C. Harris and M. Stephens. A Combined Comer and Edge Detector. Proc. Fourth Vision Conference,1998
[83]D.G Lowe. Object Recognition from Local Scale-Invariant features. International conference of Computer Vision, 1999,1150-1157
[84]D.G Lowe. Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision, 2004,60(2)91-110
[85]K.Schwidefsky, F.Ackermann. Photogrammetrie. Teubner Verlag, Stuttgart,1976
[86]GB.Smith. Stereo reconstruction of scene depth. Proc. Computer vision and pattern recogintion,1985
[87]T.S.Huang. Robust algorithms for motion estimation based on two sequential stereo image pairs. Proc. Computer vision and pattern recogintion,1985
[88]T.Kanade. Recovery of the three-dimensional shape of an object from a single view. AI. Vol.17,1981
[89]S.T.Barnard. Interpreting perspective images. AI. Vol.21,1983
[90]W.Tsai. Error correcting isomorphisms of attrbuted relational graphs of pattern analysis. Transcation an systems, man and cybernetics. Vol.9,1979
[91]T.F.Knoll. Recognizing partially visible objects using feature indexed hypotheses. Journal of robotics and automation, Vol.2, March 1986
[92]S.Lu. Recognition of 3-D scene with partially occluded objects. SPIE, Vol,7,1986
[93]M.W.Koch. Using polygons to recognize and locate partially occluded objects. PAMI, Vol.9,1987
[94]吴彰良.视觉传感器结构优化设计与标定技术:[硕士学位论文].合肥:合肥工业大学.2005
[95]颜树华,叶湘滨,王跃科.CCD光靶交汇测量精度的理论研究.光电子激光.1999,10(4):328~332
[96]张宏伟.双目视觉形貌测头的研究:[博士学位论文].天津:天津大学.2002
[97]齐舒创作室.Visual C++6.0开发技巧及实例剖析.北京:清华大学出版社,1999