用户名: 密码: 验证码:
面向再制造的机器人三维视觉检测系统研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
为了将集机器人技术与非接触检测等先进技术于一体的机器人三维视觉检测系统有效地应用于再制造领域,构建加工-检测-再制造的闭环制造过程,提高再制造工程的自动化和智能化水平,本文重点研究该系统构建中的关键技术,并将其成功应用于工件快速修复系统与涂层厚度检测系统中。主要研究内容和贡献如下:
     1.建立了包括机器人运动学、线结构光视觉传感器和系统检测模型在内的机器人三维视觉检测系统的数学模型。
     2.完成了机器人三维视觉检测系统的软硬件结构设计。硬件设计中以包含应用约束的传感器检测误差为优化目标,能够设计出符合现场需求的线结构光传感器。软件设计集中考虑了扩展、兼容以及交互性方面的诸多因素,最终搭建出功能完备的机器人三维视觉检测系统的软件平台。
     3.在线结构光传感器的现场标定问题的研究中,基于统一的二维平面标靶,首先通过机器人的已知位置关系的运动,标定出系统的内参数与手眼关系参数,其次通过三点透视原理与双重交比不变法标定出光平面参数。
     4.提出一种高效的机器人三维视觉检测系统的并发式工作方式。该方式利用缓冲区技术与多线程控制技术将数据的采集与处理流程解耦,能够独立并发执行检测任务中的各耗时环节。
     5.研究海量检测数据与标准数据的内存管理与调度,三维显示方式,及带有破损信息的检测数据与标准数据的配准问题。
     6.基于本文研究的机器人三维视觉检测系统,设计并实现工件快速修复系统与涂层厚度检测系统,给出各自的系统标定方法,并将机器人三维视觉检测系统实际应用于再制造工程,满足了再制造工程中对产品的在线检测与现场修复两大需求。
     最后在总结全文工作的基础上,给出进一步的工作展望。
For making the remanuaturing system to be more intelligent, the robotic and laser sanning technologies are combined and an integrated robotic remanfacturing system with 3D surface inspection function is presented so that the closed-loop remanufacturing process is implemented. Some key technologies and theory are researched and some application results are given in the thesis. The main works are summarized as follows:
     1. The mathematical model of the robotic inspecting system with vision measurement is established, including the main body model of robot, the mathematical models of line structured light vision sensor and the whole system models.
     2. The mathematical models of the robotic inspection system are estabilshed, which include dynamic model of the robot body, model of the vision sensor and the model of the integrated system.
     3. The framework of hardware and software of the system are constructed and implemented, which is a feature-rich platform with exensible and friendly interface. The measurement error of the line structured light sensor is taken as optimal performance, and the rubust vision sensor is designed based on the consideration for field environment.
     4. The field catibration scheme with two steps is presented. First, based on the uniform 2D plane target particular designed and the known position information of the robot, the parameters about the hand-eye relationship are calibrated. Then, the parameters of the laser plane are obtained via the principle of perspective three points and double cross ratio invance.
     5. A parallel mode of operation of the system is developed. Each time-consuming phase can be executed independently by decoupling the data collection and process using both the public buffer zone and multi-thread technology.
     6. The management, scheduling and 3D showing schemes for massive data are studied. Also, the registration algorithm between the scanned damaged data and the CAD data is presented.
     7. The presented robotic 3D inspection system is applied to design a fast repairing system and a coating thickness measurement system, so that the problems of on-line 3D nspection and fast repairing on site are sloved properly.
     Finally, future work is listed based on the conclusion of whole work.
引文
[1]徐滨士,马世宁,刘世参等.21世纪的再制造工程.中国机械工程.2000,11(1-2):36-38.
    [2]徐滨士.绿色再制造工程及其在我国的应用前景.‘工程科技与发展战略’咨询报告集.北京.中国工程院,2002
    [3]徐滨士,张伟,梁秀兵.21世纪的机械维修——绿色再制造.航空制造技术.2000(6):45-46.
    [4]徐滨士.发展再制造工程,实现节能减排.装甲兵工程学院学报.2007.21(5):1-5.
    [5]解振华.努力实现中国再制造产业发展发展的新突破.中国表面工程.2011,24(3):1-3.
    [6]徐滨士.再制造工程的现状与前沿.材料热处理学报,2010,31(1):10-14.
    [7]董允.现代表面工程技术.北京:机械工业出版社,2000.
    [8]徐滨士,刘世参,史佩京.再制造工程的发展及推进产业中的前沿问题.中国表面工程,2008,21(1):1-6.
    [9]Spyridi A J, et al. Accessibility analysis for the automatic inspection of mechanical parts by coordinate measuring machines. Proc of the 1990 IEEE International Conf on Robotics and Automation, Cincin-nati,1990.1284-1289.
    [10]http://www.faro.com
    [11]Leica geosystems AG-Leica laser rader system LR200,2001.
    [12]Leica industrial theodolite TM5100A,2002.
    [13]Hiroyuki Matsubara, Toshihiko Tsukada, Hiroshi Ito, et al. A three-dimensional position measurement method using two pan-tilt cameras. R&D Review of Toyota CRDL 2003,38(2):43-49.
    [14]Halim SETAN, Mohd Sharuddin IBRAHIM, Ismail MA'AROF. Applications of digital photogrammetric systems for dimensional measurement and 3D modelling.3rd FIG Regional Conference, Jakarta, Indonesia, October 3-7,2004.
    [15]张广军.机器视觉.北京:科学出版社,2005.
    [16]Timothy S.N., Anil K.J., A survey of automated visual inspection, Computer Vision and Image Understanding,1995,61 (2):231-262
    [17]张广军.视觉测量.北京:科学出版社,2008.
    [18]Alain Bernard. Reverse Engineering for Rapid Product development: A State of the Art.In: SPIE 3835, Boston,1999:50-63
    [19]黄凤山.光笔式单摄像机三维坐标视觉测量系统关键技术的研究.(博士学位论文).天津:天津 大学(2005)
    [20]游素亚,徐光祐.立体视觉研究的现状和进展.中国图像图形学报,1997,2(1):17-24.
    [21]吴斌.大型物体三维形貌数字化测量关键技术研究.(博士学位论文).天津:天津大学(2002)
    [22]周富强,张广军.表面视觉传感器模型参数的简易标定方法.机械工程学报,2005,41(3):175-179
    [23]韩建栋,吕乃光,董明利,娄小平.线结构光传感系统的快速标定方法.光学精密工程.2009,17(5):958-963
    [24]刘常杰,邾继贵,杨学友等.汽车白车身在线激光视觉检测站.仪器仪表学报,2004,25(4):671-672.
    [25]Lu Rongsheng, Ye Shenghua, Sun Changku. Study of the visual inspection system for vehicle wheel alignment.ISIST 99, Aug.23-26, Luoyang,1999:448-452.
    [26]Changku Sun, Qiang You, Yu Qiu.Online machine vision method for measuring the diameter and straightness of seamless steel pipes. Optical Engineering,2001,40(11):2565-2571.
    [27]Sun Changku, Qiu Yu, Ye Shenghua.Laser vision measurement system and assessment method for SMIC lead coplanarity. Chinese Journal of Lasers,2000,9(5):417-422.
    [28]Michael Demeyere,Deo Rurimunzu and Christian Eugene.Diameter measurement of spherical objects by Laser triangulation in an ambulatory context.IEEE Transactions on Instrumentation and Measurement,2007,56(3):867-872.
    [29]GKinoshita, M.Idesawa.Optical range finding system by projecting ring beam pattern. ICAR, 1985:177-184.
    [30]D.Wei,M.Gini.The use of taper light beam for object recognition.In Robot Vision,1983:143-156.
    [31]K.P.Pelowski.3D measurement with machine vision.In Proc. Vision'86 Conf.,1986:117-131.
    [32]H Yamamoto.Range imaging system based on binary image accumulation.In Proc. Int. Conf. on Pattern Recognition,1986:233-235.
    [33]K.K.Yeung, P.D.Lawrence.A low-cost 3D vision system using space-encoded spot projection.In Proc. SPIE Conf on Opt. Illus.&Im. Sens.for Mach.Vision,1986:160-172.
    [34]K.Sato, S.Inokuchi.Three-dimensional surface measurement by space encoding range imaging. Journal of Robotic Systems,1985,2(1):160-172.
    [35]M.D.Altschuler.Laser electro-optic system for rapid three-dimensional topographic mapping of surfaces.Optical Engineering,1981,20(6):953-961.
    [36]http://www.perceptron.com
    [37]http://www.gom.com
    [38]http://www.cyberware.com
    [39]http://www.creaform3d.com
    [40]http://www.metronor.com
    [41]http://www.kreon3d.com
    [42]http://www.emicroscribe.com/products.htm
    [43]邹定海,叶声华,王春和,郭育.用于在线测量的视觉检测系统.仪器仪表学报.1995,16(4):337-341
    [44]黄荣瑛.机器人视觉系统模糊识别抓取物算法.北京航空航天大学学报,2009,35(2):197-200.
    [45]陈国良,黄心汉,周祖德.微装配机器人系统.机械工程学报,2009,45(2):288-293.
    [46]吕遐东,黄心汉,蔡建华.具备多操作手协调的微装配机器人系统.华中科技大学学报(自然科学版),2006,34(11):70-73.
    [47]朱振友,朴泳杰,林涛,陈善本.基于视觉的局部环境焊缝起始位置识别方法.焊接学报,2004,25(2):95-98.
    [48]方勇纯.机器人视觉伺服研究综述.智能系统学报,2008,3(2):109-114.
    [49]周律.基于视觉伺服的弧焊机器人焊接路径获取方法研究:(博士学位论文).上海:上海交通大学,2007.
    [50]郑俊.基于立体视觉的通用测量机器人标定模式研究:(硕士学位论文),天津:天津大学,2005.
    [51]http://brownandsharpe.com/automotive-manufacturing.
    [52]http://www.joanneum.at/fb3/dib/projekte/dibr3d-robotergestuetzte-3d-vermessung.html.
    [53]http://www.perceptron.com/flexri_manu.html.
    [54]http://www.hexagonmetrology.com.cn/Product_view_8_86.aspx
    [55]工一.测量机器人模型误差及标定方法的研究,(硕士学位论文).天津:天津大学,2006.
    [56]任永杰,邾继贵,杨学友,叶声华.白车身柔性测量机器人本体补偿方法.光电工程,2009,36(2):79-84.
    [57]任永杰,邾继贵,杨学友,叶声华.机器人柔性视觉检测系统现场标定技术.机器人,2009,31(1):82-87
    [58]王一.面向测量的多关节运动机构误差模型及标定技术研究:(博士学位论文).天津:天津大学,2009.
    [59]大连海事大学.一种逆向工程机器人系统.中国,发明专利,CN1730248,2006.
    [60]Zi Ma, Huipu Xu and Ying Hu et al. A novel robot surface measurement system enhanced with 3D surface reconstruction. International Journal of Modeling, Identification and Control.2008, 4(3):286-298.
    [61]哈尔滨工业大学.测量机器人.中国,实用新型专利,02280462,2003.
    [62]赵吉宾,刘伟军,孙玉文.一种基于机器人的曲面测量、建模和加工方法.仪器仪表学报,2008,29(2):365-371.
    [63]王金涛,曲道奎,徐方.三维视觉测量系统标定技术.计算机应用,2006,26(z1):35-37.
    [64]李爱国.结构光视觉测量机器人标定技术研究:(博士学位论文).大连:大连海事大学,2009.
    [65]林娜.激光视觉三维测量及其标定技术的研究:(硕士学位论文).大连:大连海事大学,2007.
    [66]张广军.视觉测量.北京:科学出版社,2007.
    [67]吴庆阳.线结构光三维传感中关键技术研究:(博士学位论文).成都:四川大学,2006.
    [68]杨峰.图像序列的三维重建:(硕士学位论文).河北:河北大学,2009.
    [69]A W Fizgibbon. Simultaneous linear estimation of multiple view geometry and lens distortion. CVPR,2001,125-132.
    [70]Lili Ma, YangQuan Chen and Kevin L Moore. Rational radial distortion models of camera lenses with an alytical solution for distortion correction. International Journal of Information Acquisition,2004, 1(2):135-147.
    [71]A Dipanda, S Woo and F Marzani et al.3-D shape reconstruction in an active stereo vision system using genetic algorithms. Pattern Recognition,2003,36(9):2143-2159.
    [72]Trucco E and Verri A. Introductory techniques for 3-D computer vision. Prentice Hall,1998.
    [73]G Zhang and Z Wei. A novel calibration approach to structured light 3D vision inspection. Optics & Laser Technology,2002,34(5):373-380.
    [74]G Zhang, Z Wei and X Li.3D double-vision inspection based on structured light. Journal of manufacturing science and engineering,2003,125(3):617-623.
    [75]J.J.Craig.Introduction to robotics: mechanics and control. Reading Massachusetts: Addison-Wesley Publishing Company, Inc,1986.
    [76]何广忠,高洪明,吴林.基于焊接位置数学模型的变位机逆运动学算法.机械工程学报,2006,42(6):86-91.
    [77]黄进,胡英,马孜.基于粒子群优化算法的工业机器人外部轴标定.机械工程学报,2009,45(7):63-67.
    [78]和平鸽工作室.OpenGL高级编程与可视化系统开发-高级编程篇.北京:中国水利水电出版社,2006.
    [79]http://www.sgi.com/
    [80]http://www.abb.com/
    [81]http://www.kuka.com/
    [82]http://www.yaskawa.com/
    [83]王克鸿,刘永,徐越兰,余进,周毅仁.弧焊机器人离线编程技术焊接学报,2001,22(4):84-86.
    [84]何广忠.机器人弧焊离线编程系统及其自动编程技术的研究:(硕士学位论文).哈尔滨:哈尔滨工业大学,2006.
    [85]田劲松,吴林.弧焊机器人任务级离线编程系统的设计.焊接学报.2000,21(2):22~25.
    [86]林君.基于三维图形仿真的弧焊机器人离线编程及其技术实现:(硕士学位论文).北京:北京工业大学,2003.
    [87]刘永,杨静宇.弧焊机器人工作站离线编程系统—WROBCAM计算机辅助设计与图形学学报.2005,17(1):190~194.
    [88]杜乃成,胡绳荪,丁炜.机器人弧焊成形系统中离线自动编程.焊接学报,2008,29(11):81-84.
    [89]唐新华,Paul Drews机器人三维可视化离线编程和仿真系统.焊接学报,2005,26(2):64-68.
    [90]陈天飞.线结构光传感器结构设计及其摄像机标定技术:(硕士学位论文).大连:大连海事大学,2010.
    [91]贺忠海,王宝光.线结构光传感器的模型及成像公式.光学精密工程.2001,9(3):269-272
    [92]王宝光,贺忠海,陈林才,倪勇.结构光传感器模型及特性分析.光学学报.2002,22(4):481-484.
    [93]吴彰良,卢荣胜,宫能刚,费业泰.线结构光视觉传感器结构参数优化分析.传感技术学报.2004,27(4):709-712
    [94]费业泰.误差理论与数据处理.北京:机械工业出版社,2000
    [95]吴彰良,卢荣胜,宫能刚,费业泰.线结构光视觉传感器结构参数优化分析.传感技术学报.2004,27(4):709-712
    [96]熊会元,陈承鹤,宗志坚.线结构光视觉传感器设计优化.工具技术.2009,43(9):81-83
    [97]Tsai R. Y., A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses, IEEE Journal of Robotics and Automation,1987,3(4): 323-344
    [98]邱茂林,马颂德,李毅,计算机视觉中摄像机定标综述,自动化学报,2000,26(1):43-55
    [99]Martins H.A., Birk J.R., Kelley R.B., Camera models based on data from two calibration planes, Computer Graphics and Imaging Processing,1981,17:173-180
    [100]Ma S.,A self-calibration technique for active vision system, IEEE Trans. Robotics and Automation,1996,12:114-120
    [101]Zhang Z.Y., Camera calibration with one-dimensional objects, IEEE Trans. PAMI,2004,26 (7): 892-899.
    [102]Faig W., Calibration of close-range photogrammetric systems:mathematicalformulation, Photogrammetric eng.Remote sensing,1975,41 (12):1479-1486
    [103]Abdel-Aziz Y.I., Karara H.M., Direct linear transformation into object spacecoordinates in close-range photogrammetry, In:Proc.Symp.Close-Range Photogrammetry,1971:1-18
    [104]Ganapathy S., Decomposition of transformation matrices for robot vision, Proc.Int.Conference on Robotics and Automation,1984:130-139
    [105]Weng J.,Cohen P.,Herniou M.,Camera calibration with distortion models andaccuracy evaluation,IEEE Trans.PAMI,1992,14 (10):965-980
    [106]Wei G.Q., Ma S.D., Implicit and explicit camera calibration:theory andexperiments, IEEE Trans.PAMI,1994,16 (5):469-480
    [107]Maybank S., Faugeras O., A theory of self-calibration of a moving camera, International Journal of Computer Vision,1992,8 (2):123-151
    [108]Hartley R., Euclidean reconstruction and invariants from multiple images, IEEETrans. PAMI, 1994,16 (10):1036-104
    [109]Triggs B., Auto-calibration and the absolute quadric, Proc.Computer Vision and Pattern Recognition,1997:609-614
    [110]Sturm P., A case against Kruppa's equations for camera self-calibration, IEEE Trans.PAMI,2000, 22 (10):1199-1204
    [111]Longuet-Higgins H.C., A computer algorithm for reconstructing a scene from two projections, Nature,1981,293 (10):133-135
    [112]Faugeras O.D., Maybank S., Motion from point matches:multiplicity of solutions, International Journal of Computer Vision,1990,4:225-246
    [113]吴斌,大型物体三维形貌数字化测量关键技术研究:[博士学位论文],天津:天津大学,2002
    [114]Tsai R.Y., A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses, IEEE Journal of Robotics and Automation,1987, 3(4):323-344
    [115]ShashuaA., Algebraic function for recognition, IEEE Tran.PAMI,1995,17:779-789
    [116]Zhang Z. A flexible new technique for camera calibration. IEEE Trans. Pattern Analysis and Machine Intelligence.2000,22(11):1330-1334.
    [117]杨长江,孙风梅,胡占义.基于平面二次曲线的摄像机标定.计算机学报,23(5):541-547.
    [118]薛婷.三维视觉检测仪器化关键技术研究:(博士学位论文).天津:天津大学,2007.
    [119]Zhang G, He J, Yang X. Calibrating camera radial distortion with cross-ratio invariability. Optics & Laser Technology,2003,35:457-461.
    [120]翟晋,周富强,张广军.基于卡尔曼滤波的摄像机标定方法.光电工程,2007,34(9):60-65.
    [121]Dewar R. Self-generated targets for spatial calibration of structured light optical sectioning sensors with respect to an external coordinate system. Robots and Vision'88 Conf. Proceedings[C],1998:5-13
    [122]段发阶,刘凤梅,叶声华.一种新型线结构光传感器结构参数标定方法.仪器仪表学报.2000,21(1):108-110.
    [123]Huynh D Q. Calibration a structured light stripe system: a novel approach. International Journal of Computer Vision,1999,33(1):73-86.
    [124]魏振忠,张广军.一种线结构光视觉传感器标定方法.机械工程学报,2005,41(2):210-214.
    [125]许丽,张之江.基于共面靶标的结构光标定方法.光电子·激光.2009,20(8):1063-1069.
    [126]周富强,张广军,江洁.线结构光视觉传感器的现场标定方法.机械工程学报.2004,40(6):169-173.
    [127]韩建栋,吕乃光,董明利.线结构光传感系统的快速标定方法.光学精密工程.2009,17(5):949-963.
    [128]黄凤山,钱惠芬.光笔式单摄像机三维坐标视觉测量系统.光电工程.2007,34(4):69-72.
    [129]Y C Shiu,S Ahmad. Calibration of wrist mounted robotic sensors by solving homogeneous transform equations of the form AX= XB. IEEE Transactions on Robotics and Automation,1989,5(1): 16-27.
    [130]H Zhuang, Z Roth,R Sudhakar. Simultaneous robot/world and tool/flange calibration by solving homogeneous transformation of the form AX=YB. IEEE Transactions on Robotics and Automation, 1994,4(10):549-554.
    [131]R Y Tsai, R K Lenz. A new technique for fully autonomous and efficient 3-D robotics hand/eye calibration. IEEE Transactions on Robotics and Automation,1989,5(3):345-358.
    [132]C C Wang. Extrinsic calibration of a robot sensor mounted on a robot. IEEE Transactions on Robotics and Automation,1992,8(4):161-175.
    [133]F Park, B Martin. Robot sensor calibration: Solving AX=XB on the Euclidean group. IEEE Transactions on Robotics and Automation,1994,10(5):717-721.
    [134]H J Liu, F H Shi,Y C Liu. Simulation Analysis on Robotic Hand-Eye Calibration. Journal of System Simulation,2004,16(11):2541-2543.
    [135]R Horaud, F Dornaika.Hand-eye calibration. International Journal of Robotics Research,1995, 3(14):195-210.
    [136]Daniilidis. Hand-Eye Calibration Using Dual Quaternions. International Journal of Robotics Research,1999,18(3):286-298.
    [137]F Dornaika. Simultaneous Robot-World and hand-Eye Calibration. IEEE Transaction on Robotics and Automation,1998,4(14):617-622.
    [138]Rusinkiewicz S, Levoy M. Qsplat: A multiresolution point rendering system for large meshes. In: Proceedings of SIGGRAPH 2000, Louisiana,2000,343-352
    [139]Levoy M, Whitted T. The use of point s as display primitives. CS Department, University of Nort h Carolina, ChapelHill: Technical Report 852022,1985
    [140]成学文,李德群,周华民,崔树标等.基于哈希表的STL面片冗余顶点快速滤除算法.华中科技大学学报,2004,32(6):69-72
    [141]郎兴华,郭阳,林亨,张伟.STL模型的立体显示及其多屏拼接.系统仿真学报,2004,16(4)740~744
    [142]http://blog.csdn.net/060/article/details/1326025
    [143]万军,鞠鲁粤.逆向工程中数据点云精简方法研究.上海大学学报,2004,10(1):26-29.
    [144]张传明,潘懋,徐绘宏.基于分块混合八叉树编码的海量体视化研究.计算机工程,2007,33(14):33-35.
    [145]卫炜,周来水,张丽艳.海量STL文件的快速读取与显示.机械科学与技术,200625(8):935-938.
    [146]柳伟.三维模型特征提取与检索:(博士学位论文).上海:上海交通大学,2008.
    [147]Besl, P.J., McKay, N.D. A method for registration of 3-D shapes.IEEE Transactions on Pattern Analysis and Machine Intelligence,1992,14(2):239-256.
    [148]Y. Chen, G. Medioni. Object modeling by registration of multiple range images. Image and Vision Computing,1992.10:145-155.
    [149]Szymon Rusinkiewicz, Marc Levoy. Efficient variants of the ICP algorithm. Third International Conference on 3D Digital Imaging and Modeling,2001.
    [150]Pearson K. On lines and planes of closest fit to systems of points in space. Philosophical Magazine, 1901,2(6):559-572.
    [151]HOTELLING H. Analysis of a complex of statistical variables into principal components. Journal of Educational Psycholo-gy,1933,24:417-441,498-520.
    [152]KARHUNEN K. Uber lineare methoden in der wahrscheinlichkeitsrechnung.Amer Acad Sci,Fennicade Ser A I,1947,37:3-79
    [153]崔晨旸.三维模型检索中关键技术的研究:(博士学位论文).杭州:浙江大学,2005.
    [154]Ohbuchi, Masatoshi, Tsuyoshi. Retrieving 3D shapes based on their appearance. The 5th ACM SIGMM International Workshop on Multimedia Information Retrieval,2003,39-45.
    [155]戴静兰,陈志杨,叶修梓.ICP算法在点云配准中的应用.中国图像图形学报,2007,12(8):517-521.
    [156]崔培枝,朱胜,姚巨坤.柔性再制造系统研究,机械制造,2003,vol.41:7-9
    [157]史耀武,成形焊接快速零件制造技术的发展.中国机械工程,1994(06).

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700