一种新型并联机器人位姿的视觉检测系统研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
多自由度冗余驱动并联机器人控制中,其末端操作器位姿是反映并联机器人:运动状态的重要参数,并联机器人具有多自由度、运动轨迹复杂的特点,其位姿检测要求同时能完成多个自由度的测量,位姿检测是当前大载荷系统检测领域亟待解决的问题之一。相对于传统检测手段,计算机视觉检测系统具有非接触、智能、检测速度快等优点,具有较大灵活性,能实现多自由度测量,克服了传统检测手段在并联机器人位姿测量中遇到的困难。本论文从计算机视觉着手,研究构建视觉检测平台并通过不同时刻的图像智能化的采集场景中被测物体的运动信息,进而实现对多自由度冗余驱动并联机器人视觉检测系统的信息集成、处理。
     本论文建立了一种基于尺度不变量特征变换(SIFT)的视觉测量系统框架来检测一种具有10个输入的6自由度冗余驱动并联机器人,通过该系统检测出并联机器人的实时位姿。主要包括图像采集与传输、摄像机标定、SIFT匹配、空间点重建和位姿测量五个部分。
     首先根据冗余输入并联机器人位姿检测系统的特点,在硬件连接上使用两个工业黑白CCD相机WAT-902H经过同步锁相的方式连接一个PCI-1409多通道黑白图像采集卡,再将图像采集卡连接到PC机上,在尽量不影响系统性能的前提下降低系统复杂度和系统成本。在仿真平台搭建上,使用LabView和Matlab完成图像信息采集与显示系统的主要功能模块,以动态观测检测对象的状态。其次,为了简化计算提高系统的速度,采用较为简单的基于针孔模型的摄像机线性标定法标定对双目视觉系统进行标定,根据已知的样本点通过最小二乘法估算出基本参数。接着,在并联机器人位姿检测中的特征提取和特征匹配步骤中引入SIFT立体匹配算法,该算法尚未在该并联机器人位姿视觉检测系统中应用。匹配算法首先在尺度空间极值检测,剔除不稳定关键点之后确定关键点方向向量,生成SIFT特征向量,最后利用SIFT特征向量完成匹配。然后,通过点的重建方法将SIFT匹配算法得到的特征点2D坐标转换为特征点的实际3D坐标。最后,建立了冗余驱动并联机器人运动平台位姿计算的求解方法,将求解位姿问题转化为一个优化问题。通过前后两个时刻求得的特征点的实际3D坐标,根据三维空间的平移和旋转矩阵得出一组非线性方程,并将非线性方程组转化为函数优化问题,使用改进的PSO算法对该优化目标函数进行优化,针对优化函数的特点,改进的PSO算法主要加入了惯性系数,并且采用领域极值B_(best)代替G_(best)全局极值,减小了算法陷入局部极值的可能,在保证速度的前提下提高的精度,进而求出空间的实际位姿参数~(θ,(?),φt_x,t_y,t_z)。
     仿真实验表明该算法在图像存在一定视角、平移、旋转、亮度和尺度的变化时仍然具有较好效果,证明了上述方法的有效性和可行性,适用于对并联机器人多自由度和空间复杂运动的检测。
In the control of multi-degree of freedom (MDOF) parallel robot, the position and orientation of MDOF parallel robot is a very important motion state parameter. The MDOF parallel robot has complicated motion trails. Compared with tradition measurement methods, computer vision based measurement system has the advantage of intelligence, non-touch and more fast. The position and orientation measurement of MDOF parallel robot with high precision is a unresolved problem. In this thesis, the position and orientation measurement system for 6-DOF parallel robot is built based on machine vision theory. The sampling is actualized by images at different moments and then to intelligently extract the motion information from it. The position and orientation information of 6-DOF parallel robot is further analyzed and computed.
     This thesis presents a framework of scale-invariant feature transform based stereo vision position and orientation measurement system for a 6-DOF redundant actuation parallel mechanism with 10 inputs. The result of real-time pose can be calculated and displayed by the system. It is composed of image gather and transfer, camera calibration, scale-invariant feature transform (SIFT), reconstruct of points and position and orientation measurement. Main steps are as follows.
     First, a simple linear calibration method based on pin-hole model is used to calibrate the stereo vision position and orientation measurement system for parallel robot.
     Second, an acquisition and display simulation system of vision information based on LabView is built. It can observe the object state dynamically.
     Next, a processing system using SIFT is built. This framework is mainly based on scale-invariant feature transform. It performs reliable matching between different views of objects, when the images have change in scale, rotation, shift and change in illumination. It is especially adapt to measurement for multiple DOF parallel robot and complex motions in space.
     Finally, the parameter of pose can be calculated by matrixes of translation and rotation of 3D, and then is converted into an optimization problem. The result is optimized by improved particle swarm optimization (PSO) to improve the precision ensuring the high speed of the process. In the end, position and orientation measurement for parallel robot is realized by Matlab program.
     The results of simulation experiments prove the veracity and validity of all algorithms in this thesis.
引文
[1]董志强,段宝岩,立体视觉实时检测柔性机器人6-DOF位姿和运动轨迹,仪器仪表学报,2004,25(1):65-68,85.
    [2]阮晓东,李世伦,诸葛良,骆涵秀,用立体视觉测量多自由度机械装置姿态的研究,中国机械工程,2000,11(5):571-574.
    [3]郝颖明,朱枫,欧锦军,目标位姿测量中的三维视觉方法,中国图象图形学报(A版),2002,7(12):1247-1251.
    [4]T.D.Alter,3-D Pose from 3 Points Using Weak-Perspective,IEEE Transactions on Pattern Analysis and Machine Intelligence,1994,16(8):802-808.
    [5]Heping Pan,A Direct Closed-Form Solution to General Relative Orientation of Two Stereo Views,Digital Signal Processing,1999,9:195-221.
    [6]Robert Strzodka,Ivo Ihrke,and Marcus Magnor,A Graphics Hardware Implementation of the Generalized Hough Transform for fast Object Recognition Scale and 3D Pose Detection,Proceedings of the 12th International Conference on Image Analysis and Processing(ICIAP'03),2003.188-193.
    [7]Daniel De Menthon and Larry S.Davis,Exact and approximate solutions of the perspective three-point problem,IEEE Transactions on Pattern Analysis and Machine Intelligence,1992,14(11):1100-1105.
    [8]Harrie Van Dijck and Ferdinand Van der Heijden,Object recognition with stereo vision and geometric hashing,Pattern Recognition Letters,2003,24(1):137-146.
    [9]张超,沈振康,张淑琴,基于立体视觉的测量技术,系统工程与电子技术,2002,24(9):126-129.
    [10]陈学生,陈在礼,孔民秀,并联机器人研究的进展与现状,机器人,2002,24(5):464-470.
    [11]祝世平,强锡富,工件特征点三维坐标视觉测量方法综述,光学精密工程,2000,8(2):192-197.
    [12]张云,吴晓君,马廷武,庞连军,基于机器视觉的零件图像采集及识别的研究, 电子工程师,2006,32(4):29-31,65.
    [13]毛德柱,周凯,张伯鹏,刘大成,智能寻位加工技术应用研究,制造技术与机床,2000,4:42-44.
    [14]乔峰,陈子辰,傅建中,梅德庆,居冰峰,制造过程的在线检测视觉系统研究,机电工程,1997,6:191-193.
    [15]U.Buker,S.Drue,N.Gotze,G.Hartmann,B.Kalkreuter,R.Stemmer,and R.Trapp,Vision-based control of an autonomous disassembly station,Robotics and Autonomous Systems,2001,35:179-189.
    [16]徐进军,张民伟,何长虹,几种动态测量传感器综述,测绘信息与工程,2005,30(2):44-46.
    [17]于辉,左洪福,黄传奇,立体视觉在航空发动机无损检测中的应用,无损测量,2003,25(5):229-233.
    [18]汪建华,赵晓光,谭民,一种5自由度视觉伺服机器人的跟踪控制研究,机器人,2005,27(3):215-219.
    [19]王文,段宝岩,彭勃,南仁东,基于计算机视觉的大射电望远镜馈源舱动态定位系统,光学技术,2001,27(1):78-81.
    [20]徐德,赵晓光,涂志国,谭民,基于结构光立体视觉的焊缝测量,焊接学报,2004,25(5):45-48,52.
    [21]杨培,徐滨士,吴林,基于结构光三维视觉的再制造工件的测量及重建,焊接学报,2005,26(8):12-15.
    [22]朱兴龙,基于立体视觉和激光标记的空间物体位姿的快速定位算法,机械工程学报,2004,40(7):161-165.
    [23]左爱秋,吴江宁,李世沦,骆函秀,双目体视检测多自由度机械装置位姿的工作原理和技术特点,测控技术,1999,18(4):27-29.
    [24]岁波,都东,陈强,孙振国,韩翔宇,基于双目视觉的工业机器人运动轨迹准确度检测,机械工程学报,2003,39(5):88-91.
    [25]郑俊,邾继贵,叶声华,基于双目立体视觉的机器人测量技术研究,计量技术,2005.4:15-17.
    [26]朱效明,高稚允,双CCD立体视觉系统的理论研究,光学技术,2003,29(3):298-300.
    [27]贾云得,吕宏静,徐一华,徐岸,星球漫游车超广角实时立体视觉系统,自动化学报,2004,30(6):986-990.
    [28]贾云得,徐一华,刘万春,杨聪,朱玉文,微型实时多目立体视觉机设计与实现,电子学报,2003,31(9):1334-1336.
    [29]任重,邵军力,立体视觉中的三目匹配方法研究,机器人,2001,23(5):455-458.
    [30]安路平,贾云得,李鸣翔,三目立体视觉外极线校正及其FPGA实现方法,北京理工大学学报,2005,10:872-875.
    [31]赵锐,基于单目视觉的物体位姿测量方法研究,合肥工业大学硕士论文,2005.
    [32]张世杰,曹喜滨,李晖,交会对接航天器间相对位姿参数单目视觉测量的解析算法,光学技术,2005,31(1):6-10.
    [33]杨丽梅,郭立红,曹西征,单站光测图像确定空间目标三维姿态方法综述,微计算机信息,2006,22(5):186-188.
    [34]Yoshihiko NOMURA,Dili ZHANG,Yuko SAKAIDA,and Seizo,3-D Object Pose Estimation by Shading and Edge Data Fusion,Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition(CVPR'96),1996,866-871.
    [35]Nicolas Franceschini,Visual guidance based on optic flow a biorobotic approach,Journal of Physiology-Paris 98,2004,281-292.
    [36]陈熙霖,视觉计算──人类感知能力的延伸,测控技术,2000,19(5):7-14.
    [37]潘春洪,张彩霞,计算机视觉简述,自动化博览,2005,22(5):92-99.
    [38]马颂德,张正友,计算机视觉──计算理论与算法基础,科学出版社,1998.
    [39]刘江华,陈佳品,程君实,双目视觉平台的研究,机器人技术与应用,2002,1:36-40.
    [40]隋婧金,伟其,双目立体视觉技术的实现及其进展,电子技术应用,2004,10:4-6,12
    [41]杨永跃,邓善熙,丁兴号,视觉仿生与立体视觉测量,合肥工业大学学报纸(自然科学版),2001,24(6):1029-1035.
    [42]宋丽梅,双目立体机器视觉检测系统及其应用,西南科技大学学报,2006,21(1):30-34,58.
    [43]Clark F.Olson,Habib Abi-Rached,Ming Ye,Jonathan P.Hendrich,Wide-Baseline Stereo Vision For Mars Rovers,Proceedings Of The 2003 IEEE/RSJ Intl.Conference On Intelligent Robots And Systems,2003.
    [44]Aly A.Faraga,M.Sabry Hassounaa,Ayman El-Baza,S.Hushek,Real-time vision-based approach for probe tracking in operating room,International Congress Series 1268,2004,467-472.
    [45]Yajun Fang,Ichiro Masaki,and Berthold Horn,Depth-Based Target Segmentation for Intelligent Vehicles:Fusion of Radar and Binocular Stereo,IEEE Transactions on Intelligent Transportation Systerns,2002,3(3):196-202.
    [46]Minoru Asada,Takamaro Tanaka,Visual Tracking of Unknown Moving Object By Adaptive Binocular Visual Servoing,Proceeding of the 1999 IEEE International Conference on Multisensor Fusion and Intelligent Systems,1999.
    [47]Kei Okada,Masayuki haaba,Integration of Real-Time Binocular Stereo Vision And whole Body Information For Dynamic Walking Navigation of Humanoid Robot,IEEE Conference on Multisensor Fusion and Integration for Intelligent Systems 2003,2003.
    [48]Vallerand Steve,Kanbara Masayuki,Yokoya Naokazu,Binocular Vision-Based Augmented Reality System With An Increased Registration Depth Using Dynamic Correction Of Feature Positions.Proceedings of the 2003 IEEE Virtual Reality,2003,22(26):271-272.
    [49]管业鹏,童林夙,陈娜,基于双目立体视觉的偏转线圈测量方法研究,电子学报,2003,31(9):1382-1385.
    [50]高庆吉、洪炳熔、阮玉峰,基于异构双目视觉的全自主足球机器人导航,哈尔滨工业大学学报,2003,35(9):1029-1032,1088
    [51]陈锡爱,徐方,基于手眼立体视觉的机器人定位系统,计算机应用,2005,25:302-304.
    [52]高媛媛,关胜晓,许栋,基于立体视觉运动速度检测系统的研究及实现,计算机工程与应用,2005,41(2):45-53.
    [53]姜立军,甘东兵,王国荣,基于双目视觉传感的计算机辅助骨外科手术导航模型,华南理工大学学报(自然科学版),2006,34(2):67-72.
    [54]马桂珍,谌海新,马丙辰,基于双目视觉的手术器械跟踪定位技术,微计算机应用,2005,26(2):181-183.
    [55]杨耀权,施仁,高镗年,基于光学三角原理的视觉检测系统及应用,华北电力大学学报,1998,28(3):64-68.
    [56]陶国智,邾继贵,叶声华,一种基于模型的位姿求取方法,天津大学学报,2000,33(2):197-201.
    [57]Piotr Jasiobedzki,Mark Abraham,Perry Newhook,and Jimmy Talbot,Model Based Pose Estimation for Autonomous Operations in Space,International Conference on Information Intelligence and Systems(ICIIS'99),1999.
    [58]Fubito Toyama,Kenji Shoji,and Juichi Miyamichi,Model-Based Pose Estimation Using Genetic Algorithm,14th International Conference on Pattern Recognition(ICPR'98),1998,1.
    [59]Katrin Stark,Siegfried Fuchs,A Method for Tracking the Pose of Known 3-D Objects Based on an Active Contour Model,Proceedings of the 1996 International Conference on Pattern Recognition(ICPR'96),1996,905-909.
    [60]Chin-Chun Chang,Wen-Hsiang Tsai,Reliable Determination of Object Pose from Line Features by Hypothesis Testing,IEEE Transactions on Pattern Analysis and Machine Intelligence,1999,21(12):1235-1341.
    [61]Danijel Sko caj and Ales Leonardis,Robust Recognition and Pose Determination of 3-D Objects Using Range Images in Eigenspace,Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling(3DIM,01),2001.
    [62]Toshiyuki AMANO,Shinsaku HIURA,Akashi YAMAGUTI,Seiji INOKUCHI,Eigen Space Approach for a Pose Detection with Range Images,Proceedings of the 1996 International Conference on Pattern Recognition(ICPR'96),1996,622-626.
    [63]江海标,陈宗基,一种基于先验知识的3D位姿参数识别方法,航空计测技术,1997,18(1):6-9.
    [64]毛德柱,周凯,张伯鹏,基于遗传算法的工件位姿求取研究,制造技术与机床,2001,1:10-11.
    [65]杨忠根,基于最小冗余子集的单视图鲁棒精确复原目标三维位姿,模式识别与人工智能,2001,14(1):38-41.
    [66]解玉文,丁希仑,刘颖,基于CCD和超声的物体位姿检测方法及精度分析,北京航空航天大学学报,2005,31(7):809-813.
    [67]丁希仑,解玉文,基于多传感器信息融合的物体位姿检测方法,航空学报,2002,23(5):483-486.
    [68]姜立军,王国荣,轴对称回转体空间位置与姿态定位的立体视觉方法,工程图学学报,2005,5:84-88.
    [69]易亨瑜,胡晓阳,张凯,吕百达,三维轴对称目标的简化识别,中国激光,2005,32(4):466-469.
    [70]左森,郭晓松,杨必武,郭君斌,基于矩形子块法的快速全局立体匹配算法,计算机工程与应用,2005,41(33):91-94.
    [71]Kanade T,Okutomi M,A stereo matching algorithm with an adaptive window:theory and experiment,IEEE Transactions on Pattern Analysis and Machine Intelligence,1994,16(9):920-932.
    [72]徐奕,周军,周源华,立体视觉匹配技术,计算机工程与应用,2003,39(15):1-5,62.
    [73]Hong L,Chen G,Segment-based stereo matching using graph cuts,Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition,2004,1:74-81.
    [74]Vladimir Kolmogorov,Ramin Zabih,Steven Gortler,Generalized multicamera scene reconstruction using graph cut,International Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition,2003,2683:501-516.
    [75]Felzenszwalb P F,and HuttenlocherD P,Efficient belief propagation for early vision. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition,2004,1261-1268.
    [76]Brown M Z,Burschka D,Hager G D.Advances in computational stereo,IEEE Transactions on Pattern Analysis and Machine Intelligence,2003,25(8);993-1008.
    [77]林国余,张为公,基于控制点的分层双向动态规划立体匹配算法,信息与控制,2006,35(3):411-416.
    [78]刘正东,孙权森,杨静宇,基于特征约束及区域相关的体视匹配方法,计算机工程与应用,2003,39(34):38-40.
    [79]周东翔,蔡宣平,孙茂印,一种基于特征约束的立体匹配算法,中国图象图形学报,2001,6A(7):653-656.
    [80]孙华燕,李迎春,李生良,基于证据理论的立体匹配决策,光学精密工程,2000,8(2):136-139.
    [81]周东翔,蔡宣平,孙茂印,基于模糊判别的立体匹配算法,中国图象图形学报,2001,6A(4):359-360.
    [82]夏永泉,刘正东,杨静宇,一种基于正交矩的立体匹配方法,系统仿真学报,2005,17(9):2082-2084.
    [83]Nicu Sebe,Michael S.Lew,Maximum Likelihood Stereo Matching,Proceedings of the International Conference on Pattern Recognition(ICPR'00),2000.
    [84]M.Hatzitheodorou,E.A.Karabassi,G Papaioannou,A.Boehm,T.Theoharis,Stereo Matching Using Optic Flow,Real-Time Imaging,2000,6,251-266.
    [85]夏利民,谷士文,孙星明,基于免疫算法的立体匹配,计算机工程,2001,27(5):1-4,7.
    [86]Kyu-Phil Han,Kun-Woen Song,Eui-Yoon Chung,Seok-Je Cho,Yeong-Ho Ha,stereo matching using genetic algorithm with adaptive chromosomes,Pattern Recognition,2001,34:1729-1741.
    [87]刘艳梅,薛定宇,徐心和,基于人工神经网络的立体视觉定位方法,计算机工程与应用,2005,22:33-35.
    [88]徐彦君,杜利民,侯自强,金贵昌,一种用于立体匹配的改进的神经网络方法, 中国图象图形学报,1998,3(10):845-848.
    [89]胡海峰、熊银根,中国图象图形学报A,一种基于Hopfield网络的立体匹配方法,2004,19(6):729-736.
    [90]Aiqiu ZUO,Q.M.Jonathan WU,William A.GRUVER.Stereo vision guided control of a Stewart Platform[A],Proceedings of the 2002 IEEE International Symposium on Intelligent Control[C].Vancouver,BC,Canada:IEEE,2002,125-130.
    [91]K.Mikolajczyk,C.Schmid.A performance evaluation of local descriptors[J],IEEE Transactions on Pattern Analysis and Machine Intelligence,2005,27(10):1615-1630.
    [92]Y Kel,R.Sukthankar.PCA-SIFT:A more distinctive representation for local image descriptors[A],Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition[C],Washington,DC,USA:IEEE Computer Society,2004,2:506-513.
    [93]张彦斐,宫金良,李为民,高峰,一种6自由度冗余驱动并联机器人运动学分析及仿真[J],机械工程学报,2005,41(8):144-148.
    [94]吴笛飞,丁永生,郝矿荣,张淑平,一种新型的并联机器人位姿立体视觉检测系统[J],计算机工程与应用,2007,43(33):190-192.
    [95]Tsai Y.AV ersatile Camera Calibration Technique for High-accuracy 3D Machine Vision Metrology Using Off-the Shelf TV Cameras and Lenses[J],IEEE Journal of Robotics and Automation,1987,RA-3(4):323-344.
    [96]L Sobel.On Calibration Computer Controlled Cameras for Perceiving 3D Scenes[J],Artificial Intelligence,1974,5(2):185-198
    [97]D.G Lowe.Distinctive image features from scale-invariant keypoints[J],International Journal of Computer Vision,2004,60(2):91-110.
    [98]K.Mikolajczyk,C.Schmid,A performance evaluation of local descriptors,IEEE transactions on pattern analysis and machine intelligence,2005,27(10):1615-1630.
    [99]Q.Ji,M.S.Costa,R.M.Haralick,L.G.Shapiro,An integrated linear technique for pose estimation from different geometric features[J],Pattern Recognition and Artificial Intelligence,1999,13(5):200-215.
    [100]J.Kennedy and Eberhart R.C.,Particle Swarm Optimization[C],Proceedings of IEEE International Conference on Neutral Networks,1995,4:1942-1948.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700