高显现力三目视觉测量关键技术
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
视觉测量目前已成为一项应用非常广泛的精密测量技术,随着计算机技术的延伸和拓展,视觉测量技术也受到了更广泛的关注。本文提出了基于平行光照明的三目视觉测量系统方案,通过选择平行光源照明方式,可改变目标在各位置相机中的显现方式和显现力强度,利用三相机图像信息的差异性实现互补或者差分融合,能够提高前景目标的显现力,并去除掉背景噪声或非测量目标的干扰影响。目标前景的对比度提高、显现力增强,对于分离前后背景信息,提高目标特征边缘饱和度、均匀性都是非常有帮助的,为实现更高精度的特征形貌检测或者轮廓尺寸测量打下了基础。
     本文研究的主要内容包括:
     1.采用了基于平行光照明的三目视觉测量系统方案,讨论了该系统的设计原理及意义。完成了硬件系统的搭建,主要包括:照明光源系统、视频采集系统、多自由度可调节平台等部分。通过平行光照明系统的光学参数、机械结构和电气控制系统的设计,研制了光源系统。搭建了可以灵活调节水平角度和三个自由度位移量的平台系统。
     2.对系统的图像匹配特征点检测算法进行了研究。为了获取多图像中的匹配特征点,针对匹配图像中常见的角点、圆和椭圆特征分别提出了智能检测方案:基于harris原理的自动角点检测算法,基于hough变换的圆特征自动检测算法,结合hough变换和椭圆拟合原理的椭圆特征自动检测算法。通过引入不同的实验对象,分析了目标偏转角度对于角点提取的影响。以提取的圆特征和椭圆特征中心的行、列直线度来评价两种特征检测算法的特征提取精度。对比分析了圆特征自动检测算法及椭圆拟合算法对椭圆特征的处理结果。
     3.对系统的图像配准和相机标定技术进行了深入分析。采用了基于特征点的2D图像配准方案,并提出了DLT和Ransac相结合的图像2D射影变换关系计算方法。设计实验分析了在高斯噪声和野值点对的影响下,DLT和Ransac组合算法的运算精度、时间复杂度等情况,并通过对不同目标的实验处理,分析算法的实际匹配效果和精度。由浅入深的分析了相机几何模型,实验中提出了三种相机内参标定方案,并结合不同实验对象,分析了不同标定条件对相机内参数计算的准确性和稳定性的影响。
     4.采用了基于前后景采样点对比度和区域灰度评价的图像融合系数优化方法,分析了不同系数的融合结果的特点,实现了金属工件缺陷及表面细微凹凸、起伏变化形貌的检测。分别以金属工件和量块为对象,对比单目相机系统讨论了本系统在目标特征轮廓尺寸测量方面的特点。为了实现目标不同信息(比如内、外边缘和缺陷边缘)分离显示,提出了基于Radon一维定向投影的目标分类信息提取方法。通过获取不同分类信息的位置特点,使信息分离,便于对目标各信息的轮廓尺寸进行分析。
     5.以两种高漫射率目标为对象,分析了高漫射率目标的三相机成像效果,并提出了基于序列差分的多图像融合策略,比较两种应用目标的采样点对比度走势,分析了它们的漫射率效果,提出了系统在目标反射、漫射效果方面的评价方法。
Visual measurement is widely used in precision measurement technology. With the extension and expansion of computer technology, visual measurement technique has also received more attention. The thesis has proposed a series of relevant key topics about trinocular vision measurement system based on the illumination of parallel light. The manifestation method and manifestation intensity of the cameras at each site could vary for the choice of parallel light as the source. Through the processing method of complementarity or difference fusion of the image differences obtained by multiple cameras, the manifestation intensity of the foreground could be highlighted and the background noises or the interference effect of the non-measurement object could be removed. It could be very useful to separate the foreground information from the back ground to improve the saturation and uniformity of the feature edges. So this method could achieve higher precision in characteristic morphology detection and coutour dimension measurement than traditional signal-camera system.
     The main contributions of the thesis include:
     1. A trinocular vision measurement system based on the illumination of parallel light is proposed and the design principles and significance are discussed. The hardware of the system is designed and built, mainly including light source system, video capture system, adjustable platform of multi-degree of freedom and etc. With the design of the optical parameters、mechanical structures and electrical control system of the parallel light, a light source system is developed. Additionally, a platform system is built up, which could make the devices flexibly rotate at horizontal plane, and move along the directions of three degrees of freedom.
     2. The algorithm for detecting matching feature points of images in the trinocuar vision system are studied. In order to obtain matching feature points in three images, we propose some intelligent detecting methods for the features of corner point, circle, ellipse feature, including automatic corner points detection algorithm based on harris principle, automatic circle features detection algorithm based on hough transformation principle, automatic ellipse features detection algorithms based on the combination of the harris and hough transformation principles. The influences of target deflection angle on corner extraction are analyzed through different experiment targets. The row、column straightness obtained from the center points of circle or ellipse features is used to judge the extraction accuracy of the detection algorithms. The methods of detecting ellipse features with Both of the circle feature detection algorithms and ellipse fitting algorithms are comparative analyzed.
     3. The image registration and the calibration technique of the system has been deeply analyzed. 2D image matching method based on feature points is used, and a calculation method of 2D projective transformation relationship based on DLT and Ransac is proposed. Experiments are designed to analyze the influence of Gauss noise and wild point pairs on precision and time complexity when the DLT and Ransac combined method is used. Moreover, the actual matching effect and precision of the calculation method are analyzed through experiments processing on different objects. The geometric models of the camera system are analyzed and three kinds of camera internal parameters calibration schemes are proposed. Combined with different objects, we analyze the influences of different calibrate condition on the accuracy and stability of camera internal parameters calculation.
     4. A image-fusion coefficient optimization method is proposed which is based on the judgment methods of both the contrast ratio of the sampling points and the grey region. The characteristics of image fusion results with different coefficients are analyzed. With different fusion schemes, information, including defects detection, micr-concave-convex or fluctuant changes on the surface of workpiece, to be detected. The metal workpiece and gauge block are used as targets separately. It is discussed that the trinocuar vision system is much better in the measurement of contour dimension than the single vision system. In order to achieve the separation of the different information( such as the inner、outer edge and defect edge ), we proposed an classified information extraction method based on Radon, which is a one-dimensional directionally projection method. With the obtained positions of the different classified information, we could separate them from the image to conveniently analyze the contour dimensions for each information.
     5. The trinocuar vision imaging effect of the high diffusion target is analyzed through experiments of two high diffusion targets. And three-image fusion strategy based on serial image difference is proposed. Comparing the contrast ratio trend of the sample point in two targets, the different diffusion effects of these two targets can be understood. Then a judgment method is proposed about the reflection、diffusion effect of different material.
引文
[1]叶声华,王仲,精密测试技术展望,中国机械工程,2000,11(3):262~263
    [2]殷纯永,仪器科学与技术发展建议,中国机械工程,2000,11(3):264~266
    [3]朱正德,谈“机器视觉”在汽车制造业中的应用,中国测试技术,2006,32(5):22~25
    [4] W.A.Perkins,INSPECTOR:A Computer vision system which learn to inspect parts,IEEE Trans,PAMI-5:584~592
    [5] W.S.Wilson,The role of vision in a dimensional control strategy,Proc. of the Society of Manufacturing Engineers Conf,on Vision Section 7,1985:43~55
    [6]刘常杰,邾继贵,杨学友等,汽车白车身在线激光视觉检测站,仪器仪表学报,2004,25(4):671~672
    [7] Franci Lahajnar,Machine vision system for inspecting electric plates,Computer in Industry,2002,47:113~122
    [8] Keiichiro Kagawa,Koutaro Yasuoka,David C.Ng,Pulse-domain digital image processing for vision chips employing low-voltage operation in deep-submicrometer technologies,IEEE Journal of Selected Topics in Quantum Electronics,2004,10(4):816~828
    [9] Jurgen Acker,Dominik Henrich,Manipulating deformable linear objects: Characteristic features for Vision-based detection of contact state transitions,In Proceedings of the IEEE International Symposium on Assembly and Task Planning,2003:204~209
    [10]杨敏,基于机器视觉的发动机气门杆直径及圆度检测研究:[博士学位论文],广州:华南理工大学,2004
    [11]王建民,浦昭邦,晏磊等,大尺寸弧长图像测量系统及其图像处理方法的研究,宇航计测技术,2000,5:51~56
    [12]洪海涛,赵辉,图像技术用于零件尺寸测量的研究,仪器仪表学报,2001,22(3):214~218
    [13] Liangyu Lei,Xiaojun Zhou,Mingqing Pan,Automated vision inspection system for the size measurement of workpieces , Instrumentation and measurement technology conference,2005:872~877
    [14]王仲春,高岳,黄粤熙等,显微成像检测表面粗糙度,光学技术,1998,5:46~48
    [15]白素平,车英,周建民,火炮内膛表面粗糙度检测技术,长春光学精密机械学院学报,2000,24(1):12~14
    [16]左奇,史忠科,基于胶囊完整性检测系统研究,西安交通大学学报,2002,(12):1262~1265
    [17] Jome Derganc,Bostjan,Likar,Rok Bernard,Real-time automated visual inspection of color tablets in phamaceutical blisters,Real-Time Imaging,2003,9:113~124
    [18]罗志勇,刘栋玉,罗新宇,新型高温钢坯长度在线测量系统,光电工程,1995,22(5):32~40
    [19]胡亮,线阵CCD实现钢板表面缺陷在线检测关键技术及其应用研究:[博士学位论文],天津:天津大学,2005
    [20]张建荣,姜昱明,CCD成像在线测量玻璃棒直径的方法研究,应用光学,2004,25(3):53~56
    [21] J.Lassoe,Future vision system for glass works,Glass Technology,1997,38(2):43~45
    [22] Guyer.D.E,Miles.G.E,Schreiber.M.M,et.al.,Machine vision and image p rocessing for plant identification,Trans of the ASA E,1986,29(6):1500~1507
    [23] Berlage.A.G,Cooper.T.M,Aristazabal.J.F,Machine vision identification of diploid and tetraploid ryegrass seed,Trans of the ASA E,1988,31(1):24~27
    [24] Seginer I,Elster R T,Goodrum J W,et.al.,Plant wilt detection by computer vision tracking of leaf tips,Trans of the ASAE,1992,35 (5):1563~1567
    [25] Shimizu.H,Heins.R.D,Computer vision based system for plant growth analysis. Trans of the ASAE,1995,38 (3):959~964
    [26] N. Kondo,Y. Nishitsuji,P.P. Ling, K. C. Ting,Visual feedback guided robotic cherry-tomato harvesting,Transactions of the ASABE,39(6):2331~2338
    [27]王江枫,罗锡文,计算机视觉技术在芒果重量及果面坏损检测中的应用,农业工程学报,1998,14(4):186~189
    [28]张俊雄,荀一,李伟,张聪,基于计算机视觉的柑橘自动化分级,江苏大学学报(自然科学版),2007,28(2),100~103
    [29]李庆中,汪娥华,农业生物模式识别中的计算机视觉技术,中国图像图形学报,1999,4(7):610~616
    [30]张建平,吴守一,方如明等,烟叶自动分级模型的建立与训练,农业工程学报,1997,(4):179~183
    [31] Kawamura S,Natsuga M,Takekura K,et.al.,Development of an automatic rice-quality inspection system,Transaction of the ASAE,2002,45(2):379~387
    [32] Zhang Q,Yang W,Howard L,et.al.,Tracing fissure information by scanning electron microscopy characterization of naturally fissured surfaces of rice kernels,Transactions of the ASAE,2003,46(6):1583~1588
    [33]应义斌,饶秀勤,赵匀等,机器视觉技术在农产品品质自动识别中的应用研究进展,农业工程学报,2000,16(3):4~7
    [34]徐常胜,徐焱,田英利,马颂德,计算机视觉在口腔医学中的应用,《1998中国控制与决策学术年会论文集》,1998
    [35]姚敏茹,林俊亭,万宏强,基于机器视觉技术的药片包装缺损检测系统的研究,电子机械工程,2004,20(2),62~64
    [36] J.W.Roach,J.K.Aggarwal,Determining the movement of objects from a sequence of images,IEEE Trans. on PAMI-2,1980:554~562
    [37] T.D.Williams,Depth from camera motion in a real world scene,IEEE Trans. on PAMI-2,1980:511~516
    [38] A.P.Pentland,A new sense for depth of field,IEEE Trans. on PAMI-9,1987,(4):523~531
    [39] R.N.Neison,T.Y.Young,Determining three-dimensional objects shape and orientation from a single perspective view,Optical Engineering,1986,25(3):394~401
    [40] R.Horaud,New method for matching 3-D objects with single perspective views,IEEE Trans. on PAMI-9,1987(3):401~412
    [41] http://www.aicon3d.de/en/start.html
    [42] http://www.gom.com/
    [43] http://www.axios3d.de/
    [44] http://www.falcon.hu/indexeng.html
    [45] http://www.geodetic.com/
    [46]钦桂勤,黄桂平,卢成静,V-STARS数字摄影三坐标测量系统精度测试及应用,计量学报,2008,29(4A):200~203
    [47] Minoru Asada,Takamaro Tanaka,Visual Tracking Of Unknown Moving Object By Adaptive Binocular Visual Servoing,Proceeding of the 1999 IEEE International Conference on Multisensor Fusion and Intelligent Systems,1999:249~254
    [48]管业鹏,童林夙,陈娜,基于双目立体视觉的偏转线圈测量方法研究,电子学报,2003,31(9):1382~1385
    [49]高庆吉,洪炳熔,阮玉峰,基于异构双目视觉的全自主足球机器人导航,哈尔滨工业大学学报,2003,35(9):1029~1032
    [50] http://www.creaform3d.com/zh/default.aspx
    [51] Yajun Fang , Ichiro Masaki , and Berthold Horn , Depth-Based Target Segmentation for Intelligent Vehicles: Fusion of Radar and Binocular Stereo,IEEE Transactions on Intelligent Transportation Systems,2002,3(3):196~202
    [52] Eduardo Montijano,Carlos Sagues,Distributed multi-camera visual mapping using topological maps of planar regions,Pattern recognition,44(7):1528~1539
    [53] D. Shima,S. Hata,I. Ishimaru,3-D Vision Systems for Micro-Operation and Its Application,Industrial Electronics Society,The 27th Annual Conference of the IEEE,2001,1(1):267 ~272
    [54] Emilio J. Gonzalez-Galvan,Sergio R. Cruz-Ramirez,Michael J. Seelingerb,An efficient multi-camera, multi-target scheme for the three-dimensional control of robots using uncalibrated vision,2003,19(5):387~400
    [55]张祖勋,杨生春,张剑清,多基线数字近景摄影测量,地理空间信息,2007,5(1):1~4
    [56] Zhenzhong Wei , Guangjun Zhang , Inspecting verticality of cylindrical workpieces via multi-vision sensors based on structured light,Optics and Lasers in Engineering,2005,43 (10):1167~1178
    [57] Meng-Fen Ho,Chuan-YuTseng,Cheng-ChangLien,Chung-LinHuang,A multi-view vision-based hand motion capturing system,Pattern Recognition,2011,44(2):443 ~453
    [58]李鑫,基于多目视觉的布匹瑕疵在线检测方法研究,硕士论文,天津科技大学,2008
    [59]图像和机器视觉产品手册,北京凌云光视数字图像技术有限公司,2005
    [60]浦昭邦,光电测试技术,北京:机械工业出版社,2005
    [61]唐娅琴,几种图像平滑去噪方法的比较,西南大学学报,2009,31(11):125~128
    [62]胡蕾,张伟,覃庆炎,几种图像去噪算法的应用分析,信息技术,2007,31(7):81~83
    [63] Huang T.S,Yang G.J,Tang G.Y,A fast two-dimensional median filtering algorithm,IEEE transactions on acoustics,speech and signal processing,1979,27(1):13 ~18
    [64] B.Justusson , Statistical properties of median filters in signal and image processing (unpublished report), Math. Inst., Royal Inst. of Technology,1977.
    [65] Jeong B,Lee Y H. Design of weighted order statistic filter using the perception algorithm,IEEE Transactions on Signal Processing,1994,42 (11):3264~3269
    [66]秦鹏,丁润涛,一种基于排序阈值的开关中值滤波方法,中国图象图形学报,2004,4:412~416
    [67]王敏,程京,张帆,一种改进的自适应中值滤波算法,微计算机信息,2010,26(4):109~111
    [68]吕哲,王福利,常玉清等,区域自适应中值滤波器,系统仿真学报,2007,19(23):5411~5414
    [69]贾洪涛,朱元昌,王建华,扩展自适应中值滤波器的原理与实现,中国图象图形学报,2004,9(8):947~950
    [70] L. Bretzner,T. Lindeberg ,Feature Tracking with Automatic Selection of Spatial Scales,Computer Vision and Image Understanding,1998,71:385~392
    [71] T.Lindeberg,Feature detection with automatic scale selection,International journal of computer vision,1998,30(2):76~116
    [72] D.G.Lowe , Distinctive Image Features from Scale-Invariant Keypoints , International Journal of Computer Vision,2004,60(2):91~110
    [73] R.A.Haddad,A.N.Akansu,A Class of Fast Gaussian Binomial Filters for Speech and Image Processing,IEEE Transactions on Acoustics,Speech and Signal Processing,1991,5(39):723~727
    [74] Shapiro L.G.,Stockman G. C,Computer Vision,Prentence Hall,2001
    [75] Mark S.Nixon,Alberto S.Aguado,Feature Extraction and Image Processing,Academic Press,2008
    [76]许兵,尹宏杰,朱珺等,基于SUSAN及其改进算法的InSAR干涉图滤波研究,大地测量与地球动力学,2010,30(4):68~73
    [77]刘博,仲思东,一种基于自适应阈值的SUSAN角点提取方法,红外技术,2006,28(6),331~333
    [78] Perez M.M.,Dennis T.J,An adaptive implementation of the SUSAN method for image edge and feature detection,Image Processing,1997,2:394~397
    [79]季虎,孙即祥,邵晓芳等,图像边缘提取方法及展望,计算机工程与应用,2004,(14):70~73
    [80] Sobel I.,Feldman G.,A 3x3 isotropic gradient operator for image processing, in Pattern Classification and Scene Analysis,1973:271~272
    [81] Prewitt.J , Object enhancement and extraction in Picture Processing and Psychopictorics,Academic Press,New York,1970
    [82] Roberts L G,Machine Perception of Three-dimensional Solids,Optical and Electrooptical Information processing,MIT Press,1965
    [83] Kirsch.R,Computer determination of the constituent structure of biological images,Computer and Biomedical Research,1971,14(3):315~328
    [84] D. Marr,E. Hildreth,Theory of Edge Detection,Proceedings of the Royal Society of London,Series B,Biological Sciences,1980,207(1167):187~217
    [85] Canny J.,A Computational Approach To Edge Detection,IEEE Trans. on Pattern Analysis and Machine Intelligence,1986,8(6):679~698
    [86] R. Deriche,Using Canny's criteria to derive a recursively implemented optimal edge detector,Int. J. Computer Vision,1987,1:167~187
    [87] L.Kitchen,A.Rosenfeld,Gray Level Corner Detection,Recognition Letters,1982,3 (1):95~102
    [88] H. Wang,J. M. Brady,Corner detection with subpixel accuracy,Technical Report,Dept. Engineering Science,University of Oxford,1992
    [89] P.R.Beaudet,Rotationally invariant image operators,Proc. Fourth Int. Joint Conf. On Pattern Recognition,1978,2:579~583
    [90] R. Deriched,G. Giraudon,Accurate corner detection: an analytical study,Proceedings of the 3rd international conference on computer vision
    [91] Chris Harris,Mike Stephens,A Combined Corner and Edge Detector,In Alvey Vision Conference,1988:147~152
    [92] H. P. Moravec,Towards automatic visual obstacle avoidance,Proc. 5th Int. Joint Conf. Artif. Intell.,1977,2:584~584
    [93] Zheng ZQ,Wang H,Teoh EK. Analysis of gray level corner detection,Pattern Recognition Letters,1999,20(2):149~162
    [94] Montesinos P,Gouet V,Deriche R,Differential invariants for color images, Pattern Recognition,1998,1:838~840
    [95] Van de Weijer J,Gevers T,Bagdanov AD,Boosting color saliency in image feature detection,IEEE Trans. on Pattern Analysis and Machine Intelligence,2006,28(1):150~156
    [96] Kang SK,Choung YC,Park JA,Image corner detection using Hough transform,Pattern Recognition and Image Analysis,2005:279~286
    [97] Shen F,Wang H,Corner detection based on modified Hough transform,Pattern Recognition Letters,2002,23(8):1039~1049
    [98]刘勋,毋立芳,林娟,一种改进的Hough变换提取圆的方法,信号处理,2004,20(6):623~627
    [99] Illingworth J,Kittler J,A survey of the Hough transform,Computer Vision,Graphics Image Process,1988,44:87~116
    [100] Remy Bulot,Jean-Marc Boi,Contour segmentation using Hough transform,Image Processing,1996 Proceedings,1996,3:583~586
    [101] L. Xu,E. Oja,P. Kultanan,A new curve detection method: Randomized Hough transform (RHT),Pattern Recognition Letters,1990,11(5):331~338
    [102] D.H. Ballard,Generalizing the Hough Transform to Detect Arbitrary Shapes,Pattern Recognition,1981,13(2):111~122
    [103] A. A. Kassim,T. Tan, K. H. Tan,A comparative study of efficient generalized Hough transform techniques,Image and Vision Computing,1999,17(10): 737~748
    [104] Robert A,McLaughlin,Randomized Hough Transform:Improved ellipse detection with comparison,Pattern Recognition Letters,1998,19:299~305
    [105] RADRS,SMITHKC,BENHABIBB,et.al.,Application of moment and Fourier descriptors to the accurate estimation of elliptical shape parameters , Pattern Recognition Letters,1992,13(7):497~508
    [106]彭青玉,木星土星边缘的椭圆拟合,云南天文台台刊,2003,3(4):43~48
    [107] FITZGIBBON A,PILUM,FISHER R.B,Direct least square fitting of ellipses[J],Pattern Analysis and Machine Intelligence,1999,21(5):476~480
    [108] Kuglin C.D.,Hines D.C.,The phase correlation image alignment method, Cybernetics and Society,1975:l63~165
    [109] Castro E D,Morandi C,Registration of Translated and Rotated Images Using Finite Fourier Transforms,IEEE Transactions on Pattern Analysis and Machine Intelligence,PAMI,1987,9(5):700~703
    [110] Anuta P E,Spatial Registration of Multispectral and Multitemporal Digital Imagery Using fast Fourier Transform Techniques,IEEE Transactions on Geoscience Electronics,1970(8):353-368
    [111] Reddy B.S,Chatteoi B.N.,I An FFT-based technique for translation,rotation and scale—invariant image registration IEEE Transaction on Image Processing,1996,5(8):1266~1271
    [112]方青,王博亮,一种改进的基于模板比值匹配的显微图像拼接,计算机医学工程,2005,31(24):159~160
    [113]俞辉,候在克,何旭莉等,一种基于轮廓特征的图像拼接技术设计与实现,石油大学学报:自然科学版,2003,27(2):114~118
    [114] Lowe D.G.,Object recognition from local scale-invariant features,International Conference on Computer Vision, Corfu, Greece,1999,2:1150~1157
    [115] Lowe D.G.,Distinctive Image Features from Scale-Invariant Keypoints, International Journal of Computer Vision,2004,60(2):91~110
    [116] F. L. Bookstein,Fitting conic sections to scattered data,Computer Graphics and Image Processing Fitting conic sections to scattered data,1981,9(1):56~71
    [117] Richard Hartley,Andrew Zisserman,Multiple View Geometry in Computer Vision (2nd ed.),Cambridge University Press,2003
    [118] Martin A. Fischler,Robert C. Bolles,Random Sample Consensus:A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography,1981,24:381~395
    [119] J. M. Ortega,W. C. Rheinboldt,Iterative Solution of Nonlinear Equations in Several Variables,Classics in Applied Mathematics,SIAM,2000
    [120] W. H. Press,B. P. Flannery,S. A. Teukolsky,Numerical Recipes:The Art of Scientific Computing,Cambridge University Press,2007
    [121] Peter. J. Huber,Robust Statistics,online,1981
    [122]曲兴华,何滢,韩峰,强反射复杂表面随机缺陷检测照明系统分析,2003,23(5),547~551

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700