基于标记约束的三维曲面拼接方法研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
大型物体数字化采用视觉测量的手段来实现,为获得较高的测量精度,往往需要分块测量,利用三维曲面拼接技术将区域数据进行整合拼接,实现物体整体形貌测量。测量回转体时,因回转体各部分相互遮挡,从任何测量角度都无法实现一次完成整个回转体的三维测量工作。因此,三维曲面拼接技术是实现物体形貌测量的关键技术。
     本课题组前期工作提出了基于符号M阵列结构光的三维检测方法,实现了二值光源投射下动态场景的检测与三维重建。为了将该三维检测方法应用于三维拼接,本文对三维拼接方法进行研究。同时为满足对不具有明显表面特征、不宜采用自由拼接的物体的测量和拼接,本文提出了一种基于标记约束的三维曲面拼接方法。该方法在检测对象上设置1组标记,通过提取标记,获得标记的图像坐标,进而求解标记的世界坐标,由标记的世界坐标解出变换矩阵,实现两个三维曲面的拼接。本文主要工作包括以下几个方面:
     (1)改进三维标定和检测方法。为提高前期三维检测方法的精度,本文首先对三维检测方法进行改进。通过对标定数据的正确性进行检查,采用去极值求均值法矫正异常标定数据,解决因标定数据误差造成重建曲面噪声的问题。针对解码符号误匹配现象,提出窗口扩展匹配法,采用3×3窗口,降低因符号误识别破坏窗口唯一性的可能性,有效地解决符号误匹配问题。研究了适合面结构光三维检测重建曲面的平滑方法,根据检测对象表面平缓的特征,过滤曲率较大的尖锐噪声点,解决重建曲面上较大噪声无法平滑的问题,为后续拼接工作奠定基础。
     (2)标记提取和匹配方法研究。考虑到标记在三维拼接中起决定性作用,为了确保标记被正确识别,研究了通过黄金分割搜索阈值方法对标记图像进行合理的阈值分割,通过扫描标记的白色连通域及其包含的黑色内连通域识别标记,该方法稳定性强。通过与提取出的标记图像坐标邻近的关键点世界坐标,按标记与这些关键点间图像距离比例进行估计标记的世界坐标。标记设置制约着标记匹配和变换矩阵求解,本文从便于标记匹配角度研究标记设置方法,且兼顾变换矩阵求解,使得标记匹配和变换矩阵求解工作变得容易。
     (3)拼接方法研究。介绍变换矩阵求解过程,通过变换矩阵将待拼接曲面坐标系统一到参考曲面坐标系上。研究了在参考曲面坐标系下提取两个曲面的公共区域方法。并根据公共区域内检测点的世界坐标,提出了评判两个曲面是否配准方法。针对曲面未配准情况,研究了估计两个曲面夹角和位移的方法,通过多次对待拼接曲面旋转和平移,最终实现两曲面近似配准。
     (4)三维曲面拼接实验。进行曲面拼接实验,并对实验结果及误差进行分析。
Digital morphology of large objects and closed surface can be realized by means of vision measurement, and it often needs to block measurement, the regional data is integrated by using three-dimensional image mosaic technique, realizing the overall morphology measurement of objects. Therefore, the three-dimensional image mosaic technique is a key technology to realize the object morphology measurement.
     According to whether there have constraints, image mosaic technique can be divided into free mosaic and constraint-based mosaic. Free mosaic extracts the characteristic information to realize the image mosaic through the common part of the adjacent detection area, suitable for checking the obvious characteristics objects due to its flexible. However, several times of mosaic prone to cause cumulative errors. Constraint-based mosaic can be divided into sensor location constraint and image control point constraint according to the different ways of constraint. The sensor views the object from a different perspective, the relationship between two adjacent sensors’location is known, this approach often requires ancillary equipment to calibrate the relationship of sensor location, and the operation is more complicated. Image control point constraint can realize the integration of image data by using the tag information, which was added to the measurement object, it just depends on the tag information to carry out the space image mosaic, but the extraction of tag information is very complex, and the mosaic errors are larger, so it’s suitable for applications of less demanding to the mosaic accuracy.
     As a foundation of three-dimensional image mosaic technique, the accuracy and robustness of the three-dimensional detection restricts the precision and success rate of the three-dimensional mosaic. The three-dimensional detection method based on the structure light of symbols M array was put forward by the research group, the detection of dynamic scene and three-dimensional reconstruction was realized under the projection of binary light. This method is used in certain occasions, it can measure the object for a single color, and the surface curvature must small, the angle among the detection objects, the projection devices and CCD must small, and the light must weak. Due to the characteristics of detection objects, which have the small surface curvature, free mosaic is not suitable.
     Subject to the three-dimensional detection method based on the structure light of symbols M array that was put forward by the research group, a novel approach for three-dimensional image mosaic based on the mark constraint is put forward in this paper, which is based on the improvements of three-dimensional detection method. The method is set a group of markers on the detective object in order to get the marked image coordinate through extracting the markers, and then the marked world coordinate can be got, the transformation matrix can be solved by the world coordinates of markers, and then the three-dimensional image mosaic can be realized. This paper includes the following aspects:
     (1) Improve the three-dimensional detection method. The correctness of the calibration data is inspected, and the correction calibration data method is proposed. The windowing extension matching method is proposed according to the phenomenon of the decoding symbol mismatch, which effectively solves the problem of symbol mismatching. A smooth method which is suitable for the reconstruction surfaces of structured light three-dimensional detection is studied, and the problem of large burr can not be smooth in the reconstruction surfaces is solved, so has laid the foundation for the following mosaic work.
     (2) Study on marker extraction and matching method. Considering the marker plays a decisive role in three-dimensional mosaic, the marker extraction through the Golden Section methods to search threshold is studied in order to ensure there is no marker loss. Although this method’s efficiency is not high, it’s very stable. The world coordinates of the markers can be solved through the extracted markers image coordinates. Marker setting restricts marker matching and the transformation matrix solution, Marker setting is studied from the point of view of symbol matching, and the transformation matrix solution is also considered.
     (3) Study on mosaic method. The solving process of transformation matrix is introduced; the coordinate system of the mosaic image is integrated into the reference image coordinate system through the transformation matrix. The method of extract the common region of two images under the reference image coordinate is studied. Whether the two images registration is proposed according to the world coordinates of the detective points in the common region. According to the image without registration, the method of calculates the angle and displacement between two images is studied; the two images’registration was finally realized through the rotation and translation of the mosaic image many times.
     (4) The experiment of three-dimensional image mosaic. Image mosaic experiment was carried out, and the results of the experiment and the errors were analyzed.
引文
[1]吴斌,大型物体三维形貌数字化测量关键技术研究[D].天津:天津大学.2002
    [2]张国雄,三坐标测量机[M],天津:天津大学出版社,1998
    [3]H.J.Pahk, Development of computer aided inspection system with CMM for integrated mold manufacturing, Annals of the CIRP, 1993, (42)p:557-560
    [4] A.Limaiem, H.A.Elmaraghy, Automatic path planning for coordinate measuring machines, Proc.of the 1998 IEEE Int.Conf.on Rob.&Auto, 1998(1)p:887-892
    [5] Mattos, L., Grant, E.. Passive Sonar Applications: Target Tacking and Navigation of an Autonomous Robot[C]. Robotics and Automation, 2004. Proceedings. ICRA '04. 2004 IEEE International Conference on, Vol.5, April 26-May 1, 2004. p:4265– 4270
    [6] Kao-Shing Hwang, Jeng-Yih Chiou, Ming-Yi Ju, Yuan-Sun Chu. Navigation Based on Sonar Sensing in a Partially Structured Environment[C]. Neural Networks and Signal Processing, 2003. Proceedings of the 2003 International Conference on, Vol.1, 14-17 Dec. 2003. p:454– 456
    [7] Tena Ruiz, I., de Raucourt, S., Petillot, Y., Lane, D.M.. Concurrent Mapping and Localization Using Sidescan Sonar[J]. Oceanic Engineering, IEEE Journal of, Vol.29(2), April 2004. p:442–456
    [8] Rikoski, R.J., Leonard, J.J.. Trajectory Sonar Perception[C]. Robotics and Automation, 2003. Proceedings. ICRA '03. IEEE International Conference on, Vol.1, 14-19 Sept, 2003. p:963-970
    [9] Heon-Hui Kim, Yun-Su Ha, Gang-Gyoo Jin. A Study on the Environmental Map Building for a Mobile Robot Using Infrared Range Finder Sensors[C]. Intelligent Robots and Systems, 2003. (IROS 2003). Proceedings. 2003 IEEE/RSJ International Conference on, Vol.1, Oct. 27-31, 2003. p:711-716
    [10] Adachi, Y., Saito, H., Matsumoto, Y., Ogasawara, T.. Memory-Based Navigation Using Data Sequence of Laser Range Finder[C]. Computational Intelligence inRobotics and Automation, 2003. Proceedings. 2003 IEEE International Symposium on, Vol.1, 16-20, July, 2003. p:479-484
    [11]Yamashita, A., Hayashimoto, E., Kaneko, T., Kawata, Y.. 3-D Measurement of Objects in a Cylindrical Glass Water Tank with a Laser Range Finder[C]. Intelligent Robots and Systems, 2003. (IROS 2003). Proceedings. 2003 IEEE/RSJ International Conference on, Vol.2, 27-31 Oct, 2003. p:1578-1583
    [12]Zhuang Yan, Xu Xiaodong, Pan Xuejun, Wang Wei. Mobile Robot Indoor Navigation Using Laser Range Finder and Monocular Vision[C]. Robotics, Intelligent Systems and Signal Processing, 2003. Proceedings. 2003 IEEE International Conference on, Vol.1, 8-13, Oct. 2003. p:77-82
    [13]Kluge, B., Kohler, C., Prassler, E.. Fast and Robust Tracking of Multiple Moving Objects with a Laser Range Finder[C]. Robotics and Automation, 2001. Proceedings 2001 Icra. IEEE International Conference on, Vol.2, 2001. p:1683-1688
    [14] Okada, N., Hongbin Zha, Nagata, T., Kondo, E., Morooka, K.. 3-Dimensional Object Model Construction from Range Images Taken by a Range Finder on a Mobile Robot[C]. Intelligent Robots and Systems, 1998. Proceedings., 1998 IEEE/RSJ International Conference on, Vol.3, 13-17, Oct, 1998. p:1853-1858
    [15] JoséGaspar, Niall Winters and JoséSantos. Vision-Based Navigation and Environmental Representations with an Omnidirectional Camera[J]. IEEE Transctions on robotics and automation, Vol.16(6), December, 2000. p:890-898
    [16]Chahl, J.S., Srinivasan, M.V.. A Complete Panoramic Vision System, Incorporating Imaging, Ranging, and Three Dimensional Navigation[J]. Omnidirectional Vision, 2000. Proceedings. IEEE Workshop on, 12 June, 2000. p:104-111
    [17] Vitabile, S., Pilato, G., Pullara, F., Sorbello, F.. A Navigation System for Vision-guided Mobile Robots. Image Analysis and Processing, 1999. Proceedings. International Conference on, 27-29, Sept, 1999. p:566–571
    [18] Yi Ma, Kosecka, J., Sastry, S.S.. Vision Guided Navigation for a Nonholonomic Mobile Robot[J]. IEEE Transactions on Robotics and Automation, Vol.15(3), June, 1999. p:521-536.
    [19] Keb Owens and Larry Matthies. Passive Night Vision Sensor Comparision for Unmanned Ground Vehicle Stereo Vision Navigation[C]. Proceedings of the 2000 IEEE International Conference on Robotics and Automation, San Francisco, CA, April, 2000. p:122-131
    [20] Chris P.U., Bernardine D.. Reid G.S.. Stereo Vision Based Navigation for Sun-Synchronous Exploration[C]. Proceedings of the 2002 IEEE/RSJ International Conference on Intelligent Robots and Systems EPFL, Lausanne, Switzerland, October, 2002. p:805-810
    [21]李健,刘先林,刘凤德.基于双立体同步摄影的面部三维重建与量测[J].测绘科学. 2002, 27(2): p43-45
    [22]翟广泉,刘巍,朱仁芝,冯亮.平面立体三维重建多解的新算法[J].计算机工程与应用. 2002, Vol.22: p122-123
    [23] Moravec Hans P. Visual mapping by a Robot Rover[C], Proc 6th International Joint Conference on Artificial Intelligence,1979: p599-601
    [24] Yachida M, Kitamura Y, Kimachi M. Trinocular vision: new approach for correspondence problem[C], Proc 8th International Conference on Pattern Recognition(ICPR), Paris,1986: p1041-1044.
    [25] Shen J, Castan S, Zhao J, A new passive measurement method by trinocular stereo vision[J] Industrial Metrology,1999, Vol.10(3): p231-259.
    [26]许智钦,便携式彩色三维激光扫描系统的研究[D],天津:天津大学,2002
    [27]吴新民,陈进榜,高志山,利用子区域拼接法实现大型物体的3D面形测量[J],南京理工大学学报, 2001, 25(3): p270~272
    [28]Zhengyou Zhang,Iterative point matching for registration of free-form curves and Surfaces[J],International Journal of Computer Vision,1994,Vol.13(2): p119-152
    [29]C.S Chua,R.Jarvis,3D free-form surface registration and object recognition[J],International Journal of Computer Vision,1996, Vol.46(17): p77-99.
    [30] Fernando C.M.Martins, Hirohisa Shiojiri, and JoséM.F. Moura, 3D-3D registration of free formed objects using shape and texture[J], Visual Communication and Image Processing, 1997, Vol. 3024(26): p1055-1065.
    [31] RAJAPAKSE C. S, WALD M. J. , MAGLAND J. , Fast 3D registration of multimodality tibial images with significant structural mismatch[J], Progress in biomedical optics and imaging , 2009, vol. 10,(38): p133-138.
    [32] Fisher, Elizabeth; van der Stelt, Paul F.; Dunn, Stanley M. 3D registration of surfaces for change detection in medical images[J], Image Processing, 1997, Vol. 30(34): p599-610
    [33] Gaoyu Xiao, S.H.Ong ,3D registration of partially overlapping surfaces using a volumetric approach[J], Image and Vision Computing, 2007, Vol.25(6): p934-944
    [34] YARON Avi; BAR-ZOHAR Meir; HORESH Nadav, Miniature stereoscopic video system provides real-time 3D registration and image fusion for minimally invasive surgery[J] the International Society for Optical Engineering , 2007, vol. 6490(9):p1-12
    [35] Ardekani, B.A., Kershaw, J., Braun, M., Kanno, Error analysis of 3D registration of brain MR and PET images using the interhemispheric fissure[J] IEEE Transactions on Medical Imaging 1997, Vol.16(6):p947–952
    [36] Dandan, LiYan, WangZhiyan, LiuJing Jin ,3D registration of ultrasound images based on morphology skeleton[J] Device Research , 2001,Vol.8(3):p14-22.
    [37]薛婷,邾继贵,吴斌等.采用标记约束实现三维图像拼接新方法[J].光电工程. 2005, 32(9):p63—66.
    [38]尚爱军等.基于编码结构光的大型曲面三维测量[J].信息技术. 2008, 4(7): p74—77
    [39]万睿等.结构光三维重构中拼接技术的应用[J].仪器仪表用户. 2007, 15(2):p55—56.
    [40]韩建栋等.采用光学定位跟踪技术的三维数据拼接方法[J].光学精密工程. 2009, 17(1): p45—51.
    [41]杜娜,许凌羽.多目立体视觉坐标测量中拼接方法的研究[J].科技信息. 2007, 27:p133—134.
    [42]陈刚,姚英学.多视点大空间三维坐标数据归一化方法[J].光学精密工程. 2008, 16(7):p1309—1314.
    [43]刘志刚,陈康宁,林志航.三维视觉传感器多视角曲面测量数据的一种配准拼接方法[J].机器人. 1999, 21(6):p415—420.
    [44]张广军,孙军华,魏振忠等.基于单经纬仪的视觉测量三维数据拼接方法[J].仪器仪表学报. 2007, 28(3):p441—445.
    [45]苏斌.一种新的面结构光解码方法及激光投射检测的研究[D].浙江:浙江理工大学2009
    [46]李华强.符号结构光图像解码及重建曲面滤波的研究[D].浙江:浙江理工大学. 2008
    [47]朱暌.面结构光亚像素检测及感知标定方法研究[D].浙江:浙江理工大学. 2009
    [48]方玫.符号结构光分片M阵列编码模式的研究[D].浙江:浙江理工大学2007
    [49] Linda G. Shapiro, George C. Stockman Computer Vision[M].北京:机械工业出版社, 2005.
    [50]孙全颖.机械优化设计[M].哈尔宾:哈尔宾工业大学出版社, 2007.
    [51]张鄂.机械与工程优化设计[M].北京:科学出版社, 2008.
    [52]张广军机器视觉[M].北京:科学出版社, 2005.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700