基于移动机器人双目视觉的井下三维场景重建方法研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
本文对基于移动机器人双目视觉的井下三维场景重建方法进行了研究,对现有的双目视觉系统模型进行了分析,确定了采用平行双目视觉作为机器人的视觉系统,在研究和分析了传统的摄像机标定方法,摄像机自标定方法的基础上,结合井下巷道的特点提出了基于消隐点的双目视觉系统的标定方法,经实验验证此方法是可行的;在图像的立体匹配上,通过研究和分析现有的图像立体匹配方法的特点,提出了适合井下环境应用的基于特征与支持权值相结合的图像匹配方法,在对采集的井下巷道环境图的应用实验中,可以看出此方法可以得到较好的匹配效果:对井下巷道景深较大的特点,本文提出采用分段重建的方式,即对每一次得到的空间点集只保留测量误差较小的一段重建结果,而相邻两次得到的不同空间点集,用坐标变换的方法先统一到一个坐标系下,然后进行拼接。
This paper researches on3D reconstruction of mobile robotic binocular vision. The existing model of binocular vision system has been analyzed, and parallel binocular vision as a robotic vision system is adopted. Taken the underground characteristics into consideration, vanishing point in binocular vision system calibration is proposed after analyzing the traditional camera calibration and it proves to be feasible. In stereoscopic matching, the approach combining feature and weight-support is proposed to suit to coal mining and it performs well. On account of larger depth of images getting from underground, divided reconstruction of scenes is proposed and only3D points with little error are preserved. After transforming3D points getting from two adjacent measurements in the same coordinate system, we connect these points.
引文
1. 马松德,张正友.计算机视觉—计算理论与算法基础[M]..科学出版社,1998.
    2. 贾云得.2000.机器视觉[M].北京:科学出版社,1982
    3. 李奇,冯华君,徐之海,等.计算机立体视觉技术综述[J].光学技术,1999,25(5):71-73
    4. A. Maki. Stereo Vision in Attentive Scene Analysis[D]. Sweden:Royal Institute of Technology,1996
    5. M. Bjorkman. Real Time Motion and Stereo Cues for Actice Visual Observers [D]. Sweden:Royal Institute of Technology,2002
    6.F.R.Gorrea, C. C. G. Decco, Jun Okamoto Jr. Obtaining Range Information with an Omidirectional Vision System [C]. In 17th International Congress of Mechanical Engineering,2003
    '7. M. Pollefeys, R. Koch, L. V. Gool. Self-calibration'and Metric Reconstruction in Spite of Varying and Unknown Internal Camer Parameters [J]. International Journal of Computer Vision,32(1):1-25,1999
    8. S.Bamard, M. Fisechler. Computational Stereo[J]. ACM Computing Surveys,14(4):553-572,1982
    9. M. Z. Brown, D. Burschka, G. D. Hager. Advances in Computational Stereo [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,25(8):993-1008,2003
    10. T. Kannde, M. Okutomi. A Stereo Matching Algorithm with an Adaptive Window; Theory and Experiment [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,16(9):920-932,1994
    11. D. Marr, T. Poggio. Cooperative Computation of Stereo Disparity [J]. Science,194:283-287,1976
    12. Daniel Scharstein, Richard Szeliski. A Taxonomy and Evaluation of Dense Two-frame Stereo Correspondence Algorithms [J]. International Journal of Computer Vision,47(1):7-42.2002
    13. L. Zitnik, T. Kanade. A Cooperative Algorithm for Stereo Matching and Occlusion Detection [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,22(7):675-684,2000
    14. H. Mayer. Analysis of Means to Improve Cooperative Disparity Estimation [C]. In Proceedings of ISPRS Conference on Photogrammetric Image Analysis, pp:25-31,2003
    15. Y. Ohta, T. Kanade. Stereo by Intra-and Inter-scanline Search using Dynamic Programming [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,7(2):139-154,1985
    16. A. Bobick, S. Intille. Large Occlusion Stereo [J]. International Journal of.Computer Vision,33(3):181-200, 1999
    17. Jian Sun, Nan-Ning Zheng, Heung-Yeung Shun. Stereo Matching using Belief Propagation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,25(7):510-524,2003
    18. S. Roy, I. Cox. A Maximun-flow Formulation of the N-camera Stereo Correspondence Problem [C]. Inernational Conference on Conputer Vision, pp:492-499,1998
    19. H. Ishikawa, D. Geiger. Occlusion, Discontinuities, and Epipolar Lines in Stereo [C]. In European Conference on Computer Vision, pp:232-248,1998
    20. Y. Boykov, O. Vekeler, R. Zabih. Makov Random Fields, with Efficient Approximations [C]. In IEEE . Conference on Computer Vision and Pattern Recognition, pp:645-65,199.8
    21. S. Geman, D. Geman. Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,6(6):721-741,1984
    22. R. Potts. Some Generalized Order-disorder Transformation [C]. In Proceedings of the Cambridge Philosophical Society, pp:106-109,1952
    23. Hans P. Moravec. Dence 3D Perception for Broad Mobile Robot Applications. http//www.frc.ri.cmu. edu/-hpm.pubs.html
    24. http://www.cs.cmu.edu/-thrun/3D/
    25. http://www.cc.gatech.edu/ai/robot-lab/research/3d/
    26. http://www.aass.oru.se/Research/Robots/index.html
    27. Sangwoo Jo, Qonita M. Shahab, Yong-Moo,Sang Chul Ahn. Indoor Modeling for Interactive Robot Service [C]. SICE-ICASE International Joint Conference, pp:3531-3536,2006
    28. Sabry F. El-Hakim.3D Modeling of Complex Environments [C]. SPIE Proceedings, Electronic Imaging, pp: 162-173,2001
    29. Andrew Howard, denis F. Wolf, Gaurav S. Sukhatme. Towards 3D mapping in large urban environments [C]. In Proceedings of 2004 IEEE/RSJ International Conference on Intelligent robots and Systems, pp:419-424, 2004
    30. Deni Wolf, Andrew Howard,Caurav S. Sukhatme. Towards 3D geometric 3D mapping of outdoor environments using mobile robots [C]. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp:1258-1263,2005
    31. Bjom Jensen, Jan Weingarten, Sascha Kolski, Roland Siegwart. Laser Range Imaging using Moble Robots: From Pose Estimation to 3D-Models [C]. In Proc.1st Range Imaging Research Day, pp:129-144,2005
    32. Dave Ferguson. Volumetric Mine Mapping with 3D Registration [T]. Technical report, Camegie Mellon University,2002
    33. H artmut Surmann, Andreas Nuchter, Joachim Hertzberg. An autonomous mobile robot with a 3D laser range finder for 3D exploration and digitalization of indoor environments [J]. Robotics and Automation Systems. 45(2):181-198,2003
    34. S. Thrun, W. Burgard, D. Fox. A real-time algorithm for mobile robot mapping with application to multi-robot and mapping [C]. In IEEE Intemational Conference on Robotics and Automation(ICRA). pp: 31-328,2000
    35. C. Fruh, A. Zakhor.3D model generation forgities using aerial photographs and ground level laser scana [J]. Computer Visuon and Pattern Recognition,2(2):31-38.2001
    36. H. Zhao, R. Shibasaki Reconstruting textured CAD model for urban environment using vehicle-borne laser range scanners and line cameras [C]. In Second Internaional Workshop on Computer Vision System, pp: 284-295,2001
    37. The ACTS RESOLV(Reconstruction using Scanned Laser and Video) Project,1999. http://www.comp.leeds.ac.uk/resolv
    38. AVENUE(Autonomous Vehicle for Exploration and Navigation in Urban Environments) Project,2001. http://www.cs.columbia.edu/robotics/projects/avenue/
    39. 邱茂林,马颂德,李毅.计算机视觉中摄相机定标综述[J].自动化学报,26(1):43-54,2000
    40. R. Y. Tsai. An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision[C]. In Proceeding of IEEE Conference of Computer Vision and Pattern Recognition, pp:364-374,1986
    41.孟晓桥,胡占义.摄相机自标定方法的研究与进展[J].自动化学报,29(1):110-112,2003
    42. 吴福朝.计算机视觉中的数学方法.科学出版社,2008
    43.张毅,罗元,郑太雄等.移动机器人技术及其应用.电子工业出版社,2007
    44. 罗均,谢少荣,翟宇毅,王琦等.特种机器人,化学工业出版社,2004
    45.张永军,张祖勋,张剑清,利用二维DLT及光束法平差进行数字摄像机标定,武汉大学学报(信息科学版)。2002,Vo1.27 No.6
    46. R. Y. Tsai. An efficient and accurate camer calibration technique for 3D machine vision. Proc. IEEE Conference on Computer Vision and Pattern Recognition, Miami Beach, F1:364-374,1986
    47. Zhang Zhang you. A flexible new technique for camera calibration [J] IEEE Trans on PAMI,2000,22(11): 374-376
    48. S Maybank,O D Faugeras. A theory of self-calibration of a moving camera [J]. International Journal of Computer Vision,1992,8(2):123-151
    49.李析,郑南宁,程洪.一种Kruppa方法的摄像机线形自标定,西安交通大学学报,2003.8 Vol.28(SpecialIssue)
    50.李华,胡占义,一种新的线性摄像机自标定方法,计算机学报,Vol.23 No.11:1121-1129,2000
    51.袁野,田中旭,欧宗瑛,一种基于主动视觉的线性自标定方法,小型微型计算机系统,2003.11,Vo124No.11
    52.杨长江,汪威,胡占义,一种基于主动视觉的摄像机内参数自标定方法,计算机学报,1998.5Vol.21 No.5
    53. M. Pollefeys, Koch, R., Vergauwen, M., Van Gool, L. Automated reconstruction of 3D scenes from sequences of images. ISPRS Journal of Photogrammetry & Remote Sensing Vol.55, Issue.4,2000,
    54. Caprile, B., Torre,V. Using Vanishing Points for Camera Calibration. Int. J. Computer Vision,1990,4(2): 127-140
    55. S. T. Barnard, Interpreting perspective images, Artificial Intelligence 21,1983, pages 435-462
    56. T Tuytelaars, L. Van Gool, M. Proesmans and T. Moons The Cascaded Hough Transform as an Aid in Aerial Image Interpretation [C]. Proceedings of 6th International Conference on Computer Vision, January 1998, Bombay, India,67-72
    57. C. Rother A new approach for vanishing point detection in architectural environment [C]. Proceedings of the British Machine Vision Conference.2000
    58.舒远,谈正.一种新的基于消失点的自动测量算法[J].红外与激光工程。2003,32(5):479-483
    59. 章毓晋.图像工程.清华大学出版社,2005
    60. B. Caprilev. Torre. Using vanishing points for camera calibration. International of Computer Vison. Volume 4, Number 2.
    61. R.Hartley. Multile View Geometry in Computer Vision [M]. London:Cambridge University Press.2003.
    62. Cipolla R,Drummond T, Robertson D. Camera calibration from vanishing points in images of architectural scenes [A]. In:Proceedings of British Machine, Vision Conference [C], Nottingham, English,1999.
    63.谢文寒基于多像灭点进行相机标定的方法探究.博士学位论文,武汉:,武汉大学,2004。
    64. M. Z. Brown, D. Burschka, and G.D. Hager. Advances in computational stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence,2003.25(8):pp.993-1008
    65. Venkateswar V, Chellappa R. Hierarechical stereo and motion correspondence using feature groupings[J]. Int J of Computer Vision.1995.15(3):245-269.
    66. D. S charstein and R. Szeliski, A taxonomy and Evaluation of Dense Two-From Stereo Correspondence Algoriths. Computer Vision,2002.47(1):pp.7-42
    67. Muhlmann K, AIER, Hesser J. Calculating dence disparity maps from color stcre images, an efficient implementation[J]. Int J of Computer Vision.2002.47(1-3):79-88.
    68. Kolmogorov V, Zabin R. What energy functions can be minimized via graph cuts? [J]. IEE Trans on Pattern Analysis and Machine Intelligence,2004,26(2):147-159.
    69. Gong M, Yang Y H. Fast unambiguous stereo matching using reliability based dynamic programming[J]. IEEE Trans on Patter Analysis and Machine Intelligence,2005.27(6):998-32.
    70. 徐奕,周军,周源华.基于小波基动态规划的相位匹配[J].上海交通大学学报,2003,37(3):388-392.
    71. L. G. Brown. A survey of image registration techniques. ACM Computing Surveys,1992.24:326-376.
    72. Veksler O. Fast variable window for stereo correspondence using integral images[C]. Proc of IEEE Conf on Computer Vision and Pattern Recognition. Madison,2003:556-561.
    73. Wang L, Kang S B, Shun H Y. Cooperative segmentation and stero using perspective space search[C]. Proc of Asion Conf on Computer Vision. Jeju Island,2004:366-371.
    74. Yoon KJ, Kweon I S. Locally adaptive support-weight approach for visual correspondence search[C]. Proc of IEEE Conf on Computer Vision and Pattern Recongnition. San Diego,2005:924-931.
    75. Lee S. H, Kanatsugu Y., and Park J. I. Hierarchical stochastic diffusion for disparity estimation. CVPR 2001 Stereo Workshop/IJCV 2002.
    76. 沈沛意.基于像素点转移图像合成的若干关键技术研究,西安电子科技大学博士研究生学位论文.1999.
    77. Muquit M A, Shibahara T, Aoki T, A high-accuracy passive 3D measurement system using phase-based image matching[J]. IEICE Trans on Fundamentals of Electronics, Communications and Computer Sciences. 2006, E89-A930:686-697'
    78. Fleet D J, Jepson A D. Stability of phase in formation [J]. IEEE Trans on Pattern Analysis and Machine Intelligence,1993,15(12):1253-1268.
    79.徐彦君,杜利民,侯自强.基于相位尺度自适应立体匹配方法[J].电子学报.1999,27(7):38-41.
    80. Cox I J, Hingorani S L, Rao S B. A maximum likelihood stereo algorithm[J]. Computer Vision and Image Understanding,1996,63(3):542-567.
    81. 高文,陈熙霖.计算机视觉-算法与系统原理,清华大学出版社,1999
    82. Levine M D.1972. Computer determination of depth maps. Computer Graphics and Image Process. A.2:131-150.
    83. Moravec H D.1977.Towards automatic visual obstacle avoidance. Pro.5th IJCAI,584.
    84. Smith, S.M, Brady, J M.1997. SUSAN-A new approach to low level image processing. International Journal of Computer Vision,23(1):45-78
    85. Harris C G, Stephens M J. A Combined Comer and Edge Detector[C]//Proceeding of the 4th Alley Vision Conference. Manchester, England:[s.n.],1988.
    86. David G. Lowe. Distinctive image features from scale-invariant key points [J].International Journal of Computer Vision,2004,60(2):91-110.
    87. Koenderink J. The structure of images. Biological Cybernetics,1984,50(35):363-369.
    88. Lindeberg Tony. Scale-Space for discrete Signals. IEEE Transactions on Pattern Analysis and Machine Intelligence,1990,12 (3):234-254.
    89. Beril Sirmacek, Cem Unsalan. Urban-Area and Building Detection Using SIFT Key points and Craph Theory. IEEE Transaction on Geoscience and Remote sensing, Vol.47 No.4, April 2009.
    90. Kanade T., Okutomi.. A stereo matching algorithm with an adaptive:IEEE Transactions on Pattern Analysis and Machine Intelligence,1994,16(9):920-932
    91. Boykov Y, Veksler O, Zabih R. A variable window approach to early vision[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,1998,20(12):1283-1294
    92. Veksler O. Fast variable window for stereo correspondence using integral images [A]. IEEE Conference on Computer Vision and Pattern Recognition[C], Madison:IEEE Computer Society,2003
    93. Fusiello A, Roberto V, Trucco E. Efficient stereo with multiple windowing [A]. IEEE Conference on Computer Vision and Pattern Recognition[C]. San Juan:IEEE Computer Society,1997
    94. Kang S B, Szeliski R, Jinxjang C. Handling occlusions in dense multi-view stereo [A]. IEEE Computer Society,2001
    95. Tao H, Sawhney H S, Kumar R. A global matching framework for stereo computation[A]. IEEE Conference on Computer Vision and Pattern Recognition[C]. Vancouver:IEEE Computer Society,2001
    96. Wang L, Kang S B, Shum H Y. Cooperative segmentation and stereo using perspective space search[A]. Asian Conference on Computer Vision[C]. Jeju:Asian Federation of Computer Vision Societies,2004
    97. Xu Y, Wang D, Feng T, et al. Stereo computer using radial adaptive windows[A]. International Conference on Pattern Recognition[C]. Quebec:IEEE Computer Society,2004
    98. Yoon K J, Kweon I S. Locally adaptive support-weight approach for visual correspondence search[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2006,28(4):650-656
    99. 吕朝辉, 一种基于自适应权值的立体匹配方法.光学技术,vol.33 NO.4 July,2007
    100. Hartley R. Theory and Practice of Projective Rectification. International Journal of Computer Vision.1999.
    101. A,Fusieelo. A compact algorithm for rectification of stereo pairs. Machine Vision and Applications. Volume 12,2000
    102. T. Masuda, A unified approach to volumetric registration and integration of multiple range images. Proc. Of Int. Conf. on Pattern Recognition,1998(2):977-981
    103.吴斌.大型物体三维形貌数字化测量关键技术研究.天津大学博士学位论文,2002
    104. Besl P Makay. A Method for Registration of 3D Shape [J]. IEEE Transactions on Patten Analysis and Machine Intelligence,1992,14:239-256.
    105. Chen Y, Medioni G. Object Modeling by Registration of Multiple Range Images [J]. Image and Vision Computing,1992,10:145-155
    106. Soon-Yong Park, Murali Subbarao. An Accurate and fast Point-to-Plane Registration Technique [J]. Pattern Recognition Letters,2003,24:2967-2976
    107. Andrew Edie Johnson, Sing Bing Kang. Registration and Integration of Textured 3D Data [J]. Image and Vision Computing,1999,17:135-147
    108. Horn B K P. Closed from solution of absolute orientation using unit quaternions. Journal of the Optical Society of America A,1987,4(4):629-642
    109. Arun K S, Huang T S, Blostein S D. Least-squares fitting of two 3-D point sets. IEEE Transactions on Pattern A nalysis and Machine Intelligence,1987,9(5):698-700
    110. Horn B K P, Hilden H M, Negahdaripour S. Closed from solution of absolute orientation using orthonormal matrices. Journal of the Optical Society of America A,1988,5(7):1127-135
    111. Walker M W, Shao L, Volz R A. Estimating 3-D location parameters using dual number quaternions. Computer Vision and Graph Image Processing:Image Understand,1991,54(3):358-367
    112. M. Pollerfeys. Obtaining 3D Models with a Hand-Held Camera. Course No.12, Siggraph 2000
    113. Emanuele Trucco and Alessandro Verri. Introductory Techniques for 3-D Computer Vision. Prentice Hall, Edition 1,1997

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700