摘要
从全景图像中取深度信息,提取过程简单,而且无须进行相机标定,正成为国内外三维图像领域研究的热点。
比较完整的深度提取过程包括视图的提取、图像预处理、立体匹配、视差图获取和深度确定等几个部分。本文以从全景图像中提取深度信息为中心。首先,对全景图像技术及其发展进行了详细的阐述,分析并推导出从全景图像中提取深度信息的计算方法；然后重点对全景图像“视图“对之间的视差进行深入的研究。在立体匹配方面,针对全景图像技术的成像特点,采用了基于角点特征的双向匹配算法,并加入Marr立体匹配约束条件,以获得更多的最佳匹配点,然后对得到的视图对间的视差进行分析。最后,利用深度和视差的关系,求出目标点的深度信息。
Taken depth information from Integral Imaging, the extraction process is simple and doesn't require camera calibration, and three-dimensional image reconstruction is becoming a hot area of research at home and abroad.
A complete process of depth extraction includes the following parts:extraction of view image, image pre-processing, stereo matching, disparity map and depth extraction. This paper carried out the research centering at depth extraction from Integral Imaging.Firstly,we described the Integral Imaging technique and its development in detail; Analyzed and derived the calculation method of depth information extraction from Integral Image; Then focused on the research of disparity analysis between the view image pairs. In stereo matching, by analyzing imaging features of integral imaging, use corner-based feature two-way matching algorithm, and add Marr stereo matching constraints to obtain more the best match points, and then conduct a parallax analysis between view images. Finally, by the relationship between depth and parallax, it finds out depth information of target points.
引文
[1]章毓晋.图像理解与计算机视觉.清华大学出版社,2000：140-148.
[2]邹阳,邓善熙,梁发云.自动立体显示技术的研究发展.合肥工业大学学报.2005,28(8)：869-872.
[3]D.F. McAllister.3D Displays[M]. Janpan:Wiley Encyclopedia on Imaging,2002:1327-1344.
[4]魏伟.面向真三维显示的体视化若干技术研究：[硕士学位论文].浙江：浙江大学计算机应用专业,2008.
[5]冯茂岩,沈春林.立体显示技术及其研究现状.电视技术.2008,32(11)：42-43.
[6]姜太平.真三维立体显示技术研究：[博士学位论文].江苏：南京航空航天大学自动化学院,2007.
[7]丁剑飞,刘永进.三维立体显示技术综述.系统仿真学报.2008,20：132-135.
[8]丁辉,付梦印.立体显示技术最新进展.电视技术。2006,08：36-38.
[9]梁发云,邓善熙和杨永跃.裸眼立体显示系统结构研究.微电子学与计算机.2005,22(10)：43-46.
[10]谢征.三维显示中的图像放大相关技术研究：[硕士学位论文].南京：南京航空航天大学控制理论与控制工程专业,2006.
[11]宋志成.基于视差障栅原理的立体显示光学系统的研究：[硕士学位论文].安徽：合肥工业大学精密仪器与机械专业,2007.
[12]黄永刚,刘文文.基于视差照明原理的自由立体显示几何建模.液晶与显示.2006,21(5)：579-583.
[13]孙超,苏鸿根.关于Auto stereoscopic 3D技术的几点探讨.计算机工程.2007,33(7)：204-206.
[14]NOTOH, HASHIMOTO A. Relief-like depth map generation algorithm[J]. The Institute of Image Information and Television Engineers,2005,59(10):41-49.
[15]B. Lee, S.Jung, S.-Win and H. H. Park. Three-dimensional display using integral photograph with dynamically variable image planes [J]. Opt. Lett,2001,26(19):1481-1482.
[16]L. Erdmann and K. J. Gabriel. High-resolution digital integral photography by use of a scanning micro lens array [J]. Appl. Opt,2001,40(27):5592-5599.
[17]Sungyong Jung, J.-H Park, H.Choi and B. Lee. Integral 3D Imaging that has an Enhanced Viewing-Angle along Full Direction with No Mechanical Movement[J]. Proc. of SPIE,2003,5006:74-82.
[18]B. Lee, S.Jung and J.-H Park. Viewing-Angle-enhanced integral imaging using lens switching [J]. Opt. Lett.2002,2710):818-820.
[19]Manual Martinez-Corral, Bahram J avidi, Baul Martimez-Cuenca, et al. Integral imaging with improved depth of field of by use of amplitude-modulated micro lens array[J]. APPLIED OPTICS,2004,43(31):1-8.
[20]H. E. Ives. Optical Properties of a Lippman Lenticulated Sheet. J. Opt. Soc. Am.21,1931:17l-176.
[21]N. Davies, M. McComick and M. Brewin. Desine and analysis of an image transfer system using micro lens array. Opt. Eng.33,1994:3624-2633.
[22]Fumio Okano, Jun Arai, Haruo Hoshino, et al. Three-dimensional video system based on integral photography. Opt. Eng.1999,38 (6):1027-1077.
[23]Ju-Seog Jang and Bahram Javidi. Time-Multiplexed Integral Imaging for 3D Sensoring and Display. Optics&Photonics News,2004:36-43.
[24]R. Martinez-Cuenca, G. Savedra, A. Pons, et al. Facet braiding:a fundamental problem in integral imaging. Optics Letters.2007,32(9):1078-1080.
[25]Adrian Stern and Bahram Javidi. Three dimensional image sensing, visualization, and processing using integral imaging. Proceeding of IEEE special issue on 3-D technologies for imaging and display.2006,3.
[26]王红霞,伍春洪,杨扬等.三维全景图像分辨率的仿真分析.系统仿真学报.2009,21(19)：6126-6130.
[27]Dong-Hak Shin, Hoon Yoo. Improved analysis on the signal property of computational integral imaging system. Optics Express.2007,15(21):14107-14114.
[28]G. Passalis, N. Sgouros, S. Athineos, et al. Enhanced reconstruction of three-dimensional shape and texture from integral photography images. Appl. Opt.2007,46(22):5311-5320.
[29]Manolache S, McCormick M and Kung SY. Hirarchical adaptive regularization method for depth extraction from planar recording of 3D-integral images[J]. IEEE Proceeding of ICASSP,2001,3:1433-1436.
[30]Manolache S, Kung SY, McCormick M, et al.3D-object space reconstruction from planar recorded data of 3D-integral images [J]. J. VLSI Signal Processing Systems, Kluwer Academic Publishers,2002,354(1):5-18.
[31]Jea-Hyeung Park, S. Jung and Heejin. Depth extraction by use of a rectangular lens and one-dimensional image modification [J]. Applied Optics,2004,43(25),4882-4895.
[32]ChunHong Wu, Malcolm McCormick, Amar Aggoun, et al. Depth Mapping of Integral Images through Viewpoint Image Extraction with a Hybrid Disparity Analysis Algorithm. DISPLAY TECHNOLOGY.2008,4(1):101 -108.
[33]Dong-Choon Hwang, Dong-Hak Shin and Eun-Soo Kin. Depth Extraction by use of a Computational Integral Imaging Reconstruction Technique. Proceeding of Asia Display.2007, (2):1961-1966.
[34]Piao Yan, Wang Yu. Non-periodic reconstruction technique of computational integral imaging [J]. Journal of information and Computational Science.2008,5(3):1259-1264.
[35]L. Di Stefano, M. Marchionni, S. Mattoccian and etc. A Fast Area-Based Matching Algorithm[J]. Machine graphic&vision,2004,13 (4):197-220.
[36]Kun Wang. Adaptive Stereo Matching Algorithm Based on Edge Detection [J]. International Conference on Image Processing,2004,12 (6):1345-1348.
[37]David J:Fleet. Disparity from Local Weighted Phase-Correlation[J]. In Proceeding of the IEEE International Conference on System, Man, and Cybernetics, San Antonio,1994,1 (1):48-56.
[38]Moraves, H. P. Towards automatic visual obstacle avoidance. Proc.5th International Joint Conference on Artificial Intelligence,1977, pp584.
[39]Trajkovic. M, Hedley. M. Fast corner detector. Image and Vision Computing,1998, (16):75-87.
[40]C.J.Harris, M. StePhens. A combined Corner and Edge Detector [C]. Proceedings of the Fourth Alvey Vision Conference.1988:147-151.
[41]P. Tissainayagam, D.Suter. Assessing the Performance of Corner Detectors for Point Feature Tracking Applications. Image and Vision Computing.2004,22:663-679.
[42]陈白帆,蔡自兴.基于尺度空间理论的Harris角点检测.中南大学学报(自然科学版),2005,36(5)：751-754.
[43]王艳.基于点特征的立体匹配算法研究：[硕士学位论文].南京：南京理工大学检测技术与自动化装置专业,2009.
[44]贾波.正交多目立体视觉中立体匹配算法的研究：[博士学位论文].北京：清华大学信号与信息处理专业,1999.
