摘要
全景摄像系统利用双曲面反射镜,通过CCD成像单元一次性成像大于半球视场(360°×180°),一次性获取整个周边360o场景的目标信息。但是,整个场景信息仅由一块CCD传感器捕获,导致全景图像的分辨率质量下降,同时成像系统所存在的运动模糊、离焦模糊和噪声等因素很大程度的降低了目标图像的质量,从而限制了全景视觉传感器在远距离、高清晰度目标观测及识别跟踪等领域的应用。
超分辨率图像重建是利用同一场景互有位移的多帧降质图像或视频序列来重建一帧高分辨率图像的技术。旨在突破图像在硬件设备的分辨率限制,充分利用多帧图像互补信息进行数据融合,从而弥补在图像获取、传输过程中的分辨率下降。目前,图像超分辨率重建技术已经在遥感、军事、公共安全、计算机视觉、医学成像、图像压缩等领域得到了广泛应用。本文研究基于全景图像的超分辨率图像重建方法,提高全景图像的清晰度水平和空间分辨率。
首先,对影像超分辨率重建的基本理论和技术实现进行了比较全面、客观的论述;分析了影像的成像过程及影响影像质量的关键因素。
然后,分析了全景图像角分辨率下降原因及其圆周角分辨率和径向角分辨率的变化规律,在小波多分辨率分析与正交小波变换理论的基础上,分析了基于小波的超分辨率插值重建算法,并将该算法成功应用于全景图像超分辨率重建中,在应用上具有创新性。
The panoram photograph system captures an omnidirectional image which is bigger than the hemisphere field of view(360°×180°) by hyperboloid reflector, access to the entire 360 degrees around the scene of the target information through CCD. However, the resolution of the image is lower than that of conventional camera image, because 360 degree field of view is captured by only one CCD. Moreover the output image would be de degraded due to the blur and noise caused by the imaging system. These disadvantages make it restrictive for some applications where remote and high definition surveillance is needed.
Super-resolution (SR) image fusion is the technology of reconstructing a frame of image with high resolution from a group of warped, blurred and noised low-resolution (LR) images or video sequence about the same scene. The goals of this technology are to break through the resolution limitation of the imaging hardware facilities, to make up the loss of spatial resolution during the acquisition and transmission of images by the help of the data fusion of complementary information between multi-frame images. It can not only improve the visual effect of image, but also be convenient and beneficial for computer to analyze, process, recognize and understand the image. So far, the technology of Super-resolution image fusion has been extensively applied to remote sensing, military, public security, computer vision, medical imaging, image compression and so on. Therefore, in this paper,the measurement and means for enhancing the resolution and definition of the omnidirectional images is researched cased on the SR technique.
Firstly, A comprehensive review of the basic theories and techniques of superresolution is addressed .The process of acquiring images and the major factors affecting images' quality are analyzed briefly.
Secondly, the causation of the de decline of the resolution and the special movement of the circumferential resolution and radial resolution is analyzed. Based on the multiresolution analysis with orthonormal wavelets, the wavelet superresolution algorithm for the more general camera motion model is analyzed. The implementation of this algorithm to the superresolution for omnidirectional image is a great progress.
引文
[1]郭晓新.超分辨率重建问题的研究.吉林大学博士学位论文.2005:19页
[2] Henrik Andreasson,Tom Duckett.Topological Localization for Mobile Robots using Omni-directional Vision and Local Features.Proc.of the 5th IFAC Symposium on Intelligent Autonomous Vehicles (IAV),2004:3-11 P
[3] Henrik Andreasson,AndréTreptow and Tom Duckett.Localization for Mobile Robots using Panoramic Vision,Local Features and Particle Filter.Proceedings of the IEEE International Conference on Robotics and Automation (ICRA),2005:3348-3353P
[4] Hashem Tamimi,Henrik Andreasson,AndréTreptow.Localization of mobile robots with omnidirectional vision using Particle Filter and iterative SIFT. Robotics and Autonomous Systems.2006,54(9):758-765 P
[5] Peter Biber,Henrik Andreasson,Tom Duckett and Andreas Schilling.3D Modeling of Indoor Environments by a Mobile Robot with a Laser Scanner and Panoramic Camera . Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).2004:3430-3435p
[6] David Wettergreen , Operating Nomad during the Atacama Desert Trek.Proc of IEEE ICRA,1998:1016-1023 P
[7] Joshua Gluckman SKNA.Real-Time Omnidirectional and Panoramic Stereo.In Fifth European Conference on Computer Vision,1998: 218-232 P
[8]苏显渝.犯罪现场足迹三维模式检测方法与便携式检测系统的研究.国家自然科学基金资助项目(批准号60177001),2001
[9]董再励.面向任务的虚拟环境和人机交互方法研究.国家自然科学基金资助项目(批准号69975020),1999
[10]陈卫东.多机器人系统中适应性群体行为的学习.国家自然科学基金资助项目(批准号60105005),2001
[11]杨国光.180°大视场环形全景凝视成像方法.中国发明专利(FMZL)专利号2004100158280,2004
[12]凌云峰,朱齐丹,甄景蕾等.基于VC与MATLAB的全景视觉反射镜设计.计算机应用与软件.2008,25(4):199-201页
[13]庄惠敏,曹其新.基于计算机仿真的全景视觉镜面设计.微计算机信息.2008,24(16):212-213页
[14]左小祥.基于三维光路仿真的全景成像机理研究.哈尔滨工程大学硕士学位论文.2009:51-53页
[15]刘光宇,刘国栋,韩云生.一种基于全景视觉系统的Robocop机器人定位方法.江南大学学报.2009,8(3):279-282页
[16]陈林鹏,张国良,张合新等.基于RoboCup比赛的全景视觉系统镜面设计.电子器件.2007,30(6):2275-2279页
[17]朱金辉,毕盛,闵华清等.Robocup中型足球机器人运动控制.机电产品开发与创新.2005,18(5):4-12页
[18]孙国祥,丁永前.基于模糊算法的足球机器人目标跟踪控制.计算机仿真.2009,26(3):165-168页
[19]杨鹏,高晶,刘作军等.基于全景与前向视觉的足球机器人定位方法研究.控制与决策.2008,23(1):75-83页
[20]梁燕华,金鸿章,蔡成涛.模糊控制策略在避碰运动系统中的应用.系统仿真学报.2008,20(6):1554-1558页
[21] Cai Ze-Su SLHQ.Robust RBPF for mobile robot using panoramic vision.通讯和计算机.2008,5(1):16-21页
[22]许俊勇,王景川,陈卫东.基于全景视觉的移动机器人同步定位与地图创建研究.机器人.2008,30(4):289-297页
[23] Nguyen N,Milanfa P and Golub G H.Efficient generalized cross- validation with applications to parametric image restoration and resolution enhancement.IEEE Transactions on Image Processing,2001,10(9):1299-1308 P
[24] Elad M and Feuer A.Restoration of a single super-resolution image from several blurred,noisy, and under sampled measured images.IEEETransactions on Image Processing.1997,6(12):1646-1658 P
[25] Nguyen N.Numerical techniques for image super-resolution.Standford University,Standford,California,United States of America,2000 vo1.3 173-176 P
[26] Farsiu S,Robinson D,Elad M and Milanfar P.Fast and Robust Multi- Frame Super-Resolution.IEEE Trans.IP,2004,13(10):1327-1344 P
[27] Elad M. Super-Resolution Reconstruction of Images Static and Dynamic Paradigms[EB/OL]. 2002-02. The Scientific Computing and Computational Mathematics Program-Stanford University. http://www-stem.stanford.edu /~elad/Lectures/Super-Resolution_All.ppt
[28] Electrical Engineering Department Buskin School of Engineering, University of California, Super- resolution software pocket. [EB/OL] http://www.cse.ucsc.eduhmilanfar/ SR-Sofiware.htm
[29] Zhao W Y,Sawhney H S and Hansen M W.Supun Samarasekera: Super-Fusion:A Super-Resolution Method Based on Fusion.ICPR (2) 2002:269-272 P
[30] Ng J and Bose N . Mathematical Analysis of Super-resolution Methodology.IEEE Signal Processing Magazine.2003,20(3):62-74 P
[31] Vio R,Nagy J.Tenorio L and Wamsteker W.A simple but efficient algorithm for multiple-image deblurring. Astronomy&Astrophysics.416, 403-410 P
[32] Ng M,Chan R, Chan T and Yip A.Cosine Transform Preconditioners for High Resolution Image Reconstruction.Linear Algebra Appls.2000,316: 89-104 P
[33] Chan R H,Ling R K.Reconstruction of High Resolution Images from Movie Frames, Numer.Math.J.Chinese Univ.(English Ser).2003,12:25-29 P
[34] Chan R H,Chan TF,Shen LX and etal.Wavelet Algorithms for High- Resolution Image Reconstruction,SIAM J.Sci.Comput.2003,24: 1408-1432 P
[35] Chan R H,Chan TF,Shen LX and etal.Wavelet Deblurring Algorithms for Spatially Varying Blur from High-Resolution Image Reconstruction.Linear Algebra Appls.2003,366:139-155 P
[36] Yagi Y , Kawato S , Tsuji S . Real-time omni-directional image sensor(COPIS) for vision-guided navigation.IEEE Trans Robotics and Automation.1994,1(1):11-27 P
[37] Elad M and Feuer A.Super-Resolution Reconstruction of Continuous Image Sequences.International Conference on Image Processing-ICIP 1999,Kobe,Japan,1999 P
[38] Rees,D.W.Panoramic television viewing system.United States Patent No.1970,3:505-465 P
[39] David Wettergreen,Operating Nomad during the Atacama Desert Trek. Proc of IEEE ICRA,1998:1016-1023 P
[40] Rajagopalan A N and Chaudhuri S.Recursive computation of maximum likelihood function for blur identification from multiple observations.IEEE Trans.Image Processing.1998,7:1075-1079 P
[41] Rajah D and Chaudhuri S.A generalized interpolation scheme for image scaling and super-resolution . Workshop on Vision . Models and Visualization (VMV).Erlangen,Germany,Nov.1999
[42] Terry Boult,Applications of Omnidirectional Imaging.Multi-body tracking and remote reality.IEEE Trans on PAMI.1998,10(5):713-770 P
[43] Wood S,Rajah D,Christensen M and et al.Resolution improvement for compound eye images through lens diversity.In Proceedings of DSP workshop.New Mexico,2004
[44] Kim H W,fang H and Hong K S.Edge-enhancing super-resolution using anisotropic diffusion . Proc . IEEE Intl . Conf . Image Process. Thessaloniki,Greece.Oct 2001:130-133 P
[45] Shin J H , Jung J S and Paik J K . Image fusion-based adaptive regularization for image expansion.Proc.SPIE Image,Video Comm, Proc.2000,3974:1040-1051 P
[46] International conference on super resolution imaging.Theory algorithms and applications . [EB/OL] http : //hkumath . hku . hk/ math/event/Super/home.htm
[47]赵书斌,张蓬,彭思龙.基于小波域HMT模型的彩色图像超分辨率复原.中国图象图形学报,2004,9(2):172-177页
[48]赵书斌,张蓬,彭思龙.基于小波域LS方法的图象超分辨率重构算法.中国图象图形学报.2003,8A(11):1283-1285页
[49]郭坡,彭思龙,余达太,孙昌国.保留边缘信息的静态数字图象超分辨率重建.中国图象图形学报.2003,9A(6):653-656页
[50]李金宗,黄建明,陈凤等.超分辨率处理中振铃现象的分析与抑制.系统工程与电子技术,2003,25(6):664-668页
[51]孟庆武.预估计混叠度的MAP超分辨率处理算法.软件学报,2004, 15(2):207-214页
[52] JIANG Zhong-ding, LIN Hai,BAO Hu-jun, and etal.A super-resolution method with EWA.Comput.Sci.&Technol.2003,18(6):822-832p
[53]王程,王润生.基于MAP框架的图像序列超分辨率和模板匹配.计算机学报.2003,26(8):961-967页
[54]邵凌,丁佩律,张立明,胡波.从多帧低分辨率图像序列中获取高分辨率图像的算法研究.电子学报.2002,30(1):58-61页
[55]邵凌,丁佩律,张立明,胡波.重建高分辨率图像的实时串行迭代算法.红外与毫米波学报.2002,21(2):104-108页
[56]陈小蔷,张俊,吴乐南.多帧超分辨率重建中的插值方法.信号处理.2004,20(3):268-271页
[57]程臻,黄槐,姜新发.贝叶斯超分辨率方法探讨.系统工程与电子技术,2000,22(10):27-29,96页
[58]刘良云,李英才,相里斌.超分辨率图象重构技术的仿真实验研究.中国图象图形学报,2001,6A(6):629-635页
[59]周峰.提高航天传输型CCD相机地面像元分辨率方法研究.航天返回与遥感.2002,23(3):35-42页
[60]周峰.关于亚像元成像技术几个问题的探讨.航天返回与遥感.2002,23(4):26-33页
[61] R Micheals , A Erkan , Frame-rate Multi-body Tracking for Surveillance.Proc IEEE Comput.Soc.Conf.Comput.Vision and Pattern Recogn,1999:1106-1112P
[62] Tekalp A M,Ozkan M K and Sezan M L.High-resolution image reconstruction for lower-resolution image sequences and space-varying image restoration.Proceeding of the IEEE international conference on Acoustics,Speech and Signal Processing.San Francisco,CA,1992
[63] Hao Pengwei,Xu Guanhua,Zhu Chongguang,Spectral methods for spatial resolution improvement of digital images.Science in China(Series E),1999.42(4):365-375 P
[64] B.R.Frieden,H.Gc Aumann,Image reconstruction from multiple 1-D scans using filtered localized projection,Applied Optics,1999.26(17):3615-3621 P
[65] M.Irani,Shmuel Peleg.Motion analysis for image enhancement: resolution, occlusion,and transparency.VCIR.Vol 4 No.4, December 1993:324-335 P
[66] B.C.Tom and Aggelos K. Katsaggelos,Resolution enhancement of video sequences using motion compensation, Proc.1996 IEEE International Conf.on Image Processing,I-713-716,Lausanne,Switzerland,Sept.1996
[67] R.R.Schultz,Stevenson,R.L.Improved definition image expansion, Acoustics,Speech,and Signal Processing.1992.ICASSP-92.1992 IEEE International Conference on,Volume 3:23-26 P
[68] R.R.Schultz, Stevenson,R.L.A Bayesian approach to image expansion for improved definition,Image Processing,IEEE Transactions on,May 1994,Volume 3:233-241 P
[69] RC.Hardie,Barnard,K.J.Armstrong, E.E.Joint MAP registration and high-resolution image estimation using a sequence of undersampled images,Image Processing, IEEE Transactions,Volume:6 Issue:12,Dec 1997:1621-1633 P
[70] D.C.Youla and H.Webb.mage Restoration by the Method of Convex Projections Part 1 theory . IEEE Transactions on Medical Imaging.vol.MI-1,Oct.1982:2,81-94 P
[71] H.Stark,P.Oskoui,High-resolution image recovery from image-plane arrays.using convex projections.J.Opt.Soc.Am.A,1989.6(11): 1715-1726 P
[72] A.J.Patti,Ibrahim Sezan,M.Murat Tekalp.High-resolution image of reconstruction from a low-resolution image time-varying motion blur, Image Processing,1994.Proceedings.ICIP-94.IEEE.International Conference,1994:343-347 P
[73] M.Elad. Super-resolution reconstruction of images.Ph.D.dissertation Israel Institute of Technology,1996
[74]曹聚亮.图像超分辨率处理、成像及其相关技术研究.国防科学技术大学博士学位论文.2004:16-20页
[75] M.Elad and A.Feuer.Super-Resolution Restoration of an Image Sequence.International Conference on Image Processing-ICIP 1999.vol.3 Kobe,Japan,October 1999. Page(s):459-463 P
[76]曾吉勇.折反射全景立体成像.四川大学博士学位论文.2003:24-25页
[77]袁小华.超分辨率图像恢复中的方法研究.南京理工大学博士论文.2005:9-10页
[78] M.C.Hong,M.Cz Kang,and A.K.Katsaggelos.An iterative weighted regularized algorithm for improving the resolution of video sequences in Proceedings of the IEEE International Conference on Image Processing.Santa Barbara,CA,Oct 1997:474-477 P
[79]贾亮.图像超分辨率重建技术研究.南京航空航天大学硕士论文.2008:39-41页
[80]林虹.基于小波和插值的超分辨率图像重建算法.西安电子科技大学硕士学位论文.2005:11页
[81] Nguyen.N, Milanfar.P.A Wavelct-Based Interpolation-Restoration Method for Superresolution Circuits Systems Signal Process.2000:9(4):321-338 P
[82]程光权.基于小波的超分辨率图像重建.国防科学技术大学硕士学位论文.2005:36页
[83]朱锡芳.一种基于连续小波阈值的图像去噪新算法.微电子学与计算机.2007,24(11):181-185页
[84] D.L.Donoho,I.M.Johnstone, G.Kerkyacharian etal.Wavelet shrinkage:asymptopia.Journal of royal statistics society series,1995,57:301-369.
[86] P.Moulin,Liu Juan. Analysis of multiresolution image denoising schemes using generalized-Gaussian and complexity priors . IEEE Transaction Information Theory.1999,45:909-919 P