基于反射镜拼接的图像渐晕处理技术研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
随着遥感相机技术对地面分辨率和视场覆盖范围的要求越来越高,单图像传感器能够提供的图像信息已经不能满足人们的需求,基于大面阵CCD的制造工艺越来越复杂、成本越来越高的情况,不断有人提出CCD拼接的技术满足目前对大视场的要求。对目前的CCD拼接技术进行总结后发现反射式分光法具有能量利用率高、拼接长度长、无像差等优点而成为具有广泛应用前景的拼接技术。
     本文的反射镜光学拼接方法使用普通反射镜为分光元件,比其它的反射式分光法使用的反射镜加工工艺简单、扩展性更好,具有很高的实际应用价值。但是反射式分光法不可避免都存在渐晕问题,本文针对反射镜光学拼接系统中的渐晕现象进行了深入的研究,并提出了有效的校正方法实现了渐晕的处理。
     1.从几何光学与物理光学两个角度分别对反射镜光学拼接系统的渐晕现象进行了定量分析:从几何光学角度分析了由于反射镜遮挡导致的部分光线无法在像面上成像出现的能量损失问题,推导出这种情况下渐晕系数的表达式;从物理光学角度分析了由于反射镜边缘直边衍射导致的像面光强分布不均的问题,推导出了这种情况下的渐晕衍射能量分布。为了对反射镜拼接系统的成像质量进行具体分析,在ZEMAX中采用多重结构的方法构建了系统的成像模型,使用动态数据交换机制和光学追迹的方法求解系统的PSF和MTF,以此来分析系统的成像特性和渐晕失真的原因。
     2.为了对反射镜拼接渐晕处理提供一个良好的实验平台,设计了一套基于反射镜光学拼接的双面阵CCD成像系统。使用KAI-2093为图像传感器,详细分析了它的工作原理,并设计了一套合适的驱动电路和高速图像采集电路,采用FPGA片内缓存和RAM块乒乓工作相结合的方式提高了系统信号的完整性和实时性。设计了一种自动曝光控制算法,采用二维搜索的方法判断环境的光照条件,结合KAI-2093的曝光灰度曲线得到曝光补偿曲线,为后续的图像渐晕处理做好了准备。
     3.提出基于理论、辐射定标和退化模型的三种反射镜拼接渐晕处理方法,详细阐述了三种方法的原理和实现过程。基于理论模型的方法以分析得到的光学模型为基础,采用按照像元将像面分割的方法得到补偿因子,由于该方法没有考虑电子学的影响,所以它的意义目前还只限于理论分析;基于辐射定标的方法使用的是实验室辐射定标的数据,所以由此得到的补偿因子具有很好的针对性;为了弥补辐射定标法灵活性方面的缺陷,根据实际成像图片的灰度分布提出了系统渐晕的退化模型,采用最速下降法求解退化模型的几个参数,最后使用退化模型对渐晕图像进行补偿。
     4.文中最后采用图像配准和拼接的方法对反射镜拼接系统的渐晕图片进行处理,目的是为了减少系统测量上的复杂度、降低系统对测试设备的依赖性。输出调整为单片独立输出方式,采用Harris算子提取图像特征点,使用归一化相关法进行粗匹配,采用双向匹配法进一步提纯,最后采用RANSAC算法剔除所有的误匹配特征点,求解出变换模型的参数,采用分段加权平均法和基于梯度法结合的融合方法对图像重叠区域进行处理,最终得到整幅亮度均匀的图像。
With the need of high ground resolution and large ground cover in remotecarema system, monolithic image sensors are not large enough to achieve therequirement. Also because the manufacture technics of large area Charge CoupledDevice(CCD) are more complex and more cost, CCD mosaic technics have beenproposed to meet the requirement in the large field of view(FOV). In this paperseveral mosaic methods are analyzed and compared. To avoid their drawbacks themethod based on reflectors is proposed because of its advantages in higher energyefficiency, longer splice length, no-abberation, et al.
     In the paper, the reflector to be used is commonly and suits to extend, so it has abroad application prospect. However there is vignetting phenomenon in the mosaicsystem based on reflectors which will be discussed and disposed. The primarycoverage of this paper is as follows:
     First, from geometrical optics and physical optics, we analysed the generationmechanism of the vignetting phenomenon, and proposed the vignetting distributionmodel in the middle of the optical field separately. An equivalent optical model basedon muti-configuration technique is set up in ZEMAX for the analysis in the system’soptical characteristics. The system’s Point Spread Function(PSF) and ModulationTransfer Function(MTF) are calculated through dynamic data exchange and opticaltrail methods to analyze the causation of the vignetting phenomenon.
     Second, in order to prove the feasibility of the vignetting correction methods andunderstand the technology difficulties in the design, a prototype camera using thereflector mosaic structure was built which has two area CCD. We analyzed theinterline transfer area CCD KAI-2093’s working principle in detail to put forward anappropriate driving and high speed image collection scheme. we use cache in FPGAand RAM working in ping-pang mode in order to realize signal’s integrality and realtime working mode,. An auto-exposure algorithm was designed to compensate thecamera’s exposure parameters which takes advantage of the large brightness contrastamong different elements in the image, dynamically distinguishes the main object andthe background. All of the above are prepared for the vignetting corrections.
     Third,the methods based on the theory, the radiate calibration and the degeneratemodel are proposed in this paper, separately. The theory correction method is based onthe optical model gained in Chapter Three, which compensates the pixel’s grey valueaccording to the compensation factors achieved by dividing the image plane. But thismethod does not consider the impact of electronics, so it only has sense in thetheoretical analysis. The second method uses the data from the radiate calibration, sothe compensation factors are more accurate but not flexible. So in order to make upthe limitation, after the analysis of the actual image’s grey distribution, the degeneratemodel method is proposed to compensate the vignetting image, which uses thesteepest descent method to get the parameters.
     Fourth, in the end we use the image registration and mosaic algorithm to correctthe vignetting image. The output mode is turned to single, and the scheme uses theHarris operator to pick up the feature points, the NCC function to rough match, thetwo-way matching method for further purification, and finally the RANSACalgorithm to remove all the wrong matching points to obtain the transformation model.The segment weighted average method and the method based on gradient arecombined to process the overlap area to ultimately get the uniform brightness image.
引文
[1]杨秉新.国外航天侦察相机和测绘相机发展概况[J].航天返回与遥感,1998,19(2):16-24
    [2]白杉,杨秉新.航天侦察相机的发展和研发[J].影像技术,2006,2:3-6
    [3]刘明,修吉宏,刘钢,等.国外航空侦察相机的发展[J].电光与控制,2004,11(2):56-59
    [4]天兵.超级侦察兵中的大哥大——美国照相侦察卫星[J].中国国家宇航,2009,9:68-73
    [5]梁巍,周润松.国外侦察卫星最新进展[J].航天器工程,2007,16(3):30-40
    [6]胡君,王栋,孙天宇.现代航天光学成像遥感器的应用与发展[J].中国光学与应用光学,2010,3(6):519-531
    [7]黄贤忠,张建霞,刘宗杰.国产SWDC航空数码相机及其应用[J].测绘通报,2009,9:36-38
    [8]姜景山,王文魁,都亨,等.空间科学与应用(第一版)[M].北京:科学出版社,2001.51-76
    [9]张庆君,马世俊.中巴地球资源卫星成就与发展[J].航天器工程,2009,18(7):1-8
    [10]王树文.关于数字航摄相机DMC若干问题的探讨及研究[J].影响技术.2007(5):52-55
    [11]黄贤忠,张建霞,刘宗杰.国产SWDC航空数码相机及其应用[J].测绘通报,2009,9:36-38
    [12]王喜军,王军,杨会玲,等.基于多CCD拼接相机测角精度检测[J].长春理工大学学报,2005,28(12):36-38
    [13]Hye-Sook Park, etal. RealtimeTracking System for the Wide-Field-of-ViewTelescope Project [J]. SPIE,1989,1111:196-203
    [14]王景泉.21世纪初国外卫星技术及应用的发展趋势与启示[J].中国航天,2000,11:15-19
    [15]段福洲,宫辉力,李小娟.SWDC数字航空摄影仪在特大地震灾害中的应用[J].自然灾害学报,2009,18(10):36-40
    [16]Mathews B.An ultra high resolution, electro-optical framing camera forreconnaissance and other applications using a9216by9216pixel, wafer scale, focalplane array [J].Airborne reconnaissance XXII.1998:144-154
    [17]Dalsa(2006).DALSA Semiconductor Delivers World’s First100+Million PixelCCD Image Sensor Chip to Semiconductor Technologies Associates (STA)[N].Recieved Nov.20,2009, from http://www.dalsa.com/corp/news
    [18]http://www.nasa.gov/centers/goddard/missions/index.html美国NASA官方网站
    [19]张星祥,任建岳.TDICCD焦平面的机械交错拼接[J].光学学报,2006(5):740-745
    [20]SUGIURA H, KONTANI N,ASAKAWA K, et al.Super-wide-angle cameras byimage synthesis [J]. IEEE,2005,41(2):294-303
    [21]张星祥,任建岳.负压吸附式环形气垫导轨的计算方法[J].光学精密工程,2003,11(5):481-485
    [22]陈福胜.现代夜视技术及其发展方向[J].舰船光学,2001,37(4):1-4
    [23]Geary J C, Luppino G A, Bredthauer R A,et al.4096by4096pixel CCD mosaicimager for astronomical applications[J]. Proc. SPIE.1991,1447:264-273
    [24]Luppino G A, Miller K R. A modular dewar design and detector mountingstrategy for large-format, astronomical CCD mosaics[J]. Publications of AstronmicalSociety of the Pacific.1992,104(673):215-222
    [25]Boroson T A, Reed R, Wong W Y, et al. Development of a8192x8192CCDmosaic imager [J]. Proc. SPIE.1994,2198:877-885
    [26]Stubbs C W, Marshall S, Cook K H, et al.32-megapixel dual-color CCD imagingsystem[J]. Proc. SPIE.1993,1900:192-204
    [27]Jaeoby G, Armandroff T, Boroson T, et al. NOAO CCD MOSAIC IMAGERUSER MANUAL (KPNOSYSTEM)[Z]. NOAO,2000
    [28]Cuil]andre J C, Luppino G A, Starr B M,et al. Performance of the CFH12K: a12K x8K CCD mosaic camera for the CFHT Prime focus [J]. Proe. SPIE.2000,4008:1010-1021
    [29]]Wolfe T, Reed R, Blouke M M, et al. CCD detector upgrade for NOAO’s8192x8192Mosaie[J]. Proe. SPIE.1998,3355:487-496
    [30]Mtlller G P, Reed R, Armandroff T, et al. What is better than an8192x8192CCD mosaic imager: Two wide field imagers, one for KPNO and one for CTIO[J].Proe. SPIE.1998,3355:577-585
    [31]Miyazaki S, Sekiguehi M, Imi K, et al. Characterization and mosaicking of CCDsand the applications to the SUBARU wide-field camera (Suprime-Cam)[J].Proc.SPIE.1998,3355:363-374
    [32]Gunn J E, Carr M, Roekosi C, et al. The Sloan Digital Sky Survey PhotometricCamera[J]. Astronomieal Journal.1998,116:3040-3081
    [33]Luppino G A, Tonry J, Kaiser N. The current state of the art in large CCD mosaiccameras, and a new strategy for wide field, high resolution optical imaging [J].Optical Deteetors for Astronomy II: State-of-the-art at the Turn of the Millennium.2000:119-132
    [34]Iwert O, Baade D, Balestra A, et al. THE OMEGACAM16K x16K CCDDETECTOR SYSTEM FOR THE ESO VLTSURVEY TELESCOPE (VST)[J] Proe.SPIE.2002(4863):189-198
    [35]Deul E, Kuijken K, Valentijn E A. OmegaCAM: the16k x16k Survey Camerafor the VLT Survey Telescope[J]. Proe. SPIE.2002,4836:189-198
    [36]Isobe S, Asalni A, Asher D J,et al. Wide field NEO survoy1.0-m telescope with102k x4k mosaic CCD camera[J]. Proe. SPIE.2003,4836:83-87
    [37]Aune S, Boulade O, Charlot X, et al. The CFHT MegaCam40CCDs camera:cryogenic design and CCD integration[J]. Proc. SPIE.2003,4841:513-524
    [38]Komiyama Y,Miyazaki S,Yagi M,et al. Suprime-Cam: Subaru prime focuscamera[J].2003,4841:152-159
    [39]Komiyama Y, Miyazaki S, Nakaya H, et al. Subaru next-generation wide-fieldcamera: HyperSuprime[J]. Proc. SPIE.2004,5492:525-532
    [40]Hinz A, Drstel C, Heier H. DMC The digital sensor technology of Z/I Imaging[J].Proe.of Photogrammetric Week.2001:93-103
    [41]Hinz A,D Rstel C,Heier H. Digital modular camera: System concept and dataprocessing workflow[J]. International Archives of Photogrammetry and RemoteSensing.2000,33:164-171
    [42]Hinz A, Drstel C, Heier H. DMC The digital sensor technology of Z/I imaging[J].Proe. of Photogrammetric Week.2001:93-103
    [43]Leberl F W, Perko R, Gruber M A, et al. Novel Concepts for Aerial DigitalCamera [J]. ISPRS.2002
    [44]Leberl F, Gruber M, Ponticelli M, et al. The Ultracam Large Format AerialDigital Camera System[C]. Proe. The ASPRS,2003
    [45]Gruber M A, Leberl F W, Pontieelli M. Large format camera system Withmultiple coplanar focusing systems: U.S.Patent,7,339,614[P].2008
    [46]林宗坚,宣文玲,孙杰等.由小面阵CCD组合构成宽角航空相机[J].测绘科学.2005,30(001):94-98
    [47]Abell G R,Cook F J,Howes P D. Method and apparatus for arraying imagesensor modules: U.S. Patent,4,323,925[P].1982
    [48]何听,魏仲慧,郝志航.基于单心球面系统的九块面阵CCD数字拼接[J].光学精密工程.2003,11(004):421-424
    [49]Burrows C J. Hubble sPace telescope: wide field and planetary camera2instrument handbook [M].1995
    [50]李朝辉,王肇勋.空间相机CCD焦平面的光学拼接[J],光学精密工程.2000,8(3):213-216
    [51]Jain S C,Meduff O P. Optical butting of matrix arrays[J]. Proe.SPIE.1988,979:172-175
    [52]KanekoY,Saitoh M,Hamaguehi l,et al. Image forming apparatus for formingimage corresponding to subjeet, by dividing optical image corresponding to thesubjeet into plural adjaeent optical image parts: U.S.Patent,5194959[P].1993
    [53]Rubin,Leoind Borisovich Moseow S L,Viktor Vladimirovich Moseow S R,etal. Optical system for partitioning a real image: U.S.Patent,5,835,278[P].1993
    [54]Harvey R P. Optical beam splitter and eleetronic high speed camera ineorporatingsuch a beam splitter:U.S. Patent,5,734,507[P].1998
    [55]雷华.基于金字塔反射镜的视场无缝拼接技术研究[D]:[博士学位论文].浙江大学光电信息工程学系,2010
    [56]马文礼,叶宝珠,邹德春,等.高精度10片面阵CCD光学焦平面拼接[J].光电工程,1994,21(5):17-22
    [57]郁道银,谈恒英.工程光学.第二版.机械工业出版社,2006.2
    [58]姚启钧.光学教程.第四版.高等教育出版社.2008.6.
    [59]张广军.激光直边衍射CCD位移测量方法[J].实用测试技术,1994(6):10-11
    [60]梁华秋,张永炬.直边衍射光强分布的实验验证[J].大学物理实验,2002(9):36-37
    [61]钱晓凡,胡涛,张晔.基于MATLAB的衍射场模拟计算[J].昆明理工大学学报(理工版),2004(6):132-135.
    [62]ULFIMTSEV P V. Method of edge waves in the physical theory of diffraction[R].Air Force System Command, Foreign Tech. Div Document,1971, ID No.FTD-HC-23-259-71
    [63]UMUL Y Z. Modified theory of physics optics[J]. Optics Express,2004,12(20):4959-4972
    [64]]BornMax, woxfEmil.杨葭荪译.光学原理[M].第七版.北京:电子工业出版社,2005
    [65]Goodman J W. Introduetionto Fourier optics[M].2nded. New York: Roberts&Company Publishers,2005
    [66]Stork D G, Robinson M D. Theoretical foundations for joint digital-opticalanalysis of electro-optical imaging system[J]. Applied Optics.2008,47(10):64-75
    [67]Dowski J E, Cathey W T. Extended depth of field through wave-front coding[J].Applied Optics,1995,34(11):1859-1866
    [68]Csir(2004). MZDDE-The ZEMAX DDE Toolbox for Matlab[N]. Received Jan.5,2010, from http://www.mathworks.es/matlabcentral/fx_files/7507/l/content/MZDDE/Documents/ZEMAX%20DDE%20Toolbox%20for%20Matlab.html
    [69]刘均,高明.光学设计[M].西安:西安电子科技大学出版社
    [70]袁沧旭.光学设计[M].科学出版社
    [71]ZEMAX学习秘笈—葵花宝典[M].上海,讯技光电科技(上海)有限公司,2005
    [72]Data Sheet,CCD KAI-2093Interline transfer area CCD Image Sensor. America:KODAK Imaging,1998.
    [73]陶明慧,张星祥,张宇,等. KAI-2093型面阵CCD多模式驱动时序设计[J].液晶与显示,2011(1),105-110
    [74]刘光昌,陈欣. CCD驱动电路设计的新方法[J].半导体光电,1997,18(4):232~235.
    [75]郭伟强,万志,常磊,金龙旭,任建岳.面阵CCD信号采集系统的噪声抑制[J].发光学报.2008(2):204~208.
    [76]徐培凤.基于图像处理的白动对焦和自动曝光算法研究[D]:[硕士学位论文].南京:江苏大学,2005
    [77]周杰.基于多区域分割及模糊逻辑的自动曝光方法[D]:[硕士学位论文].上海:上海交通大学,2007
    [78]沙占祥.摄影手册.北京:中国摄影出版社,2004
    [79]母国光,战元龄.光学.北京:人民教育出版社,1978
    [80]曾卓荣.照相机曝光时间的计算.物理教师.2003,24(1):41
    [81]付贤松. CMOS图像传感器动态范围扩展技术的研究[D]:[硕士学位论文]:天津:天津大学,2006
    [82]Suji Shimizu,Toshiharu Kondo,Takashi Kohashi,Masaaki Tsuruta.TsruyoshiKomuro,A NEW ALGORITHM FOR EXPOSURE CONTROL BASED ON FUZZYLOGIC FOR VIDEO CAMERAS[J].,IEEE Transaetions on Consumer Electronies,AUGUST1992:38(3)
    [83].Masayuki Murakami,Nakalji Honda,An Exposure Control System of Videocameras Based on Fuzzy Logic Using Color Infonnation[J],0-7803-3645-3/961996IEEE
    [84]June-SokLee, You-Young Jung, Byung-So0Kim and sung-Jea KO, ANADVANCED VIDEO CAMERA SYSTEM WITH ROBUST AF,AE,AND AWBCONTROL[J],IEEE Transactions on Consumer Electronics,AUGUST2001:47(3)
    [85]Toshinobu Haruki,Kenichi Kikuchi,VIDEO CAMERA SYSTEM USINGF1JZZY LOGIC[J],IEEE Transactions on Consumer Electronics,Vol.38,No.3,AUGUST1992
    [86]冯强,霍俊彦,杨海涛.一种新颖的图像抗渐晕技术[J].电子科技,2007,10:67-70.
    [87] Wonpil Yu.Practical anti-vignetting methods for digital cameras [C]. IEEE.975~983.
    [88] Yu-Na Kim, Dong-Gyu Sim.Vignetting and Illumination Compensation forOmni-Directional Image Generation on Spherical Coord [C]. IEEE.on computersociety.2006.
    [89]Asada N,Amano A,Baba M. Photometric Calibration of Zoom Leans System[C].Washington:IEEE Int. Conf. on Pattern Recognition,1996(1):186-190
    [90]Tao Minghui, Ren Jianyue. Non-uniformity Correction in Multi-CCD ImagingSystem[C]. The2010International Conference on Mechanical and ElectronicsEngineering,August1-3,2010:V2257-V2260
    [91]邹谋炎.反卷积与信号复原[Z].北京:国防工业出版社,2001
    [92]任建岳,孙斌,张星祥,陈长征. TDICCD交错拼接的精度检测[J].光学精密工程,2008,16(10):1852-1857.
    [93]Harris C, Stephens M. A combined corner and edge detector[C].In: Proceedingsof the4th Alvey Vision Conference,1988:147-151.
    [94]Anarta G, Nicolai P. Robustness of Shape Descriptors to Incomplete ContourRepresentations[J]. IEEE Transaction on Pattern Analysis and MatchingIntelligence,2005,27(11):1793-1803.
    [95]Greg M, Serge B, Jitendra M. Efficient Shape Matching Using ShapeContexts[J].IEEE Transaction on Pattern Analysis and MatchingIntelligence,2005,27(11):1832-1837.
    [96]Rousseeuw, Leroy P J. Robust Regression and Outlier Detection[J]. John Wiley&Sons Inc. New York,1987.
    [97]Zhang Z Y, Rachid D R, Oliver F. A robust technique for matching twouncalibrated images through the recovery of the unknown epipolar geometry[J].Artifical Intelligence,1995,78(1/2):87-119.
    [98]Fischler M,BSolles R.Random sample consensus:A paradigm for model fittingwith applications to image analysis and automated cartography[J].Communicationsof the ACM,1981,24(6):381–395.
    [99]赵向阳,杜利民.一种全自动稳健的图像拼接融合算法[J].中国图像图形学报,2004,9(4):417-422.
    [100]巫远征.低空航片视频图像拼接[D]:[硕士学位论文].电子科技大学,2007.5.
    [101]刘卫光.图像信息融合与识别[M].北京:电子工业出版社,2008.
    [102]张静,胡志萍,刘志泰,等.基于轮廓相位相关的图像自动拼接[J].大连理工大学学报,2005,45(1):68-74.
    [103]陈涛.图像仿射不变特征提取方法研究[D]:[博士学位论文].武汉:国防科学技术大学研究生院,2006.10.
    [104] Nunez J, at el. Multiresolution-Based Image Fushion with Additive WaveletDecomposition[J].IEEE Trans.on Geoscience and Remote Sensing,1999,37(3):1204-1211.
    [105]方贤勇.图像拼接技术研究[D]:[博士学位论文].杭州:浙江大学博士学位论文,2005.7.
    [106]李强,张钹.一种基于图像灰度的快速匹配算法[J].软件学报,2006,17(2):216-222.
    [107]Rafael C G, Richard E W, Steven L E. Digital Image Processing UsingMATLAB[N]. Publishing House of Electronics Industry,2004.5.
    [108] Toet A, at el. Merging thermal and visual images by contrast pyramid[J].Optical engineering,1989,28(7):789-792.
    [109]Chipman L J, at el. Wavelets and Image Fushion[C]. Proc. SPIE,1995,2569:208-219.
    [110]Nunez J, at el. Multiresolution-Based Image Fushion with Additive WaveletDecomposition[J]. IEEE Trans.on Geoscience and Remote Sensing,1999,37(3):1204-1211.
    [111]王仲训,丁挺,丁晓丹等.一种全景图像拼接算法的实现[J].工程图学学报,2006,2:112-116.
    [112]容观澳.计算机图象处理[M].北京:清华大学出版社,2000,2.
    [113]Levin A,Zomet A,Peleg S,et al. Seamless image stitching in the gradietdomain[J]. Lecture Notes in Computer Science.2004:377-389.
    [114] Zomet A,Levin A,Peleg S,et al. Seamless image stitching by minimizingFalse edges[J]. IEEE Transactions on Image Proeessing.2006,15(4):969-977.
    [115] Perez P,Gangnet M,Blake A. Poisson image editing[J]. ACM Transactions onGraphics.2003,22(3):313-318.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700