高动态范围成像技术的研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
人类获取的信息大部分来自于视觉,图像是视觉获取信息重要来源。数字成像技术在现代信息技术中有着举足轻重的作用。本文针对提高数字成像系统动态范围的方法进行了理论与实验研究。
     本文首次将信息论引入对数字成像系统动态范围的研究中来,明确揭示了图像的信息量与动态范围之间的关系:在系统曝光量不变的前提下,成像系统动态范围与图像信息量的负倒数成线性关系,即成像系统的动态范围越大,其相应获取图像的熵就越大。
     从信息论的角度系统的总结了目前扩展成像系统动态范围的三个方向:时间域扩展,空间域扩展以及自适应扩展。提出三种新的利用空间光调制器(SLM)实现的动态范围扩展方法:时间域SLM多次曝光,空间域光强编码调制,自适应PID反馈控制。完整的推导了三种扩展方法对动态范围的影响,并得出结论:在理想情况下,三种方法可以达到的最大系统动态范围为空间光调制器动态范围与图像传感器动态范围之积。通过数值模拟证实了这三种方法的有效性。
     自行设计并成功实现了基于硅基液晶调制器LCoS和CCD传感器的的高动态范围成像系统。利用该成像系统分别进行了时间域多次曝光,空间域光强编码调制,自适应PID反馈控制三种动态范围扩展实验。对每一种方法都给出了实验结果,并对实验结果进行讨论分析,最后对三种方法的适用范围进行了讨论。
     首次提出通过系统信息量计算来优化包含多离散器件成像系统的方法。该方法以获得成像系统最大互信息量为目标,寻找出各离散器件固有周期之间最优化的匹配关系,以及离散器件间最优化的空间位置,从而简单有效的削弱系统中莫尔条纹带来的影响。
     首次提出了一种基于不完全beta函数对高动态范围图像进行图像色调压缩的色调映射算法。该方法结合了全域法与局域法两种色调映射算法的特点,具有效率高,自适应好等优点,通过该算法可以有效的将高动态范围图像压缩到普通范围内显示。
For human being, most of the information is acquired by human vision, and image is the most important visual information source. The digital imaging technology plays great pole in the modern information fields. Theoretical and experimental researches for the high dynamic range digital imaging system are carried out in this paper.
     Information theories are imported into the dynamic range research of imaging system for the first time. The relationship between information rate and dynamic range is revealed clearly: with constant exposure, system dynamic range has a negative reciprocal relation with the image entropy, which means the bigger dynamic range leads to bigger image entropy.
     According to the information theory view, three directions to extend the system dynamic range are concluded: temporal extending, spatial extending and self-adaptive extending. Three new dynamic range extend methods with spatial light modulator (SLM) are proposed: temporal SLM multi-exposure method, spatial light encoding method and self-adaptive PID feedback control method. The influence to the dynamic range of these methods are discussed, the theoretical maximum dynamic range is the product of the SLM dynamic range and image sensor dynamic range. Results of data simulation prove that the system dynamic range can be extended effectively.
     Designed and successfully realized a high dynamic range imaging system based on LCoS and CCD. Three dynamic range extending experiments are performed with this system: temporal SLM multi-exposure method, spatial light encoding method and self-adaptive PID feedback control method. Experimental results and discussion for each method are provide, the applicable range of each method is also discussed.
     Optimize method based on information rate calculation for multi-discrete-devices imaging system is proposed for the first time. By this method, the information rate of the whole system is taken as the indicator to seek the optimized matching relation among discrete devices, and also to determine the optimized position of these devices, and thus the influence of Moire fringe in the system can be reduced effectively.
     A new tune mapping arithmetic based on incomplete beta function is proposed for the first time. This method combined the global method and local method, and has high efficiency and good adaption. High dynamic range can be compressed into normal range to be displayed on general monitor.
引文
[1]J.A.Ferwerda.Elements of Early Vision for Computer Graphics[J],IEEE Computer Graphics and Applications,2001,21(5):22-33.
    [2]L.Spillmann and J.S.Werner(eds.).Visual Perception:The Neurological Foundations[M].San Diego:Academic Press,1990.
    [3]B.A.Wandell.Foundations of Vision[M].Sinauer Associates,1995.
    [4]Karim,K.S.,Yin,S.,Nathan,A.,et al.,High dynamic range pixel architectures for diagnostic medical imaging[J].SPIE,2004,5368(2):657-667.
    [5]Collins A.R.,The comet assay for DNA damage and repair - Principles,applications,and limitations[J].Molecular Biotechnology,2004,26(3):249-261.
    [6]Paul E.Debevec,Jitendra Malik,Recovering high dynamic range radiance maps from photographs[J],International Conference on Computer Graphics and Interactive Techniques,2008,Article No.31.
    [7]C.W.Wyckoff,An experimental extended exposure response film[J],in SPIE Newsletter,June/July 1962:16-20
    [8]S.Mann,Compositing multiple pictures of the same scene[C],Proc.46th Annual IS&T Conf.,Boston,MA,May,1993:50-52
    [9]B.C.Madden,Extended intensity range imaging[C],technical report,GRASP Laboratory,Univ.of Pennsylvania,1993
    [10]K.Yamada,T.Nakano,S.Yamamoto,E.Akutsu,and K.Ashi,Wide dynamic range vision sensor for vehicles[C],IEEE Intl.Conf.Vehicle Navigation Info.Syst.,Aug.,1994:405-408
    [11]K.Moriwaki,Adaptive exposure image input system for obtaining high-quality color information[C],Systems and Computers in Japan 258,July 1994:51-60
    [12]陈自宽,张延忻,母国光,用强度系列成图法获取或显示高动态范围图像[J],数据采集与处理,dec,1994,.9(4),:247-250
    [13] P. E. Debevec and J. Malik, Recovering high dynamic range radiance maps from photographs[C],SIGGRAPH 97 Conf. Proc, Computer Graphics Annual Conf. Series, Aug., 1997:368-378
    
    [14]M. A. Robertson, S. Borman, and R. L. Stevenson, Dynamic range improvement through multiple exposures[J], Int. Conf. Image Process. Mar, 1999, ;159-163.
    
    [15] Kao WC, High dynamic range imaging by fusing multiple raw images and tone reproduction[J], IEEE transactions on consumer electronics,2008,54(1):10-15
    
    [16] R. A. Street. High dynamic range segmented pixel sensor array[P]. U.S. Patent 5789737, August 1998.
    
    [17]D.D.Wen. High dynamic range charge coupled device[P]. U.S. Patent 4873561, October 1989.
    
    [18] M. Hamazaki. Driving method for solid-state image pickup device[P]. Japanese Patent 08-331461,December 1996.
    
    [19]O.Y.Petch, et al.; Wide interscene Dynamic Range CMOS APS Using Dual Sampling[J], IEEE, Trans. Electron Devices, 1997,.44(10):1721-1723.
    
    [20] Cheng HY, Choubey B, Collins S A high-dynamic-range integrating pixel with an adaptive logarithmic response [J], IEEE photonic technology letters, 2007, 19(13):1169-1171
    
    [21]H. Doi, Y. Hara, Y. Kenbo, and M. Shiba. Image sensor[P]. Japanese Patent 8-223491, August 1986.
    
    [22] K. Saito. Electronic image pickup device.Japanese Patent 07-254965, February 1995.
    
    [23] T. Kimura. Image pickup device[P]. Japanese Patent 10-069011,March 1998
    
    [24] E. Ikeda. Image data processing apparatus for processing combined image signals in order to extend dynamic range[P]. U.S. Patent 5801773, September 1998.
    
    [25] Shree K Nayar and Vlad Branzoi, Programmable Imaging using a Digital Micromirror Array[C], Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'04), 1063-6919/04:436-443
    [26]A.O.Akyuz,E.Reinhard,and S.Pattanaik.Color Appearance Models and Dynamic Range Reduction[C],in First ACM Symposium on Applied Perception In Graphicsand Visualization(APGV),New York:ACM,2004:166
    [27]Tumblin,J.and H.Rushmeier:Tone Reproduction for Realistic Images[J].IEEE Computer Graphics and Applications,November 1993,13(6):42-48.
    [28]Ward,G,A contrast-based scalefactor for luminace display[M].In P.S.Heckbert(Ed.) Graphis Gems Ⅳ,Boston,Academic Press Professional.,1994.
    [29]Erik Reinhard,Parameter estimation for photographic tone reproduction[J].Journal of graphics tools,2002,7(1 ):45-52
    [30]G Qiu,J.Guan,J.Duan and M.Chen,Tone mapping for HDR image using optimization -A new closed form solution[C],ICRP 2006,18th International Conference on pattern reorganization,Aug,2006,Hong Kong:20-24
    [31]Krawczyk,G,Mantiuk,R.,Zdrojewska,D.,et al.Brightness adjustment for HDR and tone mapped images[C],Pacific Graphics '07.15th Pacific Conference on Computer Graphics and Applications,Saarbrucken,2007,373-381
    [32]Rovid,A,Varkonyi-Koczy,AR,Hashimoto,T,Balogh,S,Shimodaira,Y,Gradient based synthesized multiple exposure time HDR image,2007 IEEE Instrumentation & meansurement Technology Conference:1-5:1687-1692
    [33]陶纯堪,陶纯匡,光学信息论[M],科学出版社,北京,2004,。
    [34]David X.D.Yang,Abbas EI Gamal,et al.,A 640X512 CMOS Image Sensor with Ultra wide Dynamic Range Floating-Point Pixel-Level ADC[J],IEEE Journal of Solid-State Circuits,1999,34(12):1821 -1834.
    [35]Abbas El Gamal,SNR and Dynamic Range[J],EE392B Lecture Note 5,Stanford University,Stanford,USA,200t
    [36]William K.Pratt.Machine vision methods for automatic defect detection in liquid crystal displays[J].Advanced Imaging,1998,13(4):53-54.
    [37]M.Charfi,A.Nyeck,A Tosser,Focusing criterion[J],Electronics Letter,1991,27(14):1233-1235
    [38]J.Baina,J.Dublet,Automatic focus and iris control for video cameras[C],5th international conference on Image Processing and itsApplication,1995:232-235
    [39]李天柁,弟宇鸣,肖刚等,核径迹图像自动分析系统自动聚焦方法研究[C],第九届全国核电子学与核探测技术学术年会论文集,1998:354-356
    [40]李奇,冯华君,徐之海等,数字图象清晰度评价函数研究[J],光子学报,2002,31(6):736-738
    [41]郑学芬,林宗坚,范丽等,遥感影像信息量的计算方法研究[J],山东科技大学学报,2008,Feb,27(1):80-83
    [42]李大军,基于信息熵的空间数据位置不确定性模型的研究[D],武汉:武汉大学,2003
    [43]王秉钧,孙学军,沈保锁等,现代通信系统原理[M],天津大学出版社,1998
    [44]Huck F.O,Alter-Gartenberg Alter-Gartenberg,Information-theoretic Assessment of Sampled Imaging Systems[J],Optical Engineering,1999,38(5):742-762
    [45]Y.Ttakura,S.Tsutsumi,T.Takagi.Statistical properties of the background noise for the atmospheric windows in the intermediate infrared region[J].Infrared Phys.,1974,14:17-29
    [46]Y.Tadmor,D.J.Tolhurst.Discrimination of changes in the second-order statistics of natural and synthetic images[J].Vision Res.,1994,34:541-554.
    [47]胡谋法,李超,王书宏等,可见光图像背景灰度特征:双高斯混合分布模型[J],信号处理,2005,Aug,21(4a):23 1-234
    [48]Joseph W.G秦克诚 傅立叶光学导论[M],北京,电子工业出版社,2006.
    [49]陈浙泊,徐进,倪旭翔,林斌,陆祖康,基于空间光调制器的HDR图像获取方法,光子学报[J],2008,April,2008,37(4):844-847
    [50]The Imaging Source Europe Gmbh,彩色CCD工作原理[OL],http://www.theimagingsource.com/zh cn/resources/whitepapers/download/howcolca mswp.zh_cn.pdf,2008,3.
    [51]Nayar,Shree K.,Mitsunaga,Tomoo,High dynamic range imaging:spatially varying pixel exposures,Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition[C],v 1,2000:472-479
    [52]刘伯春,智能PID调节器的设计及应用[J],电气自动化,1999,3:18-21
    [53]Astrom K.J.,Migglund T.,Automatic Tuning of Simple Regulators with Specifications on Phase and Amplitude Margins[J],Automatica,1999,20,:645-651
    [54]吴振顺,姚建均,岳东海.模糊自整定PID控制器的设计及应用[J],哈尔滨工业大学学报,2004,36(11),:1578-1580
    [55]Zhebo Chen,Chen Shen,Jin Xu,Xuxiang Ni,Zukang Lu,The feedback stability research of HDRI system,Optica Aplicata[J],.39(3),2009
    [56]F.G.Shinskey,方崇智(译),过程控制系统[M],化学工业出版社,北京,1982.
    [57]孙明轩,黄宝健,迭代学习控制[M],国防工业出版社,北京,1999.
    [58]Ziegler J.G.,Nichols N.B.,Optimum Settings for Automatic Controllers[J],Trans.ASME,1992,64:759-768
    [59]Gawthrop P.J.,Nomikos P.E.,Automatic Tuning of Commercial PID Controllers for Single-Loop and Multiloop Applications[J],IEEE Control Syst.Mag,1998,10,34-42
    [60]Hagglund T.and Astrom K.J.,Industrial Adaptive Controllers Based on Frequency Response Techniques[J].Automatica,1991,27(4),:599-609
    [61]魏克新,王云亮,陈志敏,Matlab语言与自动控制系统设计[M],机械工业出版社,北京,1997.
    [62]Matthias Pferffer,An Overview with Focus on LC on Silicon(LCoS) Display[J],U.S.A:Three-Five Systems,Inc,2000
    [63]Kazlas P.T.,Johnson K.M.,McKnight D.J.Miniature Liquid-Crystal-on-Silicon Display Assembly[J],Optics Letters,1998,23(12):972-974
    [64]Schuck M.H.,McKnight D.J.,Johnson K.M.,et al.,Spin-Cast Planarization of Liquid-crystal-on-Silicon Microdisplays[J],Optics Letters,1997,22(19):1512-1514
    [65]http://www.jvc.com.cn/html/shangpinxinxi/dianshiji/guangguijingdianshi/ 2006/1220/106.html[OL]
    [66]http://www.photofans.cn/article/article.php/9520[OL]
    [67]http://www.jcst.cn/chanpin/digital/minilab.html[OL]
    [68]黄锡珉,LCoS技术的发展[J],液晶与显示,2002,17(1):1-5
    [69]W.S.Boyle and G.E.Smith,Charge Coupled Semiconductor Devices[J],Bell Syst.Tech.J.,1970,Apr.:587-593
    [70]M.F.Tompsett,et al.Charge Coupled Imaging Devices Experimental Results[J],IEEE,Trans.Electron Devices,.ED- 18,1971,:992-996
    [71]D.Renshaw,et al,ASIC Image Sensors[J],IEEE internal sysmposium on circuits and systems 1990:3038-3041
    [72]E.R.Fossum,Active Pixel Sensors:Are CCD's Dinosaurs?[C],In Proc.SPIE,1993,.1900:2-14
    [73]米本和也,CCD/CMOS图像传感器基础与应用[M],科学出版社,北京,2006.
    [74]迟学芬,韩昌元,易志栋,基于信息理论的采样成像系统匹配设计[J],光学学报,2003,Mar.23(3):278-283
    [75]迟学芬,石文孝,韩昌元等,基于信息理论的采样成像系统优化设计方案[J],通信学报,Sep.2002,.23(9):88-93
    [76]Zia-ur Rahman,Carl L.False,F.O.Huck,Information theoretical assessment of visual communication with subbanding coding[J],SPIE,2308,:885-894
    [77]迟学芬,基于信息理论的成像系统评价与系统技术研究[D],中科院长春光机所,2003.
    [78]Park S K,Rahman Z.Fidelity analysis of sampled imaging systems[J].Optical Engineering,1999,.38(5),:786-800
    [79]徐进,陈浙泊,李燕等,可编程系统中莫尔条纹处理方法研究[J],光子学报,2008,Feb,37(2):325-327
    [80]赵长海,万秋华,龙科慧等,莫尔条纹信号采集的自适应采样系统[J],武汉理工大学学报,2008,Jul,.30(6),:143-145
    [81]高俊,莫尔条纹的处理[J].印刷杂志,2003,(3):53-54.
    [82]谢嘉宁,赵建林.光学空间滤波过程的计算机仿真[J].光子学报,2002,31(7):847-850.
    [83]戚巽骏,数字采样成像系统的光学低通滤波理论研究[D],2009,3月,浙江大学
    [84]汪宏志,陈浙泊,徐进,倪旭翔,陆祖康,基于插值法对可编程成像系统中莫尔条纹的处理,光学仪器[J],October,2007,29(5):31-33
    [85]Chen,Zhebo;Xu,Jin;Lin,Bin;Ni,Xuxiang;Lu,Zukang,A HDRI camera based on SLM,Key Engineering Materials[J],v364-366 Ⅱ,2008:1237-1241
    [86]Reinhard Erik,Stark Michael;Shirley Peter,etc.,Photographic tone reproduction for digital images,ACM Transactions on Graphics[J],2002,v 21(3):267-276
    [87]Erik Reinhard,Sumanta Pattanaik,Greg Ward,et al,High Dynamic Range Imaging[M],San Francisco:Morgen Kaufmann,2005.
    [88]G.Ward-Larson,R.A.Shakespeare.Rendering with Radiance[M].San Francisco:Morgan Kaufmann,1998.
    [89]P.E.Debevec.Rendering Synthetic Objects into Real Scenes:Bridging Traditional and Image-based Graphics with Illumination and High Dynamic Range Photography[C],in SIGGRAPH 98 Conference Proceedings,Annual Conference Series,ACM SIGGRAPH,1998:45-50
    [90]P.E.Debevec,J.Malik.Recovering High Dynamic Range Radiance Maps from Photographs[C],in SIGGRAPH97 Conference Proceedings,Annual Conference Series,ACM SIGGRAPH,August 1997:369-378.
    [91]F.Kainz,R.Bogart,and D.Hess.The OpenEXR Image File Format[C],in SIGGRAPH Technical Sketches,2003.
    [92]Tubbs J D.A note on parametric image enhancement[J].Pattern Recognition,1997,30(6),:617-621.
    [93]Raveh I,Mendlovic D,Zalevsky,et al..Digital Method for Defocus Corrections:Experimental Result[J],Optical Engineering,1999,38(10):1620-1626.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700