基于灰度投影的实时电子稳像算法研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
电子稳像是新一代的稳像方法,它利用计算机图像处理技术实现图像序列的稳定。因为具有稳像精度高、体积小、重量轻、功耗低以及成本低等优点,它在军事和民用中都有广泛的应用前景。实时电子稳像是指用电子稳像的方法及时地稳定图像序列,使得摄像系统和跟踪系统的操作者不会受到摄像机本身运动的干扰,因此实时电子稳像算法具有稳像速度快精度高的特点。
     本课题在嘉兴市科技项目资助下,对实时电子稳像技术进行了深入研究,内容涵盖原理探讨、常用算法分析、实时电子稳像算法构建、稳像系统实现、试验论证和稳像评价等方面,取得了一系列成果,部分成果对于实时电子稳像技术的发展有影响作用。
     论文分析了图像序列间产生差异的原因,明确了电子稳像的必要性。阐述了电子稳像基本原理、基本方法和处理过程,并讨论其实现的关键技术。提出实时电子稳像算法的要求,并分析了目前国外电子稳像常见算法的特点,选取灰度投影算法作为本文实时电子稳像算法的基础。
     建立了电子稳像的软件仿真平台。生成了几种不同类型运动矢量的模拟图像序列,用来分析和验证灰度投影算法的稳像特性,为以后构建实时电子稳像算法奠定了重要的基础。
     针对实时稳像中灰度投影算法不能处理的几种情况,如对比度差、内部运动物体和旋转图像序列等。在灰度投影基础上分别构建了新的算法,并用试验证明其可行性。论文首次提出了运用两次匹配的算法稳定内部运动物体的图像序列和运用先补偿平移后补偿旋转的算法快速稳定旋转图像序列。并且也提出了一种判断摄像系统是否存在扫描运动的策略。
     建立了电子稳像系统。阐述了电子稳像算法的评价方法。用CCD摄像机采集不同类型运动矢量的视频图像序列,对本文构建的实时电子稳像算法进行评价和验证。试验结果表明,本文的非旋转实时电子稳像算法帧处理率达到50帧/秒同时,稳像精度和块匹配算法的精度接近;旋转实时电子稳像算法也在PSNR大大提高的基础上,帧处理率达到30帧/秒。
Electronic image stabilization is a new method to stabilize image sequences with computer image processing technique. It has a lot of advantages, such as high image stabilizing precision, compact size, lightweight, low power consumption and reasonable price. Therefore the electronic image stabilization has been applied to martial and civil equipments all over the world. Real-time electronic image stabilization is a method to timely stabilize image sequences in electronic image stabilization algorithm, which remove the unwanted movements of camcorders. So real-time electronic image stabilization algorithm is characterized by highly precision and quickly matching performance.This thesis, supported by the Innovation Fund of Jiaxing city in Zhejiang province, mainly discussed the real-time image stabilization, concerning the theoretical research, common algorithm analysis, real-time algorithm design, image stabilization system realization, experimental testifying and algorithm evaluation. A series of result are obtained and parts of them will influence the development of real-time electronic image stabilization.This thesis analyzes the blurring cause of image sequences and proposes the necessity of electronic image stabilization. It expatiates principle and method of electronic image stabilization in detail and discusses key technique of realization. Based on study for several typical algorithms of motion vector estimation adopted by overseas electronic image stabilization system and real-time electronic image stabilization algorithm's requirements, pray projection algorithm is chosen as the base part of real-time electronic image stabilization algorithm.A software simulated platform of electronic image stabilization is set up in the computer. Several simulated image sequences with different types motion vector are created to analyze and testify the performance characterization of pray projection algorithm. These analysis provide an important theoretical basis for designing real-time electronic image stabilization algorithm.Gray projection algorithm can not deal with certain image sequences, like as low contrast ratio, athletic objects inside and rotary images. New algorithms based on pray projection are designing for these situations and are testified by specifically experiments. The twice matching
    algorithm to stabilize image sequences including athletic objects inside and the algorithm compensating translation vector firstly and compensating rotary vector secondly to stabilize rotary image sequences are firstly presented in this thesis. A method to judge whether the camcorder has scanning motion is presented also.Electronic image stabilization system is set up and evaluation methods of image stabilization are presented. Image sequences with different types motion vector are obtained by CCD camcorder to evaluate and testify the performance characterization of real-time image stabilization algorithm designed in this thesis. Experimental results show that the non-rotary real-time algorithm can process 50 frames per second with similar image stabilizing precision and that the rotary real-time algorithm can process 30 frames per second with improving PSNR.This thesis discusses infrared electronic image stabilization. Characteristics are known by analyzing the video obtained by infrared camera. Experimental results of processing infrared image sequences show that gray projection algorithm can restrain the noise of infrared images and is feasible.
引文
[1] 汪小勇,李奇.用于实时数字稳像的灰度投影算法研究[J].光子学报,2006
    [2] 李奇,徐之海,冯华君.一种图像稳定程度的描述方法[J].光学学报,2004,24(3):427-430
    [3] M. Oshima, et al., "VHS camcorder with electronic image stabilizer," IEEE Trans. Consumer Electronics, vol. 35, no. 4, pp. 749-758, Nov. 1989.
    [4] 韩绍坤,赵跃进.电子稳像技术及其发展[J].光学技术,2001,27(1):71-73
    [5] K. Uomori, et al., "Automatic image stabilizing system by full-digital signal processing," IEEE Trans. Consumer Electronics, vol. 36, no. 3, pp. 510-519, Aug. 1990.
    [6] Y. Egusa, et al., "An application of fuzzy set theory for an electronic video camera image stabilizer," IEEE Transactions on Fuzzy Systems, vol. 3, no. 3, pp. 351-356, Aug. 1995.
    [7] 董立羽,卜彦龙.电子稳像技术发展评述[J].信息技术与信息化,2004,6:17-20
    [8] J. S. Jin, Z. Zhu, and G. Xu, "A stable vision system for moving vehicles," IEEE Trans. Intelligent Transportation Systems, vol. 1, no. 1, pp. 32-39, Mar. 2000.
    [9] 赵红颖,金宏.电子稳像技术概述[J].光学精密仪器,2001,8(9):354-359
    [10] 汪遵.光学稳像扫描稳像条件分析计算研究[J].光学技术,1992(6)
    [11] Nester Y. Image Stabilization[J]. Opt Eng, 1982, 11(9)
    [12] 沈宏海,刘晶红.摄像稳定技术[J].光学 精密工程,2001,9(2):115-119
    [13] K. Sato, et al., "Control techniques for optical image stabilizing system," IEEE Trans. Consumer Electronics, vol. 39, no. 3, pp. 461-466, Aug. 1993.
    [14] K. Uomori, A. Morimura and H. Ishii, "Electronic image stabilization system for video cameras and VCRs," J. Soc. Motion Pict. Telev. Eng., Vol. 101, pp. 66-75, 1992.
    [15] 钟平,于前洋.基于特征点匹配技术的运动估计及补偿方法[J].光电子·激光,2004,15(1):73-77
    [16] 钟平.一种改进的代表点匹配算法在稳像技术中的应用[J].光学技术,2005,31(5):742-745
    [17] 钟平,于前洋.动态图像序列运动矢量估计算法的研究[J].光学技术,2003,29(2):219-222
    [18] 周渝斌,赵跃进.基于C6711 DSP的实时数字稳像系统[J].北京理工大学学报,2004,24(5):435-438
    [19] 周渝斌,赵跃进.基于单向投影矢量的数字电子稳像方法[J].北京理工大学学报,2003,23(4):509-512
    [20] Jesse S. Jin, Zhigang Zhu and Guangyou Xu, "Digital video sequence stabilization based on 2.5D motion estimation and inertial motion filtering," Real-Time Image 7, pp. 357-365, 2001, Academic Press.
    [21] 赵红颖,晏磊.船载图像序列电子稳定算法的研究[J].光学 精密工程,2003,11(6):602-606
    [22] 葛卫龙,雷选华.实现图像稳定的快速算法[J].红外与激光工程,2004,33(1):43-46
    [23] G. R. Chen, et al., "A novel structure for digital image stabilizer," Proc. of 2000 IEEE Asia-Pacific Conference on Circuits and Systems, pp. 101-104, 2000.
    [24] 熊国清,于起峰.用于实时跟踪的快速匹配算法[J].计算机辅助设计与图形学学报,2002,14(1):1-3
    [25] S. J. Ko, S. H. Lee, and K. H. Lee, " Digital image stabilizing algorithms based on bit-plane matching," IEEE Tran. Consumer Electronics, vol. 44, no. 3, pp. 617-622, Aug. 1998.
    [26] 徐之海,李奇.摄像、照相系统中的稳像技术[J].照相机,2002,6:4-5
    [27] 陆其明,金邦飞.DirectShow开发指南.北京:清华大学出版社[M],2003
    [28] 陆其明.DirectShow实务精选.北京科海电子出版社[M],2004
    [29] F. Vella, et al., "Digital image stabilization by adaptive block motion vectors filtering," IEEE Trans. Consumer Electronics, vol. 48, no. 3, pp. 796-801, Aug. 2002.
    [30] Rafael C. Gonzalez, Richard E. Woods.数字图像处理.北京:电子工业出版社[M],2002
    [31] S. Erturk, "Digital image stabilization with sub-image phase correlation based global motion estimation," IEEE Trans. Consumer Electronics, vol. 49, no. 4, pp. 1320-1325, Nov. 2003.
    [32] M. K. Kim, et al., "An efficient global motion characterization method for image processing applications," IEEE Trans. Consumer Electronics, vol. 43, no. 4, pp. 1010-1018, Nov. 1997.
    [33] S. Erturk, "Image sequence stabilisation: motion vector integration (MVI) versus frame position smoothing (FPS)," Proc. of the 2nd International Symposium on Image and Signal Processing and Analysis, pp. 266-271, 2001.
    [34] 罗诗途,张圮.一种基于特征匹配的实时电子稳像算法[J].国防科技大学学报,2005,27(3):45-48
    [35] M. K. Gullu and S. Erturk, "Fuzzy image sequence stabilization," Electronics Letters, vol. 39, no. 16, pp. 1170-1172, Aug. 2003.
    [36] S. W. Jeon, et al., "Fast digital image stabilizer based on Gray-coded bit-plane matching," IEEE Trans. Consumer Electronics, vol. 45, no. 3, pp. 598-603, Aug. 1999.
    [37] 张博,任广辉.采用下采样和位平面匹配的局部运动估计[J].光电工程,2005,32(2)
    [38] J. K. Paik, Y. C. Park, and S. W. Park, "An edge detection approach to digital image stabilization based on tri-state adaptive linear neurons," IEEE Tran. Consumer Electronics, vol. 37, no. 3, pp. 521-530, Aug 1991.
    [39] Y. S. Yao and R. Chellappa, "Selective stabilization of images acquired by unmanned ground vehicles", IEEE Trans. Robotics and Automation, vol. 13, pp. 693-708, 1997.
    [40] J. K. Paik, Y. C. Park, and D. W. Kim, "An adaptive motion decision system for digital image stabilizer based on edge pattern matching," IEEE Trans. Consumer Electronics, vol. 38, no. 3, pp. 607-616, Aug. 1992.
    [41] Stephen B. Balakirsky and Rama Chellappa, "Performance characterization of image stabilization algorithms" Real-Time Image 2, pp. 297-313, 1996, Academic Press.
    [42] A. Engelsberg and G. Schmidt, G. "A comparative review of digital image stabilizing algorithms for mobile video communications", IEEE Trans. Consum. Electron., vol. 45, pp. 591-597, 1999.
    [43] 李博,王孝通.电子稳像的灰度投影三点局域自适应搜索算法[J],2004,31(9):69-72
    [44] 赵红颖,晏磊.一种稳定船载电视侦察图像序列的灰度投影拟合算法[J].光学技术,2004,30(1):83-85
    [45] C. Morimoto and R. Chellappa, "Fast electronic digital image stabilization for off-road navigation", Real-Time Imaging, vol. 2, pp. 285-296, 1996.
    [46] Y. S. Yao, P. Burlina and R. Chellappa, "Electronic image stabilization using multiple cues", in Proc. of IEEE Int. Conf On Image Processing, vol, 1, pp. 191-194, 1995,
    [47] J. Y. Chang, et al., "Digital image translational and rotational motion stabilization using optical flow technique," IEEE Trans, Consumer Electronics, vol. 48, no. 1, pp. 108-115, Feb. 2002.
    [48] 孙辉,赵红颖.基于光流模型的图像运动估计方法[J].光学 精密工程,2002,10(5):443-447
    [49] 钟平,于前洋.机载摄像设备图像稳定方法探讨[J].光电工程,2002,29(Sup):73-76
    [50] Z. Duric and A, Rosenfeld, "Image Sequence Stabilization in real time", Real-Time Imaging, vol. 2, pp. 271-284, 1996.
    [51] 容观澳.计算机图像处理.北京:清华大学出版社[M],2000,PP.130-133
    [52] 钟平,冯进良.动态图像序列帧间运动补偿方法探讨[J].光学技术,2003,29(4):441-444
    [53] 钟平,于前洋.航摄动态图像序列稳定技术仿真研究[J].计算机仿真,2004,21(1):71-73
    [54] 赵红颖,晏磊.船载摄像系统的一种电子稳像算法[J].光学技术,2003,29(5):628-630
    [55] S. Erturk, "Translation, rotation and scale stabilisation of image sequences," Electronics Letters, vol. 39, no. 17, pp. 1245-1246, Aug. 2003.
    [56] 周锐.CIG图像抖动对成像制导仿真系统的影响[J].系统仿真学报,1997,3:111-115
    [57] 张庆生,张楠.低空高射武器观瞄系统的图像稳定技术[J].光学技术,2002,28(3):270-272
    [58] 刘平,王平.红外成像系统稳像技术[J].红外技术,2004,26(5):49-51
    [59] M. K. Gullu, E. Yaman, and S. Erturk, "Image sequence stabilization using fuzzy adaptive Kalman filtering," Electronics Letters, vol. 39, no. 5, pp. 429-431, March 2003.
    [60] M. K. Gullu and S. Erturk, "Membership function adaptive fuzzy filter for image sequence stabilization" IEEE Trans. Consumer Electronics, vol. 50, no. 1, pp. 1-7, Feb. 2004.
    [61] 邹博,张文军.相关块匹配运动估计算法[J].上海交通大学学报,1998,31(5):43-47
    [62] 姚志军,王延杰.基于TMS320C6416的电子稳像的实现[J].光学技术,2005,31(3):424-426
    [63] A. Burt and P, Anandan, "Image stabilization by registration to a reference mosaic", in Proc. of ARPA Image Understanding Workshop, pp. 425-434, 1994.
    [64] 宋永江,夏良正.多直线全局运动估计及其在图像稳定中的应用[J].东南大学学报,2002,32(2):151-157
    [65] 葛卫龙,雷选华.电子稳像中运动矢量一致性的优化算法[J].海军工程大学学报,2004,16(2):92-94
    [66] 刘明,赵跃进.电子稳像中的运动补偿矢量处理方法的研究[J].光学技术,2005,31(3):457-459
    [67] 罗诗途,王艳玲.车载图像配准稳定算法中的关键技术[J].光电工程,2005,32(5):16-20
    [68] S. Erturk and T. J. Dennis, "Image sequence stabilization based on DFT filtering", IEE Proc. on Image Vision and Signal Processing, vol. 127, pp. 95-102, 2000.
    [69] 罗诗途,王艳玲.车载图像跟踪系统中电子稳像算法的研究[J].光学 精密工程,2005,13(1):95-102
    [70] S. Erturk,"Real-time digital image stabilization using Kalman filters", Real-Time Imaging, vol. 8, pp. 317-328, 2002.
    [71] B. Girod,"Motion-compensating prediction with fractional-pel accuracy", IEEE Trans. Commun., vol. 41, pp. 604-612, 1993.
    [72] 韩绍坤,张立华.电子稳像技术中的坐标变换及像偏移函数分析[J].光学技术,2002,28(3):278-281
    [73] 时永刚,赵跃进.混合编程技术在电子稳像钟的应用[J].北京理工大学学报,2001,21(2):252-255
    [74] 潘爱民,王国印.Visual C++技术内幕.北京:清华大学出版社[M],1999
    [75] 陈跃庭,汪小勇.多参考点三步搜索法快速稳像算法[J].光电子·激光,2006

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700