基于改进Canny边缘检测算子的电子稳像算法研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
电子稳像是一种新型的视频图像序列稳定技术,它利用计算机数字图像处理和电子技术相结合的方法来实现图像序列的稳定。由于具有稳像精度高、体积小、功耗低、成本低以及易于操作等优点,电子稳像技术已被广泛用于摄像机抖动的检测和消除,视频压缩,运动目标的检测和跟踪,以及图像拼接等领域。本课题在苏州大学现代光学技术研究所“天巡一号小卫星CCD相机研制”的项目资助下,对电子稳像技术进行了较为深入研究,有效地实现了视频图像的实时稳定。
     论文阐述了电子稳像的基本原理、基本方法和处理过程,并讨论了其实现的关键技术。介绍了电子稳像中几种常见的典型算法,并通过对典型算法的仿真分析,总结出了各算法的优缺点,并针对本课题的要求,分析了实时电子稳像的特点,明确实时稳像算法的要求,最终确定采用基于改进Canny边缘检测算子的电子稳像算法。
     针对传统特征点匹配电子稳像算法中提取的特征点容易受到噪声干扰的问题,论文在研究传统的特征点匹配电子稳像算法的基础上,提出了一种将改进的Canny边缘检测算子应用于电子稳像中的方法。此方法利用改进的Canny算子对图像进行边缘检测,并通过对边缘检测的图像进行合理分区,在子区域内进行图像的特征点提取,然后根据特征点集内具有相对稳定位置的结构特征,采用距离不变准则,对特征点的有效性进行验证,保证各点的局部运动具有良好的全局一致性。同时建立二维运动模型进行全局运动估计,以此确定仿射模型的运动参数。最后利用卡尔曼滤波的方法来进行运动补偿从而达到输出稳定视频图像的目的。在进行特征点提取的过程中,课题研究了几种典型的特征点提取算法,并在PC机上进行算法仿真和分析。
     此外,论文介绍了电子稳像算法的评价方法。同时还建立电子稳像的软件仿真平台,对基于改进Canny边缘检测的电子稳像算法进行了稳像处理研究,并利用评价方法对稳像效果进行分析。最后对本课题的研究进行了总结与展望。
Electronic image stabilization is a new technology to stabilize image sequence, which is combined of computer digital image processing and electronic technology to achieve the stability in the image sequence. It has a lot of advantages, such as high image stabilizing precision, compact size, low power consumption, reasonable price and easy to operate. Therefore it has been widely used in the detection and elimination of video’s dithering, video compression, the moving target detection and tracking, image mosaic, etc. This thesis, supported by the item of the design of CCD camera on the 1st Tianxun Moonlet, has carried out an intensive study of the electronic image stabilization technique, and achieved the effective stabilization of the video image sequence.
     This thesis expatiates the basic principles, methods and process of the electronic image stabilization, and discusses the key technique of realization. Through the simulation of several typical algorithm, the advantages and disadvantages of each algorithm is summarized. Basing on the study of several typical algorithms for video stabilization and real-time electronic image stabilization algorithm’s requirements, the improved method of Canny edge-detection algorithm is applied to electronic image stabilization.
     In order to solve the problem that the feature points are easily influenced by the noise, based on the research of the traditional features tracking algorithm, the improved method of Canny edge-detection algorithm for electronic image stabilization is proposed. The image edge is detected with improved Canny operator, through dividing edge detected image into many blocks in reason, the suitable feature points can be selected, which has a stable structure and the relative positions of all points are stable. So the thesis proposes the distance invariant criterion to check the feature matching, which can keep global coherence of all local motions and produce the global motion vector by establishing two-dimensional model of movement. Then the parameters of the affine model are calculated based on these points, finally, Kalman filter is applied to motion compensation to achieve the stability of the video sequences. The thesis also presents several typical feature point extraction algorithms, and has laboratory simulation and analysis in PC.
     In addition, the thesis introduces the evaluation methods of image stabilization. And a software simulated platform has been created to analyze and testify the performance of the improved method of Canny edge-detection algorithm for electronic image stabilization, evaluation methods is then used to analyze the effects of the stabilization. Finally, research of this thesis is summarized and given the direction of further study and improving.
引文
[1] K.Ratakonda. Real-time Digital Video Stabilization for Multi-media Applications[J]. IEEE Trans on CAS for Video Tech,1998,8(6):69-72.
    [2]沈宏海,刘晶红等.摄像稳定技术[J].光学精密工程,2001,9(2):115-120.
    [3] M.Oshima,et al. VHS camcorder with electronic image stabilizer[J]. IEEE Trans. Consumer Electronics,Nov.1989,35(4):749-758.
    [4] Y.Egusa,et al. An application of fuzzy set theory for an electronic video camera image stabilizer[J]. Transactions on Fuzzy Systems,Aug.1995,3(3):351-356.
    [5]孙辉,熊经武,赵红颖.电子稳像技术在船载电视监视系统中的应用[J].光电工程,2008,35(2):103-108.
    [6]徐之海,李奇,冯华君.摄像、照相系统中的稳像技术[J].照相机,2002,6:4-5。
    [7]程锋,任戈.惯性稳定平台建模及振动传递率分析[J].光电工程,2006,33(4):19-22。
    [8] D.N.Eskov,Yu.A.Stepin,VA.Toropin. Optical image stabilization methods and means[J]. Sov.J.Opt.Technol,Jan.1982,49(1).
    [9]朱强华,李胜勇,姜涛.稳像技术[J].舰船电子对抗,2006,29(5):77-80.
    [10] Y.Netser. Image Stabilization[J]. Opt.End,1982,11(9).
    [11]韩绍坤,赵跃进,刘明奇.电子稳像技术及发展[J].光学技术,2001,27(1):71-73。
    [12] N.A.Tsoligkas,D.Xu, I.French, Y.Luo. A Motion Model Based Video Stabilization Algorithm,2006 World Automation Congress.
    [13] Hung-Chang Chang,Shang-Hong Lai,and Kuang-Rong Lu. A Robust and Efficient Video Stabilization Algorithm,2004 IEEE International Conference on Multimedia and Expo(ICME).
    [14] Sridhar Srinivasan Rama Chellappa,Image Stabilization and Mosaicking Using the Overlapped Basis Optical Flow Field. 1997.Proceedings. International Conferenceon Image Processing.
    [15] H.D.Seok, H.K.Kwak,J.Lyou. A Rotational Motion Estimation Method for Digital Image Stabilization. TENCON 2005 IEEE Region 10.
    [16] MENG Long,LIN Xinggang,XU Lidong,FU Fangwen,Video Stabilizing System for Digital Camera. ICSP’04 Proceedings. vol.2. 2004.
    [17] Sung-jen ko,Sung-Hee Lee,Seung-Won Jeon,Eui-Sung Kang. Fast Digital Image Stabilizer Based on Gray-Coded Bit-Plane Matching. IEEE Transactions on Consumer Electronics. Vol.45.No.3, August 1999.
    [18] Alp Erturk,Sarp Erturk. Two-Bit Transform for Binary Block Motion Estimation. IEEE Transactions on Circuits and Systems Video Technology. Vol 15.
    [19] SUN.H,ZH. Y. X,XIONG J. W,et al. The application of high resolution gray projection algorithm in electronic image stabilization technology[J]. 2006,32(3):378-380.(in Chinese).
    [20] S. Erturk. Digital image stabilization with sub-image phase correlation based global motion estimation[J]. IEEE Transactions on Consumer Electronics,2003,49(4):1320-1325.
    [21] COX G S,JAGER G De. A survey of point matching techniques and a new approach to point pattern recognition [A]. Proceedings of 1992 South African Symposium on Communications and Signal Processing[C]. Cape Town, South African:IEEE,1992,243-248.
    [22]朱娟娟,郭宝龙,冯宗哲.一种基于灰度投影算法的电子稳像算法[J].光子学报,2005,33(8):1266-1269.
    [23]朱娟娟,郭宝龙.一种运动载体摄像的自适应稳像算法[J].光电子激光,2007,18(1):108-112.
    [24]朱娟娟,郭宝龙.电子稳像的特征点跟踪算法[J].光学学报,2006,26(4): 516-521.
    [25] Auberger S,Miro C,Digital Video Stabilization Architecture for Low Cost Devices[C].Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis,2005.
    [26] Ohyun Kwon,Jeongho Shin,Joonki Paik.Edge Based Adaptive Kalman Filtering for Real-time Video Stabilization[C]. IEEE International Conference on Consumer Electronics,2006.
    [27] Ping Zhong. Research on methods of motion estimation and compensation in electronic image stabilization technique[C]. Electronic Imaging and Multimedia Technology IV,2004.
    [28] Yasuyuki Matsushita,Eyal Ofek,Xiaoou Tang,Heung-Yeung Shum.Full-Frame Video Stabilization with Motion Inpainting.IEEE Transactions on Pattern Analysis and Machine Intelligence,2006:1150-1163.
    [29]赵红颖,金宏,熊经武.电子稳像技术概述[J] .光学精密工程,2001,9(4):354-35.
    [30]董立羽,卜彦龙,戴彬.电子稳像技术发展评述[J].信息技术与信息化,2004,6:17-20.
    [31]钟平.机载电子稳像技术[D].博士学位论文,中国科学院长春光学精密机械与物理研究所,2003.
    [32] Y.CHANG,W.F.HU,M.H.CHENG,et al. Digital Image Translational and Rotational Motion Stabilization Using Optical Flow Technique[J]. IEEE Transaction on Consumer Electronics,2002,48(1):108-115.
    [33] E.Catmull,A.R.Smith. 3-D Transformation of Images in Scanline Order[J]. Compute Graphics,1980,14(3):279-285.
    [34] R.Kenneth,Castleman. Digital Image Processing[C]. Prentice-Hall,1996:95-99.
    [35] Carlos. Electronic digital image stabilization design and evaluation with applications[D]. University of Maryland,1997.
    [36]韩绍坤,张立华,刘明奇.电子稳像技术中的坐标变换及像偏移函数分析[J] .光学技术,2002,28(3):278-251.
    [37] Q.Zheng,R.Chllappa. A computational vision approach to image registration[J]. IEEE Trans.Image Processing,1993(2).
    [38] F.Vella,A.Castorina,M.Mancuso,et al. Digital image stabilization by adaptive block motion vectors filtering[J]. IEEE Trans on Consumer Electronics,2002,48(3):796-801.
    [39]陈志坚,李哲,石磊.一种基于图像特征块匹配的电子稳像算法[J].科学技术与工程,2007,7(11):2512-2515。
    [40] Vanne J, Hamalainen T D, Kuusilinna K. Aparallel memory system for variable block-size motionestimation algorithms[J]. Circuits and Systems for Video Technology, 2008,18(4):538-543.
    [41] Sun Hui. Fast gray projection algorithm and its application to electronic image stabilization[J]. Optics and Precision Engineering,2007,15(3):412-416.
    [42] J.Mahenx,J.Cruikshank,et al. Video rate image stabilization system[J]. SPIE,2000,34(14):232-238.
    [43]赵天云,郭雷,余博.基于灰度投影的快速电子稳像算法[J].微电子学与计算机,2008,25(11):233-236.
    [44]张永祥,赵晓旭,张伟功,等.一种基于灰度投影的电子稳像改进算法[J].微电子学与计算机,2008,25(11):212-215.
    [45]孙辉,张永祥等.高分辨率灰度投影算法及其在电子稳像中的应用[J].光学技术,2006,32(3):378-380.
    [46]周亚军,王翔,苏享,等.快速灰度投影稳像算法研究[J].兵工自动化,2009,28(8):88-91.
    [47] Sung-Jea Ko,Sung-Hee Lee,Kyung-Hoon Lee. Digital image stabilizing algorithms based on bit-plane matching[J]. IEEE Transactions on Consumer Electronics,1998,44:617-622.
    [48] S.W.Jeon,et al. Fast digital image stabilizer based on Gray-coded bit-plane matching[J]. IEEE Trans Consumer Electronics,Aug.1999,45(3):598-603.
    [49] Marius Tico , Markku Vehvilainen. Constraint motion filtering for video stabilization[C]. IEEE International Conference on Image Processing,2005:569-572.
    [50]钟平,于前洋,金光.基于特征点匹配技术的运动估计及补偿方法[J].光电子激光,2004,15(1):72-77.
    [51] J.B.Shi,C.Tomasi. Good Features to Track[J]. IEEE Conference on Computer Visionand Pattern Recognition,CVPR,1994:593-600.
    [52]罗诗途,张玘等.一种基于特征匹配的实时电子稳像算法[J].国防科技大学学报,2005,27(3):45-48.
    [53] Yong Shan,Wang Run-sheng. Improved algorithms for motion detection and tracking[J]. Optical Engineering,2006,45(6):1-7.
    [54] D. Marr,E. Hildreth. Theory of edge detection[J]. Proceedings Royal Society of London,1980,B207(1167):187-217.
    [55]雒涛,郑喜风,丁铁夫.改进的自适应阈值Canny边缘检测[J].光电工程,2009,36(11):106-111.
    [56] JungYoup Suk,Gun-Woo Lee. New Electronic Digital Image Stabilization Algorithm in Wavelet Transform Domain(M).CIS,2005,PART II:911-916.
    [57] L.Kitchen , A.Rosenfeld. Gray Level Corner Detection[J]. Patter Recognition Letters,1982,1(1):95-102.
    [58] M.Smiths,J.M.Brady,Susan. A New Approach to Low Level Image Processing [R]. Internal Technical Report,Defense Research Agency,UK:Oxford University,1995.
    [59] C.Harris,Stephens M, A Combined Corner and Edge Detector[C]. In Proc Alley Conf Vision England Manchester University Press,1988:189-192.
    [60]官云兰,张红军,刘向美.点特征提取算法探讨[J].东华理工学院学报,2007,30(1):42-46.
    [61]王舒鹏,方莉.利用Moravec操作数提取特征点实现过程分析[J].计算机知识与技术,2006,3:125-126.
    [62] W.Forstner,E.Gulch. A fast operator for detection and precise location of distinct points,corners and centers of circular features[C]. Proceeding of Intercom-mission Workshop on Fast Processing of Photogram metric Data. Interlaken:Switzerland,1987.
    [63] S.M.Smith, J.M.Brady. Susan - A new approach to low level image processing[ J ]. International Journal of Computer Vision, 1997, 23 (1) :45 - 78.
    [64] Uomori Kenya,Moritura Atsushi,Hirofumi Ishii. Automatic image stabilization system by full-digital signal processing[C]. IEEE Int.Conf. Consum. Electron(ICCE).Rosemont,1990.
    [65]朱娟娟,郭宝龙.电子稳像的特征点跟踪算法[J].光学学报,2006,26(4):516-521。
    [66] S.Ertiirk. Real-time digital image stabilization using Kalman filters[J]. Real-Time Imaging,2002,8:317-328.
    [67]钟平.一种改进的代表点匹配算法在稳像技术中的应用[J].光学技术,2005,31(5):742-745。
    [68] BAO P,ZHANG L. Canny edge detection enhancement by scale multiplication[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27(9):1485- l490.
    [69] Canny J. A Computational Approach To Edge Detection,IEEE Trans. Pattern Analysis and Machine Intelligence,1986,8:679-714.
    [70] S.Erturk. Digital image stabilization with sub-image phase correlation based global motion estimation[J]. IEEE Trans. Consumer Electronics,Nov.2003,49(4):1320- 1325.
    [71] M.K.Kim,et al. An efficient global motion characterization method for image processing applications[J]. IEEE Trans. Consumer Electronics,Nov.1997,43(4):1010-1018.
    [72] S.Erturk. Image sequence stabilization:motion vector integration (MVI) versus frame position smoothing(FPS)[J]. Proc.of the 2nd International Symposium on Image and Signal Processing and Analysis,2001:266-271.
    [73]孙志忠,袁慰平,闻震初.数值分析[M].南京:东南大学出版社,2002.
    [74] Marius Tico , Markku Vehvilainen. Constraint motion filtering for video stabilization[C]. IEEE International Conference on Image Processing,2005:569-572 .

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700