数字视频稳像技术综述
|
摘要
数字视频稳像(digital video stabilization,DVS)技术发展已历经30多年,随着设备计算能力的不断提高、算法研究的不断更新以及市场需求的不断驱动,数字视频稳像技术也随之不断发展,经历了从最初以计算简单为主的方案发展到以稳像效果显著为主的方案,再发展到计算简单并且效果显著的方案.通过对文献资料的整理分析,并根据技术发展的时间顺序,数字稳像技术被分类为传统方案和新兴方案.按照采用运动模型的不同,传统方案分为传统2D方案和传统3D方案;新兴方案分为新兴2D方案和借助传感器方案.对每类方案,首先对其采用的关键技术进行分析总结,然后列举这些关键技术在数字视频稳像中的应用实例.对数字稳像技术的发展进行了总结,最后对数字视频稳像技术的研究难点和发展趋势进行了展望.
Digital video stabilization(DVS)techniques have been developing for over 30 years.The improvement of device computing ability,the research on related algorithms as well as the market needs have always been driving the development of DVS techniques:from simple solutions aimed at computing simplicity in early years to complex solutions aimed at stabilization effect,and further to advanced solutions trying to meet both computing simplicity and stabilization effect in recent years.In this survey,we first analyze the existing DVS techniques chronologically and then classify them into two basic catalogues:traditional techniques and emerging techniques.Traditional techniques are strictly based on typical motion models and rely on image processing algorithms for motion estimation.Emerging techniques relax the motion models and introduce novel techniques for motion estimation.According to the motion model they adopt,the traditional techniques are further divided into traditional 2Dtechniques and traditional 3Dtechniques.Similarly,the emerging techniques are further divided into emerging 2Dtechniques and sensor-based techniques.In each technique survey,we first analyze the key techniques it relies on and then list its applications in DVS.Finally,we summarize the existing DVS techniques and look into the challenges and developing trend of DVS techniques in the future.
Digital video stabilization(DVS)techniques have been developing for over 30 years.The improvement of device computing ability,the research on related algorithms as well as the market needs have always been driving the development of DVS techniques:from simple solutions aimed at computing simplicity in early years to complex solutions aimed at stabilization effect,and further to advanced solutions trying to meet both computing simplicity and stabilization effect in recent years.In this survey,we first analyze the existing DVS techniques chronologically and then classify them into two basic catalogues:traditional techniques and emerging techniques.Traditional techniques are strictly based on typical motion models and rely on image processing algorithms for motion estimation.Emerging techniques relax the motion models and introduce novel techniques for motion estimation.According to the motion model they adopt,the traditional techniques are further divided into traditional 2Dtechniques and traditional 3Dtechniques.Similarly,the emerging techniques are further divided into emerging 2Dtechniques and sensor-based techniques.In each technique survey,we first analyze the key techniques it relies on and then list its applications in DVS.Finally,we summarize the existing DVS techniques and look into the challenges and developing trend of DVS techniques in the future.
引文
[1]Liu Feng,Gleicher M,Wang Jue,et al.Subspace video stabilization[J].ACM Trans on Graphics,2011,30(1):623-636
[2]Rawat P,Singhai J.Review of motion estimation and video stabilization techniques for hand held mobile video[J].International Journal of Signal&Image Processing,2011,2(2):159-168
[3]Ko S J,Lee S H,Lee K H.Digital image stabilizing algorithms based on bit-plane matching[J].IEEE Trans on Consumer Electronics,1998,44(3):617-622
[4]Morimoto C,Chellappa R.Automatic digital image stabilization[C/OL]//Proc of IEEE Int Conf on Pattern Recognition.Piscataway,NJ:IEEE,1996[2016-02-19].https://www.researchgate.net/publication/247372692_Automatic_Digital_Image_Stabilization
[5]Irani M,Rousso B,Peleg S.Recovery of ego-motion using image stabilization[C]//Proc of Conf on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE,1994:454-460
[6]Chen Ting.Video stabilization algorithm using a blockbased parametric motion model,EE392J[R].Palo Alto,CA:Stanford University,2000
[7]Bhaskar H,Bez H E.A novel block motion estimation model for video stabilization applications[C]//Proc of Int Conf on Informatics in Control,Automation and Robotics.Piscataway,NJ:IEEE,2007:303-306
[8]Vella F,Castorina A,Mancuso M,et al.Digital image stabilization by adaptive block motion vectors filtering[J].IEEE Trans on Consumer Electronics,2002,48(3):796-801
[9]Vella F,Castorina A,Mancuso M,et al.A robust digital image stabilization algorithm using block motion vectors[C]//Proc of Int Conf on Consumer Electronics.Piscataway,NJ:IEEE,2002:234-235
[10]Yang S H,Jheng F M.An adaptive image stabilization technique[C]//Proc of IEEE Int Conf on Systems,Man and Cybernetics.Piscataway,NJ:IEEE,2006:1968-1973
[11]Battiato S,Puglisi G,Bruna A R.A robust video stabilization system by adaptive motion vectors filtering[C]//Proc of ICME.Piscataway,NJ:IEEE,2008:373-376
[12]Chen Homer H,Liang Chiakai,Peng Yuchun,et al.Integration of digital stabilizer with video codec for digital video cameras[J].IEEE Trans on Circuits&Systems for Video Technology,2007,17(7):801-813
[13]Puglisi G,Battiato S.A Robust image alignment algorithm for video stabilization purposes[J].IEEE Trans on Circuits&Systems for Video Technology,2011,21(10):1390-1400
[14]Tang Chongwu,Yang Xiaokang,Chen Li,et al.A fast video stabilization algorithm based on block matching and edge completion[C]//Proc of the 13th IEEE Int Workshop on Multimedia Signal Processing.Piscataway,NJ:IEEE,2011:1-5
[15]Foroosh H,Zerubia J,Berthod M.Extension of phase correlation to subpixel registration[J].IEEE Trans on Image Processing,2002,11(3):188-200
[16]Li Min,Biswas M,Kumar S.DCT-based phase correlation motion estimation[C]//Proc of Int Conf on Image Processing.Piscataway,NJ:IEEE,2004:445-448
[17]Kumar S,Biswas M,Nguyen T.Efficient phase correlation motion estimation using approximate normalization[C]//Proc of the 38th Asilomar Conf on Signals Systems and Computers.Piscataway,NJ:IEEE,2004:1727-1730
[18]Bi Lingyan,Chan Kowkping,Yu Yinglin.Modified CLTdomain motion estimation based on phase correlation[J].Journal of Electronics,2004,21(2):110-115
[19]Argyriou V,Vlachos T.A study of sub-pixel motion estimation using phase correlation[C]//Proc of the British Machine Vision Conf.Durham,UK:BMVA,2006:387-396
[20]Ahmed J,Jafri M N.Improved phase correlation matching[G]//Image and Signal Processing.Berlin:Springer,2008:128-135
[21]Yan Hongshi,Liu Jianguo.Robust phase correllation based motion estimation and its applications[C]//Proc of the British Machine Vision Conf.Durham,UK:BMVA,2008:1045-1054
[22]Vera E,Torres S.Subpixel accuracy analysis of phase correlation registration methods applied to aliased imagery[C]//Proc of the 16th European Signal Processing Conf.Piscataway,NJ:IEEE,2008:1-5
[23]Liu Yangke,De Jifu,Li Bo,et al.Real-time global motion vectors estimation based on phase correlation and gray projection algorithm[C]//Proc of the 2nd Int Congress on Image and Signal Processing.Piscataway,NJ:IEEE,2009:1-5
[24]Chen Yueting,Wu Jiagu,Li Qi,et al.A windowed phase correlation algorithm for subpixel motion estimation[G]//SPIE 7850:Proc of Int Society for Optical Engineering.Bellingham,WA:SPIE,2010:2280-2283
[25]Lai Lijun,Xu Zhiyong.Global motion estimation based on Fourier Mellin and phase correlation[C]//Proc of the 2nd Int Conf on Civil,Materials and Environmental Sciences.Paris:Atlantis,2015:636-639
[26]Erturk S.Digital image stabilization with sub-image phase correlation based global motion estimation[J].IEEE Trans on Consumer Electronics,2003,49(4):1320-1325
[27]Erturk S.Translation,rotation and scale stabilization of image sequences[J].Electronics Letters,2003,39(17):1245-1246
[28]Sanjeev K,Haleh A,Mainak B,et al.Real-time affine global motion estimation using phase correlation and its application for digital image stabilization[J].IEEE Trans on Image Processing,2011,20(12):3406-3418
[29]Jia Ruiming,Zhang Hong,Wang Lei,et al.Digital image stabilization based on phase correlation[C]//Proc of IEEE Int Conf on Artificial Intelligence and Computational Intelligence.Piscataway,NJ:IEEE,2009:485-489
[30]Zhang Yuefei,Xie Mei,Tang Dongming.A central subimage based global motion estimation method for in-car video stabilization[C]//Proc of the 3rd IEEE Int Conf on Knowledge Discovery and Data Mining.Piscataway,NJ:IEEE,2010:204-207
[31]Arnheim R.The perception of the visual world[J].Journal of Aesthetics&Art Criticism,1952,11(2):231-235
[32]Barron J,Fleet D,Beauchemin S S.Performance of optical flow techniques[J].International Journal of Computer Vision,1994,12(1):236-242
[33]Lucas B,Kanade T.An iterative image registration technique with an application to stereo vision[C]//Proc of Int Joint Conf on Artificial Intelligence.Menlo Park,CA:AAAI,1981:674-679
[34]Chang Hungchang,Lai Shanghong,Lu Kuangrong.A robust and efficient video stabilization algorithm[C]//Proc of IEEE Int Conf on Multimedia and Expo.Piscataway,NJ:IEEE,2004:29-32
[35]Chang J Y,Hu Wenfeng,Cheng Muhuo,et al.Digital image translational and rotational motion stabilization using optical flow technique[J].IEEE Trans on Consumer Electronics,2002,48(1):108-115
[36]Cai Jinhai,Walker R A.Robust motion estimation for camcorders mounted in mobile platforms[C]//Proc of Digital Image Computing:Techniques and Applications.Piscataway,NJ:IEEE,2008:491-497
[37]Bouguet J Y.Pyramidal implementation of the Lucas Kanade feature tracker description of the algorithm[R].Santa Clara,CA:Intel Corporation Microprocessor Research Labs,2000
[38]Cai Jinhai,Walker R.A Robust video stabilization algorithm using feature point selection and delta optical flow[J].IET Computer Vision,2010,3(4):176-188
[39]Harris C,Stephens M.A combined corner and edge detector[C]//Proc of the 4th Alvey Vision Conf.Durham,UK:BMVA,1988:147-151
[40]Edward R,Reid P,Tom D.Faster and better:A machine learning approach to corner detection[J].IEEE Trans on Pattern Analysis and Machine Intelligence,2010,32(32):105-119
[41]Shi Jiaobo,Tomasi C.Good features to track[C]//Proc of IEEE Computer Society Conf on Computer Vision and Pattern Recognition.Los Alamitos,CA:IEEE Computer Society,1994:593-600
[42]Lowe D.Distinctive image features from scale-invariant keypoints[J].International Journal of Computer Vision,2004,60(2):91-110
[43]Bay H,Tuytelaars T,Gool L V.SURF:Speeded up robust features[J].Computer Vision&Image Understanding,2006,110(3):404-417
[44]Amisha P.A survey on video stabilization techniques[J].International Journal of Engineering Sciences&Research Technology,2015,4(2):338-342
[45]Censi A,Fusiello A,Roberto V.Image stabilization by features tracking[C]//Proc of IEEE Int Conf on Image Analysis and Processing.Piscataway,NJ:IEEE,1999:665
[46]Hu Rong,Shi Rongjie,Shen Ifan,et al.Video stabilization using scale-invariant features[C]//Proc of the 17th IEEE Int Conf on Information Visualization.Piscataway,NJ:IEEE,2007:871-877
[47]Yang Junlan,Schonfeld D,Mohamed M.Robust video stabilization based on particle filter tracking of projected camera motion[J].IEEE Trans on Circuits&Systems for Video Technology,2009,19(7):945-954
[48]Shen Yao,Guturu P,Damarla T,et al.Video stabilization using principal component analysis and scale invariant feature transform in particle filter framework[J].IEEE Trans on Consumer Electronics,2009,55(3):1714-1721
[49]Pinto B,Anurenjan P R.SURF based robust video stabilization using Kalman filter[C]//Proc of Int Conf on Technological Trends.Piscataway,NJ:IEEE,2011[2016-02-17].https://www.researchgate.net/publication/260384456_SURF_based_Robust_Video_Stabilization_Using_Klman_Filter
[50]Zhou Minqi,Asari V K.A fast video stabilization system based on speeded-up robust features[G]//Advances in Visual Computing.Berlin:Springer,2011:428-435
[51]Zhang Kun,Xu Tingfa,Wang Ping,et al.Real-time fullframe digital image stabilization system by SURF[J].Optics&Precision Engineering,2011,19(8):1964-1972(in Chinese)(张坤,许廷发,王平,等.高精度实时全帧频SURF电子稳像方法[J].光学精密工程,2011,19(8):1964-1972)
[52]Zheng Xie,Cui Shaohui,Wang Gang,et al.Video stabilization system based on speeded-up robust features[C]//Proc of Int Industrial Informatics and Computer Engineering Conf.Paris:Atlantis,2015:1995-1998
[53]Irani M,Anandan P.About direct methods[G]//LNCS1883:Vision Algorithms:Theory and Practice.Berlin:Springer,1999:267-277
[54]Torr P H S,Zisserman A.Feature based methods for structure and motion estimation[G]//LNCS 1883:Vision Algorithms:Theory and Practice.Berlin:Springer,1999:278-294
[55]Kalman R E.A new approach to linear filtering and prediction problems[J].Journal of Basic Engineering,1960,82(1):35-45
[56]Valiviita S,Ovaska S J,Vainio O.Polynomial predictive filtering in control instrumentation:A review[J].IEEE Trans on Industrial Electronics,1999,46(5):876-888
[57]Erturk S.Image sequence stabilization:Motion vector integration(MVI)versus frame position smoothing(FPS)[C]//Proc of the 2nd Int Symp on Image and Signal Processing and Analysis.Piscataway,NJ:IEEE,2001:266-271
[58]Jahne B B.Digital Image Processing:Concepts,Algorithms and Scientific Applications[M].Berlin:Springer,1992
[59]Yasuyuki M,Eyal O,Ge Weina,et al.Full-frame video stabilization with motion inpainting.[J].IEEE Trans on Pattern Analysis&Machine Intelligence,2006,28(7):1150-1163
[60]Xu Jie,Chang Huawen,Yang Shuo,et al.Fast featurebased video stabilization without accumulative global motion estimation[J].IEEE Trans on Consumer Electronics,2012,58(3):993-999
[61]Erturk S.Real-time digital image stabilization using Kalman filters[J].Real-Time Imaging,2002,8(4):317-328
[62]Litvin A,Konrad J,Karl W C.Probabilistic video stabilization using Kalman filtering and mosaicking[G]//SPIE 5022:The Int Society for Optical Engineering.Bellingham,WA:SPIE,2003:663-674
[63]Gullu M K,Yaman E,Erturk S.Image sequence stabilisation using fuzzy adaptive Kalman filtering[J].Electronics Letters,2003,39(5):429-431
[64]Wang Dechong,Liang Aimin.Constraint translational and rotational motion filtering for video stabilization[C]//Proc of the 13th European Signal Processing Conf.Piscataway,NJ:IEEE,2005,2005:64-70
[65]Gordon N,Arulampalam M,Maskell S,et al.A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking[J].IEEE Trans on Signal Process,2002,50(2):174-188
[66]Yang Junlan,Schonfeld D,Chen Chong,et al.Online video stabilization based on particle filters[C]//Proc of Int Conf on Image Processing.Piscataway,NJ:IEEE,2006:1545-1548
[67]Yang Junlan,Schonfeld D,Mohamed M.Robust video stabilization based on particle filter tracking of projected camera motion[J].IEEE Trans on Circuits&Systems for Video Technology,2009,19(7):945-954
[68]Chen Bingyu,Lee Kenyi,Huang Weiting,et al.Capturing intention-based full-frame video stabilization[J].Computer Graphics Forum,2008,27(7):1805-1814
[69]Zhang Fanglue,Wang Jue,Zhao Han,et al.Simultaneous camera path optimization and distraction removal for improving amateur video[J].IEEE Trans on Image Processing,2015,24(12):5982-5994
[70]Yoo S,Katsaggelos A K,Jo G,et al.Video completion using block matching for video stabilization[C]//Proc of the 18th IEEE Int Symp on Consumer Electronics.Piscataway,NJ:IEEE,2014:1-2
[71]Hartley R,Zisserman A.Multiple View Geometry in Computer Vision[M].2nd ed.Cambridge,UK:Cambridge University Press,2003
[72]Hartley R.In defense of the eight-point algorithm[J].IEEE Trans on Pattern Analysis and Machine Intelligence,1997,19(6):580-593
[73]Stewenius H,Nister D,Kahl F,et al.A minimal solution for relative pose with unknown focal length[C]//Proc of IEEE Conf on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE,2005:789-794
[74]Kukelova Z,Bujnak M,Pajdla T.Polynomial eigenvalue solutions to minimal problems in computer vision[J].IEEE Trans on Software Engineering,2012,34(7):1381-1393
[75]Nister D.An efficient solution to the five-point relative pose problem[J].IEEE Trans on Pattern Analysis and Machine Intelligence,2004,26(6):756-770
[76]Li Hongdong,Hartley R.Five-point motion estimation made easy[C]//Proc of the 18th Int Conf on Pattern Recognition.Piscataway,NJ:IEEE,2006:630-633
[77]Brückner M,Bajramovic F,Denzler J.Experimental evaluation of relative pose estimation algorithms[C]//Proc of the 3rd Int Conf on Computer Vision Theory and Applications.Piscataway,NJ:IEEE,2008:431-438
[78]Wang Jungming,Chou Hanping,Chen Seiwang,et al.Video stabilization for a hand-held camera based on 3D motion model[C]//Proc of the 16th IEEE Int Conf on Image Processing.Piscataway,NJ:IEEE,2009:3477-3480
[79]van Wyk M A,Durrani T S,van Wyj B J.A RKHS interpolator-based graph matching algorithm[J].IEEE Trans on Pattern Analysis&Machine Intelligence,2002,24(7):988-995
[80]Zhang Guofeng,Hua Wei,Qin Xueying,et al.Video stabilization based on a 3Dperspective camera model[J].Visual Computer,2009,25(11):997-1008
[81]Liu Feng,Gleicher M,Jin Hailin,et al.Contentpreserving warps for 3Dvideo stabilization[J].ACM Trans on Graphics,2009,28(3):341-352
[82]Lee T H,Lee Y G,Song B C.Fast 3Dvideo stabilization using ROI-based warping[J].Journal of Visual Communication&Image Representation,2014,25(5):943-950
[83]Ryu Y G,Roh H C,Chung M J.3Dvideo stabilization for humanoid eyes using vision and inertial sensors inspired by human VOR[C]//Proc of IEEE Int Conf on Robotics and Biomimetics.Piscataway,NJ:IEEE,2010:1780-1785
[84]Azuma R,Bishop G.Improving static and dynamic registration in an optical seethrough HMD[C]//Proc of the21st Annual Conf on Computer Graphics and Interactive Techniques.New York:ACM,1994:197-204
[85]Grassia F S.Practical parameterization of rotations using the exponential map[J].The Journal of Graphics Tools,1998,3(3):29-48
[86]Hanotaux G,Peroche B.Interactive control of interpolations for animation and modeling[C/OL]//Proc of Graphics Interface.1993:201-208[2016-02-19].https://www.researchgate.net/publication/243782403_Interactive_Control_of_Interpolations_for_Animation_and_Modeling
[87]Johnstone J K,Williams J P.Rational control of orientation for animation[C/OL]//Proc of Graphics Interface.1995:179-186[2016-02-19].https://www.researchgate.net/publication/243781796_Rational_control_of_orientation_for_animation
[88]Shoemake K.Animating rotation with quaternion curves[J].ACM SIGGRAPH Computer Graphics,1985,19(3):245-254
[89]Hsieh C C,Fang Y C,Wang M E,et al.Noise smoothing for VR equipment in quaternions[J].IIE Transactions,1998,30(7):581-587
[90]Lee J,Shin S Y.Motion fairing[C]//Proc of Computer Animation.Piscataway,NJ:IEEE,1996:136-143
[91]Lee J,Shin S Y.General construction of time-domain filters for orientation data[J].IEEE Trans on Visualization and Computer Graphics,2002,8(2):119-128
[92]Morimoto C,Chellappa R.Fast 3Dstabilization and mosaic construction[C]//Proc of IEEE Computer Society Conf on Computer Vision&Pattern Recognition.Piscataway,NJ:IEEE,1997:660-665
[93]Kang Singbing.Survey of image-based rendering techniques[G]//SPIE 4067:The Int Society for Optical Engineering.Bellingham,WA:SPIE,1997:2-16
[94]Shade J,Gortler S,He Liwei,et al.Layered depth images[C]//Proc of the 25th Annual Conf on Computer Graphics and Interactive Techniques.New York:ACM,1998:231-242
[95]Kang S B,Dinh H Q.Multi-layered image-based rendering[J].Graphics Interface,1999,1(7):2-13
[96]Buehler C,Bosse M,Mcmillan L,et al.Unstructured lumigraph rendering[C]//Proc of Association for Computing Machinery.New York:ACM,2001:425-432
[97]Buehler C,Bosse M,Mcmillan L.Non-metric image-based rendering for video stabilization[C]//Proc of the 2001IEEE Computer Society Conf on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE,2001:609-614
[98]Wang Yushuen,Liu Feng,Hsu Pushen,et al.Spatially and temporally optimized video stabilization[J].IEEE Trans on Visualization&Computer Graphics,2013,19(8):1354-1361
[99]Lee Kenyi,Chuang Yungyu,Chen Bingyu,et al.Video stabilization using robust feature trajectories[C]//Proc of IEEE Int Conf on Computer Vision.Piscataway,NJ:IEEE,2009:1397-1404
[100]Tomasi C,Kanade T.Shape and motion from image streams under orthography:A factorization method[J].International Journal of Computer Vision,1992,9(2):137-154
[101]Ryu Y G,Chung M J.Robust online digital image stabilization based on point-feature trajectory without accumulative global motion estimation[J].IEEE Signal Processing Letters,2012,19(4):223-226
[102]Ringaby E,Forssén P E.Efficient video rectification and stabilization for cell-phones[J].International Journal of Computer Vision,2012,96(3):335-352
[103]Liu Shuaicheng,Yuan Lu,Tan Ping,et al.Bundled camera paths for video stabilization[J].ACM Trans on Graphics,2013,32(4):96-96
[104]Bai J,Agarwala A,Agrawala M,et al.User-assisted video stabilization[C]//Proc of the 25th Eurographics Symp on Rendering.New York:ACM,2014:61-70
[105]Wang Zhongqiang,Zhang Lei,Huang Hua.Multiplane video stabilization[C]//Proc of Computer Graphics Forum.Hoboken,NJ:John Wiley&Sons,2013:265-273
[106]Goldstein A,Fattal R.Video stabilization using epipolar geometry[J].ACM Trans on Graphics,2012,31(5):573-587
[107]Laveau S,Faugeras O.3-D scene representation as a collection of images[C]//Proc of the 12th Int Conf on Pattern Recognition.Piscataway,NJ:IEEE,1994:689-691
[108]Hsu Yufeng,Chou Chengchuan,Shih Mingyu.Moving camera video stabilization using homography consistency[C]//Proc of the 19th IEEE Int Conf on Image Processing.Piscataway,NJ:IEEE,2012:2761-2764
[109]Ryu Y G,Roh H C,Chung M J.Video stabilization for robot eye using IMU-aided feature tracker[C]//Proc of IEEE Int Conf on Control Automation and Systems.Piscataway,NJ:IEEE,2010:1875-1878
[110]Karpenko A,Jacobs D,Baek J,et al.Digital video stabilization and rolling shutter correction using gyroscopes[R].Palo Alto,CA:Stanford University,2011
[111]Hanning G,Forslow N,Forssen P E,et al.Stabilizing cell phone video using inertial measurement sensors[C]//Proc of IEEE Int Conf on Computer Vision Workshops.Piscataway,NJ:IEEE,2011:1-8
[112]Jia Chao,Evans B L.3Drotational video stabilization using manifold optimization[C]//Proc of Int Conf on Acoustics,Speech,and Signal Processing.Piscataway,NJ:IEEE,2013:2493-2497
[113]Jia Chao,Evans B L.Constrained 3Drotation smoothing via global manifold regression for video stabilization[J].IEEE Trans on Signal Processing,2014,62(13):3293-3304
[114]Bell S,Troccoli A,Pulli K.A non-linear filter for gyroscope-based video stabilization[C]//Proc of European Conf on Computer Vision.Berlin:Springer,2014:294-308
[115]Sun Jian.Video stabilization with a depth camera[C]//Proc of IEEE Computer Society Conf on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE,2012:89-95
[2]Rawat P,Singhai J.Review of motion estimation and video stabilization techniques for hand held mobile video[J].International Journal of Signal&Image Processing,2011,2(2):159-168
[3]Ko S J,Lee S H,Lee K H.Digital image stabilizing algorithms based on bit-plane matching[J].IEEE Trans on Consumer Electronics,1998,44(3):617-622
[4]Morimoto C,Chellappa R.Automatic digital image stabilization[C/OL]//Proc of IEEE Int Conf on Pattern Recognition.Piscataway,NJ:IEEE,1996[2016-02-19].https://www.researchgate.net/publication/247372692_Automatic_Digital_Image_Stabilization
[5]Irani M,Rousso B,Peleg S.Recovery of ego-motion using image stabilization[C]//Proc of Conf on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE,1994:454-460
[6]Chen Ting.Video stabilization algorithm using a blockbased parametric motion model,EE392J[R].Palo Alto,CA:Stanford University,2000
[7]Bhaskar H,Bez H E.A novel block motion estimation model for video stabilization applications[C]//Proc of Int Conf on Informatics in Control,Automation and Robotics.Piscataway,NJ:IEEE,2007:303-306
[8]Vella F,Castorina A,Mancuso M,et al.Digital image stabilization by adaptive block motion vectors filtering[J].IEEE Trans on Consumer Electronics,2002,48(3):796-801
[9]Vella F,Castorina A,Mancuso M,et al.A robust digital image stabilization algorithm using block motion vectors[C]//Proc of Int Conf on Consumer Electronics.Piscataway,NJ:IEEE,2002:234-235
[10]Yang S H,Jheng F M.An adaptive image stabilization technique[C]//Proc of IEEE Int Conf on Systems,Man and Cybernetics.Piscataway,NJ:IEEE,2006:1968-1973
[11]Battiato S,Puglisi G,Bruna A R.A robust video stabilization system by adaptive motion vectors filtering[C]//Proc of ICME.Piscataway,NJ:IEEE,2008:373-376
[12]Chen Homer H,Liang Chiakai,Peng Yuchun,et al.Integration of digital stabilizer with video codec for digital video cameras[J].IEEE Trans on Circuits&Systems for Video Technology,2007,17(7):801-813
[13]Puglisi G,Battiato S.A Robust image alignment algorithm for video stabilization purposes[J].IEEE Trans on Circuits&Systems for Video Technology,2011,21(10):1390-1400
[14]Tang Chongwu,Yang Xiaokang,Chen Li,et al.A fast video stabilization algorithm based on block matching and edge completion[C]//Proc of the 13th IEEE Int Workshop on Multimedia Signal Processing.Piscataway,NJ:IEEE,2011:1-5
[15]Foroosh H,Zerubia J,Berthod M.Extension of phase correlation to subpixel registration[J].IEEE Trans on Image Processing,2002,11(3):188-200
[16]Li Min,Biswas M,Kumar S.DCT-based phase correlation motion estimation[C]//Proc of Int Conf on Image Processing.Piscataway,NJ:IEEE,2004:445-448
[17]Kumar S,Biswas M,Nguyen T.Efficient phase correlation motion estimation using approximate normalization[C]//Proc of the 38th Asilomar Conf on Signals Systems and Computers.Piscataway,NJ:IEEE,2004:1727-1730
[18]Bi Lingyan,Chan Kowkping,Yu Yinglin.Modified CLTdomain motion estimation based on phase correlation[J].Journal of Electronics,2004,21(2):110-115
[19]Argyriou V,Vlachos T.A study of sub-pixel motion estimation using phase correlation[C]//Proc of the British Machine Vision Conf.Durham,UK:BMVA,2006:387-396
[20]Ahmed J,Jafri M N.Improved phase correlation matching[G]//Image and Signal Processing.Berlin:Springer,2008:128-135
[21]Yan Hongshi,Liu Jianguo.Robust phase correllation based motion estimation and its applications[C]//Proc of the British Machine Vision Conf.Durham,UK:BMVA,2008:1045-1054
[22]Vera E,Torres S.Subpixel accuracy analysis of phase correlation registration methods applied to aliased imagery[C]//Proc of the 16th European Signal Processing Conf.Piscataway,NJ:IEEE,2008:1-5
[23]Liu Yangke,De Jifu,Li Bo,et al.Real-time global motion vectors estimation based on phase correlation and gray projection algorithm[C]//Proc of the 2nd Int Congress on Image and Signal Processing.Piscataway,NJ:IEEE,2009:1-5
[24]Chen Yueting,Wu Jiagu,Li Qi,et al.A windowed phase correlation algorithm for subpixel motion estimation[G]//SPIE 7850:Proc of Int Society for Optical Engineering.Bellingham,WA:SPIE,2010:2280-2283
[25]Lai Lijun,Xu Zhiyong.Global motion estimation based on Fourier Mellin and phase correlation[C]//Proc of the 2nd Int Conf on Civil,Materials and Environmental Sciences.Paris:Atlantis,2015:636-639
[26]Erturk S.Digital image stabilization with sub-image phase correlation based global motion estimation[J].IEEE Trans on Consumer Electronics,2003,49(4):1320-1325
[27]Erturk S.Translation,rotation and scale stabilization of image sequences[J].Electronics Letters,2003,39(17):1245-1246
[28]Sanjeev K,Haleh A,Mainak B,et al.Real-time affine global motion estimation using phase correlation and its application for digital image stabilization[J].IEEE Trans on Image Processing,2011,20(12):3406-3418
[29]Jia Ruiming,Zhang Hong,Wang Lei,et al.Digital image stabilization based on phase correlation[C]//Proc of IEEE Int Conf on Artificial Intelligence and Computational Intelligence.Piscataway,NJ:IEEE,2009:485-489
[30]Zhang Yuefei,Xie Mei,Tang Dongming.A central subimage based global motion estimation method for in-car video stabilization[C]//Proc of the 3rd IEEE Int Conf on Knowledge Discovery and Data Mining.Piscataway,NJ:IEEE,2010:204-207
[31]Arnheim R.The perception of the visual world[J].Journal of Aesthetics&Art Criticism,1952,11(2):231-235
[32]Barron J,Fleet D,Beauchemin S S.Performance of optical flow techniques[J].International Journal of Computer Vision,1994,12(1):236-242
[33]Lucas B,Kanade T.An iterative image registration technique with an application to stereo vision[C]//Proc of Int Joint Conf on Artificial Intelligence.Menlo Park,CA:AAAI,1981:674-679
[34]Chang Hungchang,Lai Shanghong,Lu Kuangrong.A robust and efficient video stabilization algorithm[C]//Proc of IEEE Int Conf on Multimedia and Expo.Piscataway,NJ:IEEE,2004:29-32
[35]Chang J Y,Hu Wenfeng,Cheng Muhuo,et al.Digital image translational and rotational motion stabilization using optical flow technique[J].IEEE Trans on Consumer Electronics,2002,48(1):108-115
[36]Cai Jinhai,Walker R A.Robust motion estimation for camcorders mounted in mobile platforms[C]//Proc of Digital Image Computing:Techniques and Applications.Piscataway,NJ:IEEE,2008:491-497
[37]Bouguet J Y.Pyramidal implementation of the Lucas Kanade feature tracker description of the algorithm[R].Santa Clara,CA:Intel Corporation Microprocessor Research Labs,2000
[38]Cai Jinhai,Walker R.A Robust video stabilization algorithm using feature point selection and delta optical flow[J].IET Computer Vision,2010,3(4):176-188
[39]Harris C,Stephens M.A combined corner and edge detector[C]//Proc of the 4th Alvey Vision Conf.Durham,UK:BMVA,1988:147-151
[40]Edward R,Reid P,Tom D.Faster and better:A machine learning approach to corner detection[J].IEEE Trans on Pattern Analysis and Machine Intelligence,2010,32(32):105-119
[41]Shi Jiaobo,Tomasi C.Good features to track[C]//Proc of IEEE Computer Society Conf on Computer Vision and Pattern Recognition.Los Alamitos,CA:IEEE Computer Society,1994:593-600
[42]Lowe D.Distinctive image features from scale-invariant keypoints[J].International Journal of Computer Vision,2004,60(2):91-110
[43]Bay H,Tuytelaars T,Gool L V.SURF:Speeded up robust features[J].Computer Vision&Image Understanding,2006,110(3):404-417
[44]Amisha P.A survey on video stabilization techniques[J].International Journal of Engineering Sciences&Research Technology,2015,4(2):338-342
[45]Censi A,Fusiello A,Roberto V.Image stabilization by features tracking[C]//Proc of IEEE Int Conf on Image Analysis and Processing.Piscataway,NJ:IEEE,1999:665
[46]Hu Rong,Shi Rongjie,Shen Ifan,et al.Video stabilization using scale-invariant features[C]//Proc of the 17th IEEE Int Conf on Information Visualization.Piscataway,NJ:IEEE,2007:871-877
[47]Yang Junlan,Schonfeld D,Mohamed M.Robust video stabilization based on particle filter tracking of projected camera motion[J].IEEE Trans on Circuits&Systems for Video Technology,2009,19(7):945-954
[48]Shen Yao,Guturu P,Damarla T,et al.Video stabilization using principal component analysis and scale invariant feature transform in particle filter framework[J].IEEE Trans on Consumer Electronics,2009,55(3):1714-1721
[49]Pinto B,Anurenjan P R.SURF based robust video stabilization using Kalman filter[C]//Proc of Int Conf on Technological Trends.Piscataway,NJ:IEEE,2011[2016-02-17].https://www.researchgate.net/publication/260384456_SURF_based_Robust_Video_Stabilization_Using_Klman_Filter
[50]Zhou Minqi,Asari V K.A fast video stabilization system based on speeded-up robust features[G]//Advances in Visual Computing.Berlin:Springer,2011:428-435
[51]Zhang Kun,Xu Tingfa,Wang Ping,et al.Real-time fullframe digital image stabilization system by SURF[J].Optics&Precision Engineering,2011,19(8):1964-1972(in Chinese)(张坤,许廷发,王平,等.高精度实时全帧频SURF电子稳像方法[J].光学精密工程,2011,19(8):1964-1972)
[52]Zheng Xie,Cui Shaohui,Wang Gang,et al.Video stabilization system based on speeded-up robust features[C]//Proc of Int Industrial Informatics and Computer Engineering Conf.Paris:Atlantis,2015:1995-1998
[53]Irani M,Anandan P.About direct methods[G]//LNCS1883:Vision Algorithms:Theory and Practice.Berlin:Springer,1999:267-277
[54]Torr P H S,Zisserman A.Feature based methods for structure and motion estimation[G]//LNCS 1883:Vision Algorithms:Theory and Practice.Berlin:Springer,1999:278-294
[55]Kalman R E.A new approach to linear filtering and prediction problems[J].Journal of Basic Engineering,1960,82(1):35-45
[56]Valiviita S,Ovaska S J,Vainio O.Polynomial predictive filtering in control instrumentation:A review[J].IEEE Trans on Industrial Electronics,1999,46(5):876-888
[57]Erturk S.Image sequence stabilization:Motion vector integration(MVI)versus frame position smoothing(FPS)[C]//Proc of the 2nd Int Symp on Image and Signal Processing and Analysis.Piscataway,NJ:IEEE,2001:266-271
[58]Jahne B B.Digital Image Processing:Concepts,Algorithms and Scientific Applications[M].Berlin:Springer,1992
[59]Yasuyuki M,Eyal O,Ge Weina,et al.Full-frame video stabilization with motion inpainting.[J].IEEE Trans on Pattern Analysis&Machine Intelligence,2006,28(7):1150-1163
[60]Xu Jie,Chang Huawen,Yang Shuo,et al.Fast featurebased video stabilization without accumulative global motion estimation[J].IEEE Trans on Consumer Electronics,2012,58(3):993-999
[61]Erturk S.Real-time digital image stabilization using Kalman filters[J].Real-Time Imaging,2002,8(4):317-328
[62]Litvin A,Konrad J,Karl W C.Probabilistic video stabilization using Kalman filtering and mosaicking[G]//SPIE 5022:The Int Society for Optical Engineering.Bellingham,WA:SPIE,2003:663-674
[63]Gullu M K,Yaman E,Erturk S.Image sequence stabilisation using fuzzy adaptive Kalman filtering[J].Electronics Letters,2003,39(5):429-431
[64]Wang Dechong,Liang Aimin.Constraint translational and rotational motion filtering for video stabilization[C]//Proc of the 13th European Signal Processing Conf.Piscataway,NJ:IEEE,2005,2005:64-70
[65]Gordon N,Arulampalam M,Maskell S,et al.A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking[J].IEEE Trans on Signal Process,2002,50(2):174-188
[66]Yang Junlan,Schonfeld D,Chen Chong,et al.Online video stabilization based on particle filters[C]//Proc of Int Conf on Image Processing.Piscataway,NJ:IEEE,2006:1545-1548
[67]Yang Junlan,Schonfeld D,Mohamed M.Robust video stabilization based on particle filter tracking of projected camera motion[J].IEEE Trans on Circuits&Systems for Video Technology,2009,19(7):945-954
[68]Chen Bingyu,Lee Kenyi,Huang Weiting,et al.Capturing intention-based full-frame video stabilization[J].Computer Graphics Forum,2008,27(7):1805-1814
[69]Zhang Fanglue,Wang Jue,Zhao Han,et al.Simultaneous camera path optimization and distraction removal for improving amateur video[J].IEEE Trans on Image Processing,2015,24(12):5982-5994
[70]Yoo S,Katsaggelos A K,Jo G,et al.Video completion using block matching for video stabilization[C]//Proc of the 18th IEEE Int Symp on Consumer Electronics.Piscataway,NJ:IEEE,2014:1-2
[71]Hartley R,Zisserman A.Multiple View Geometry in Computer Vision[M].2nd ed.Cambridge,UK:Cambridge University Press,2003
[72]Hartley R.In defense of the eight-point algorithm[J].IEEE Trans on Pattern Analysis and Machine Intelligence,1997,19(6):580-593
[73]Stewenius H,Nister D,Kahl F,et al.A minimal solution for relative pose with unknown focal length[C]//Proc of IEEE Conf on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE,2005:789-794
[74]Kukelova Z,Bujnak M,Pajdla T.Polynomial eigenvalue solutions to minimal problems in computer vision[J].IEEE Trans on Software Engineering,2012,34(7):1381-1393
[75]Nister D.An efficient solution to the five-point relative pose problem[J].IEEE Trans on Pattern Analysis and Machine Intelligence,2004,26(6):756-770
[76]Li Hongdong,Hartley R.Five-point motion estimation made easy[C]//Proc of the 18th Int Conf on Pattern Recognition.Piscataway,NJ:IEEE,2006:630-633
[77]Brückner M,Bajramovic F,Denzler J.Experimental evaluation of relative pose estimation algorithms[C]//Proc of the 3rd Int Conf on Computer Vision Theory and Applications.Piscataway,NJ:IEEE,2008:431-438
[78]Wang Jungming,Chou Hanping,Chen Seiwang,et al.Video stabilization for a hand-held camera based on 3D motion model[C]//Proc of the 16th IEEE Int Conf on Image Processing.Piscataway,NJ:IEEE,2009:3477-3480
[79]van Wyk M A,Durrani T S,van Wyj B J.A RKHS interpolator-based graph matching algorithm[J].IEEE Trans on Pattern Analysis&Machine Intelligence,2002,24(7):988-995
[80]Zhang Guofeng,Hua Wei,Qin Xueying,et al.Video stabilization based on a 3Dperspective camera model[J].Visual Computer,2009,25(11):997-1008
[81]Liu Feng,Gleicher M,Jin Hailin,et al.Contentpreserving warps for 3Dvideo stabilization[J].ACM Trans on Graphics,2009,28(3):341-352
[82]Lee T H,Lee Y G,Song B C.Fast 3Dvideo stabilization using ROI-based warping[J].Journal of Visual Communication&Image Representation,2014,25(5):943-950
[83]Ryu Y G,Roh H C,Chung M J.3Dvideo stabilization for humanoid eyes using vision and inertial sensors inspired by human VOR[C]//Proc of IEEE Int Conf on Robotics and Biomimetics.Piscataway,NJ:IEEE,2010:1780-1785
[84]Azuma R,Bishop G.Improving static and dynamic registration in an optical seethrough HMD[C]//Proc of the21st Annual Conf on Computer Graphics and Interactive Techniques.New York:ACM,1994:197-204
[85]Grassia F S.Practical parameterization of rotations using the exponential map[J].The Journal of Graphics Tools,1998,3(3):29-48
[86]Hanotaux G,Peroche B.Interactive control of interpolations for animation and modeling[C/OL]//Proc of Graphics Interface.1993:201-208[2016-02-19].https://www.researchgate.net/publication/243782403_Interactive_Control_of_Interpolations_for_Animation_and_Modeling
[87]Johnstone J K,Williams J P.Rational control of orientation for animation[C/OL]//Proc of Graphics Interface.1995:179-186[2016-02-19].https://www.researchgate.net/publication/243781796_Rational_control_of_orientation_for_animation
[88]Shoemake K.Animating rotation with quaternion curves[J].ACM SIGGRAPH Computer Graphics,1985,19(3):245-254
[89]Hsieh C C,Fang Y C,Wang M E,et al.Noise smoothing for VR equipment in quaternions[J].IIE Transactions,1998,30(7):581-587
[90]Lee J,Shin S Y.Motion fairing[C]//Proc of Computer Animation.Piscataway,NJ:IEEE,1996:136-143
[91]Lee J,Shin S Y.General construction of time-domain filters for orientation data[J].IEEE Trans on Visualization and Computer Graphics,2002,8(2):119-128
[92]Morimoto C,Chellappa R.Fast 3Dstabilization and mosaic construction[C]//Proc of IEEE Computer Society Conf on Computer Vision&Pattern Recognition.Piscataway,NJ:IEEE,1997:660-665
[93]Kang Singbing.Survey of image-based rendering techniques[G]//SPIE 4067:The Int Society for Optical Engineering.Bellingham,WA:SPIE,1997:2-16
[94]Shade J,Gortler S,He Liwei,et al.Layered depth images[C]//Proc of the 25th Annual Conf on Computer Graphics and Interactive Techniques.New York:ACM,1998:231-242
[95]Kang S B,Dinh H Q.Multi-layered image-based rendering[J].Graphics Interface,1999,1(7):2-13
[96]Buehler C,Bosse M,Mcmillan L,et al.Unstructured lumigraph rendering[C]//Proc of Association for Computing Machinery.New York:ACM,2001:425-432
[97]Buehler C,Bosse M,Mcmillan L.Non-metric image-based rendering for video stabilization[C]//Proc of the 2001IEEE Computer Society Conf on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE,2001:609-614
[98]Wang Yushuen,Liu Feng,Hsu Pushen,et al.Spatially and temporally optimized video stabilization[J].IEEE Trans on Visualization&Computer Graphics,2013,19(8):1354-1361
[99]Lee Kenyi,Chuang Yungyu,Chen Bingyu,et al.Video stabilization using robust feature trajectories[C]//Proc of IEEE Int Conf on Computer Vision.Piscataway,NJ:IEEE,2009:1397-1404
[100]Tomasi C,Kanade T.Shape and motion from image streams under orthography:A factorization method[J].International Journal of Computer Vision,1992,9(2):137-154
[101]Ryu Y G,Chung M J.Robust online digital image stabilization based on point-feature trajectory without accumulative global motion estimation[J].IEEE Signal Processing Letters,2012,19(4):223-226
[102]Ringaby E,Forssén P E.Efficient video rectification and stabilization for cell-phones[J].International Journal of Computer Vision,2012,96(3):335-352
[103]Liu Shuaicheng,Yuan Lu,Tan Ping,et al.Bundled camera paths for video stabilization[J].ACM Trans on Graphics,2013,32(4):96-96
[104]Bai J,Agarwala A,Agrawala M,et al.User-assisted video stabilization[C]//Proc of the 25th Eurographics Symp on Rendering.New York:ACM,2014:61-70
[105]Wang Zhongqiang,Zhang Lei,Huang Hua.Multiplane video stabilization[C]//Proc of Computer Graphics Forum.Hoboken,NJ:John Wiley&Sons,2013:265-273
[106]Goldstein A,Fattal R.Video stabilization using epipolar geometry[J].ACM Trans on Graphics,2012,31(5):573-587
[107]Laveau S,Faugeras O.3-D scene representation as a collection of images[C]//Proc of the 12th Int Conf on Pattern Recognition.Piscataway,NJ:IEEE,1994:689-691
[108]Hsu Yufeng,Chou Chengchuan,Shih Mingyu.Moving camera video stabilization using homography consistency[C]//Proc of the 19th IEEE Int Conf on Image Processing.Piscataway,NJ:IEEE,2012:2761-2764
[109]Ryu Y G,Roh H C,Chung M J.Video stabilization for robot eye using IMU-aided feature tracker[C]//Proc of IEEE Int Conf on Control Automation and Systems.Piscataway,NJ:IEEE,2010:1875-1878
[110]Karpenko A,Jacobs D,Baek J,et al.Digital video stabilization and rolling shutter correction using gyroscopes[R].Palo Alto,CA:Stanford University,2011
[111]Hanning G,Forslow N,Forssen P E,et al.Stabilizing cell phone video using inertial measurement sensors[C]//Proc of IEEE Int Conf on Computer Vision Workshops.Piscataway,NJ:IEEE,2011:1-8
[112]Jia Chao,Evans B L.3Drotational video stabilization using manifold optimization[C]//Proc of Int Conf on Acoustics,Speech,and Signal Processing.Piscataway,NJ:IEEE,2013:2493-2497
[113]Jia Chao,Evans B L.Constrained 3Drotation smoothing via global manifold regression for video stabilization[J].IEEE Trans on Signal Processing,2014,62(13):3293-3304
[114]Bell S,Troccoli A,Pulli K.A non-linear filter for gyroscope-based video stabilization[C]//Proc of European Conf on Computer Vision.Berlin:Springer,2014:294-308
[115]Sun Jian.Video stabilization with a depth camera[C]//Proc of IEEE Computer Society Conf on Computer Vision and Pattern Recognition.Piscataway,NJ:IEEE,2012:89-95