空中视频序列的分辨率增强技术的研究
|
摘要
本文主要针对基于空中视频图象序列的图象分辨率增强技术进行研究,该技术主要是通过获取得到的低分辨率视频图象序列应用超分辨率重建算法来重建高分辨率的图象以达到图象分辨率增强的目的。通过超分辨率重构算法重建高分辨率图象,既提高了分辨率,又提高了系统的效能,是现有既定条件下比较可行的一种图象分辨率增强方法。
本文就基于空中视频图象序列的超分辨率重构技术开展了一系列理论研究和实验探索,主要做了以下几个方面的工作。
首先,介绍并解释了与该课题相关主要术语,介绍了该课题的应用背景以及国内外研究现状。以期使读者对该课题从宏观上有一个粗略的了解。
建立一个正确的图象退化模型是图象复原和图象超分辨率重建的前提,本文比较详细的介绍了图象退化模型建立的过程,构造更高分辨率的图象就是图象的上抽样过程,离不开对图象的插值放大处理,因此本文简单介绍了一些基本的图象插值算法。
基于本文所研究问题的应用环境,占有很大一部分比例的视频图象是运动退化的本文详细研究并实现了频域和空域中的运动退化图象复原算法。并取得了较为满意的恢复结果。另外,本文简要的介绍了当前比较流行运动估计方法,光流场方法和模块匹配方法。
本文研究并实现了基于凸集投影(POCS)和迭代反卷积(IBP)两种超分辨率重建算法来重建更高分辨率的图象以达到图象分辨率增强的目的。本文详细分析了这两种算法各自的优缺点,分析得知,由于其良好的抗噪能力和能充分利用先验信息的能力,使得POCS算法比较适合本文所研究问题的应用环境。
最后对本课题做了总结和展望,提出了后续可以进行的一些工作。
The research work focuses on the resolution enhancement by the video sequences in the air, which is a technique of estimating a high-resolution from video sequences to enhance the resolution of image. This technique reconstructs the image by algorithm of high-resolution. It raises the resolution as while as the efficiency, so that it has become one of the most available methods to enhance resolution of image.
The thesis summarized the academic and experimental research on the super-resolution reconstruction by the air video sequence, and the detailed research works can be described as following:
At the very beginning, we introduced the main gloss correlate to the problem. And then we took the pictures of the resolution testing board and other practicalities to make the reader have a macroscopical view about the problem.
The precondition of the image restoration and the super-resolution is building a correct model of degradations. The thesis introduced the process of building degradation model. Since super-resolution reconstruction is the process of up-sampling the low-resolution images, we introduced some basic interpolation algorithm for digital images.
The thesis introduced the process of building degradation model. Since super-resolution reconstruction is the process of up-sampling the low-resolution images, we introduced some basic interpolation algorithm for digital images. Besides that, to evaluate the quality of processed image, we introduced some evaluation functions to evaluate image quality.
In this right condition, the motion blurred images hold a large proportion in the video sequences, so one of our main tasks is to restore these motion blurred images. The thesis research and implement the main restoration algorithms, including frequency domain and special domain processing and obtain approving results. Besides that, we introduced the popular algorithm for motion estimation.
The thesis researched and implemented the projection onto convex sets super-resolution reconstruction algorithm and the iterative back projection super-resolution reconstruction algorithm to enhance the resolution of the image. We analysis the advantages and the disadvantages of the two algorithms .And then we got the conclusion, for it's noise resistibility and priori information capability, POCS algorithm is fit for the right problem which the thesis researched.
In the end of the thesis, we prospected the future of the technology and analyzed the necessary development in this field.
本文就基于空中视频图象序列的超分辨率重构技术开展了一系列理论研究和实验探索,主要做了以下几个方面的工作。
首先,介绍并解释了与该课题相关主要术语,介绍了该课题的应用背景以及国内外研究现状。以期使读者对该课题从宏观上有一个粗略的了解。
建立一个正确的图象退化模型是图象复原和图象超分辨率重建的前提,本文比较详细的介绍了图象退化模型建立的过程,构造更高分辨率的图象就是图象的上抽样过程,离不开对图象的插值放大处理,因此本文简单介绍了一些基本的图象插值算法。
基于本文所研究问题的应用环境,占有很大一部分比例的视频图象是运动退化的本文详细研究并实现了频域和空域中的运动退化图象复原算法。并取得了较为满意的恢复结果。另外,本文简要的介绍了当前比较流行运动估计方法,光流场方法和模块匹配方法。
本文研究并实现了基于凸集投影(POCS)和迭代反卷积(IBP)两种超分辨率重建算法来重建更高分辨率的图象以达到图象分辨率增强的目的。本文详细分析了这两种算法各自的优缺点,分析得知,由于其良好的抗噪能力和能充分利用先验信息的能力,使得POCS算法比较适合本文所研究问题的应用环境。
最后对本课题做了总结和展望,提出了后续可以进行的一些工作。
The research work focuses on the resolution enhancement by the video sequences in the air, which is a technique of estimating a high-resolution from video sequences to enhance the resolution of image. This technique reconstructs the image by algorithm of high-resolution. It raises the resolution as while as the efficiency, so that it has become one of the most available methods to enhance resolution of image.
The thesis summarized the academic and experimental research on the super-resolution reconstruction by the air video sequence, and the detailed research works can be described as following:
At the very beginning, we introduced the main gloss correlate to the problem. And then we took the pictures of the resolution testing board and other practicalities to make the reader have a macroscopical view about the problem.
The precondition of the image restoration and the super-resolution is building a correct model of degradations. The thesis introduced the process of building degradation model. Since super-resolution reconstruction is the process of up-sampling the low-resolution images, we introduced some basic interpolation algorithm for digital images.
The thesis introduced the process of building degradation model. Since super-resolution reconstruction is the process of up-sampling the low-resolution images, we introduced some basic interpolation algorithm for digital images. Besides that, to evaluate the quality of processed image, we introduced some evaluation functions to evaluate image quality.
In this right condition, the motion blurred images hold a large proportion in the video sequences, so one of our main tasks is to restore these motion blurred images. The thesis research and implement the main restoration algorithms, including frequency domain and special domain processing and obtain approving results. Besides that, we introduced the popular algorithm for motion estimation.
The thesis researched and implemented the projection onto convex sets super-resolution reconstruction algorithm and the iterative back projection super-resolution reconstruction algorithm to enhance the resolution of the image. We analysis the advantages and the disadvantages of the two algorithms .And then we got the conclusion, for it's noise resistibility and priori information capability, POCS algorithm is fit for the right problem which the thesis researched.
In the end of the thesis, we prospected the future of the technology and analyzed the necessary development in this field.
引文
[1]阮秋琦编著,数字图象处理学,北京:电子工业出版社,2001
[2]Tsai R Y,Huang T S.Multi-frame image restoration and registration[J].Adcances in Computer Vision and Image Processing,1984,1:101-106
[3]Mehmet K.Ozkan,A.Murat Tekalp,and M,Ibrahim Sezan POCS-Based Restoration of Space-Varying Blurred Images[J]IEEE Transactions on image processing,vol,3.No,4,July 1994:450-454
[4]Dante C.Youlafellow,IEEE,Generalized Image Restoration by the Method of Alternation Orthogonal Projections[J].IEEE Transactions on circuits and systems,vol,CAS-25,No.9,September 1978:694-702
[5]Ibrahim Sezan M and Murat Tekalp A,Adaptive Image Restoration with Artifact Suppression Using the Theory of Convex Projections.IEEE.Transactions on acoustics,speech and signal.vol.38.No.1 January 1990:181-185
[6]Tekalp A M,Ozkan M K,Sezan M L.High-resolution image reconstruction for lower-resolution image restoration[A].Proceedings of the IEEE International Conference on Acousics,Speech and Signal Processing[C].San Francisco,CA,1992
[7]Ng M K,Bose N K.Mathematical analysis of super-resolution methodology[J].IEEE Signal Processing Magazine,2003(5):62-74
[8]Elad M,Feuer A Super-resolution restoration of image sequence:adaptive filtering approach[J].IEEE Trans IP,1989,8(3):387-395
[9]Nelson D.A.Mascarenhas and William K.Pratt,member,IEEE,Digital Image Restoration under a Regression Model.IEEE Transaction on circuits and systems,Vol,cas-22,No3,March 1975:252-266
[10]明文华,孔晓(?),梁栋.运动模糊图象的恢复方法研究.计算机工程.vol.30No.7,April 2004:133-135
[11]Wang Xiaohong,Zhao Rongchun.Restoration of motional-blurred Images.Hefei:In:SPIE Proc.Second International Conference on Image and Graphics,2002-08:413-421
[12]陈前荣,陆启生,成礼智.基于方向微分的运动模糊方向鉴别.中国图象图象学报.2005,10(5):590-595
[13]陈前荣,陆启生等.运动模糊图象点扩散函数尺度鉴别.计算机工程与应用.2004,23:15-19
[14]Alexander A.Sawchuk,member,IEEE.Space-Variant Motion degradation and Restoration.Proceedings of the IEEE,VOL.60,No,7,July 1972:854-861
[15]洪功义,姜昱明.基于图象配准的POCS超分辨率图象重构,计算机仿真,2004,21(6)145-147
[16]Nguyen.Numerical Algorithms for image Super-Resolution[D].Stanford University.2000
[17]H Anddrew,B Hunt.Digital image resolution[M].Prentice Hall,Englewood Cliffs,NJ,1997
[18]曹三省.光流场估计算法的优化分析.Natural Science Edition Journal of Beijing Broadcasting Institute,Vol.8,No.4(Dec 2001)23-29
[19]HORN B,SCHUNCK B.Determining optical flow[J].Artificial Intelligence,1981,17(4):185-203
[20]薛梅.复原和超分辨率复原算法及应用研究.东南大学硕士学位论文.2002
[21]Nhat Xuan Ngugen.Numerical algorithms for image super-resolution[M].PhD Thesis,Stanford University,2000.
[22]R.C.Hardie,K.j.Barnard,J.G.Bogar,E.E.Armstrong,and E.A.Watson," High Resolution Image Reconstruction from a Sequence of Rotated and Translated Frames and It's Application to an Infrared Imaging System",Optical Engineering,vol.73,no.l,pp247-26,Jan.1998.
[23]Schultz R,Stevenson R L.Extraction of high-resolution frames from video sequence [J].IEEE Trans IP,1996,5(6):996-1011
[24]张新明,沈兰荪.超分辨率复原技术的发展.测控技术.2002,21(5):33-35
[25]B.Vrcel,P.P.Vaidyanathan.Efficient implementation of all digital Interpolation.IEEE Trans.On Image Processing,2001,10(11):1639-1646
[26]N.Nguyen,P.Milanfar,G.Golub.A computationally efficient super-resolution image reconstruction algorithm.IEEE Trans.On Image Processing,2001,10(4):573-583
[27]王小红,陈秀万,潭仲军,赵光椿.一种有效的运动模糊图象恢复算法.计算机工程.2003,29(17):13
[28]陆俊,舒志龙,阮秋琦.基于尺度旋转的图象恢复研究.通信学报.2000,21(7)67-71
[29]XIANG Youjun,Guo Baolong.Fast block matching algorithms for motion estimation.Computer Engineering.Vol.29 No 13.August 2003:62-64
[30]汪孔桥,Jari.A.Kangas.数字图象的质量评价.测控技术.2000,19(5):14-16
[31]Irani M,Peleg S.Motion Analysis for Image Enhancement:Resolution,Occlusion and Image Resolution,1993;(12)
[32]张新明,沈兰荪.超分辨率复原技术的发展,测控技术,2002,21(5)
[33]Michael Elad and Arie Feuer,Senior Member,IEEE.Restoration of a single super-resolution image from several blurred,noisy and understand measured images.IEEE Transaction on image processing,Vol 6.No.12,December 1997:1646-1658
[34]孟昕,张燕平.运动模糊图象恢复的算法研究与分析,计算机技术与发展2007,17(8):73-76
[35]纪现才.视频图像超分辨率复原,北京工业大学硕士学位沦文,2003
[36]焦斌亮,赵文蕾.浅析互有位移图象序列的超分辨率复原,遥测遥控,2006,27(1)
[37]周芳.图象超分辨率复原技术的现状与展望,自动化与仪表,2006(1):10-14
[38]高守传,姚领田等编著.Visual C++实践与提高—数字图象处理与工程应用篇.北京:中国铁道出版社.2005
[39]赵文蕾.基于互有位移序列图象的超分辨率复原技术研究.燕山大学硕士学位论文,2006
[40]刘志军.图象超分辨率复原技术研究,华中科技大学硕士学位论文,2004
[41]J.K.Han,H.M.Kim.Modified cubic convolution scalier with minimum loss of information.Optical engineering,2001,40(4):540-546
[42]钟山等.图象静态超分辨率重建.红外与毫米波学报,2000,(2):153-156
[2]Tsai R Y,Huang T S.Multi-frame image restoration and registration[J].Adcances in Computer Vision and Image Processing,1984,1:101-106
[3]Mehmet K.Ozkan,A.Murat Tekalp,and M,Ibrahim Sezan POCS-Based Restoration of Space-Varying Blurred Images[J]IEEE Transactions on image processing,vol,3.No,4,July 1994:450-454
[4]Dante C.Youlafellow,IEEE,Generalized Image Restoration by the Method of Alternation Orthogonal Projections[J].IEEE Transactions on circuits and systems,vol,CAS-25,No.9,September 1978:694-702
[5]Ibrahim Sezan M and Murat Tekalp A,Adaptive Image Restoration with Artifact Suppression Using the Theory of Convex Projections.IEEE.Transactions on acoustics,speech and signal.vol.38.No.1 January 1990:181-185
[6]Tekalp A M,Ozkan M K,Sezan M L.High-resolution image reconstruction for lower-resolution image restoration[A].Proceedings of the IEEE International Conference on Acousics,Speech and Signal Processing[C].San Francisco,CA,1992
[7]Ng M K,Bose N K.Mathematical analysis of super-resolution methodology[J].IEEE Signal Processing Magazine,2003(5):62-74
[8]Elad M,Feuer A Super-resolution restoration of image sequence:adaptive filtering approach[J].IEEE Trans IP,1989,8(3):387-395
[9]Nelson D.A.Mascarenhas and William K.Pratt,member,IEEE,Digital Image Restoration under a Regression Model.IEEE Transaction on circuits and systems,Vol,cas-22,No3,March 1975:252-266
[10]明文华,孔晓(?),梁栋.运动模糊图象的恢复方法研究.计算机工程.vol.30No.7,April 2004:133-135
[11]Wang Xiaohong,Zhao Rongchun.Restoration of motional-blurred Images.Hefei:In:SPIE Proc.Second International Conference on Image and Graphics,2002-08:413-421
[12]陈前荣,陆启生,成礼智.基于方向微分的运动模糊方向鉴别.中国图象图象学报.2005,10(5):590-595
[13]陈前荣,陆启生等.运动模糊图象点扩散函数尺度鉴别.计算机工程与应用.2004,23:15-19
[14]Alexander A.Sawchuk,member,IEEE.Space-Variant Motion degradation and Restoration.Proceedings of the IEEE,VOL.60,No,7,July 1972:854-861
[15]洪功义,姜昱明.基于图象配准的POCS超分辨率图象重构,计算机仿真,2004,21(6)145-147
[16]Nguyen.Numerical Algorithms for image Super-Resolution[D].Stanford University.2000
[17]H Anddrew,B Hunt.Digital image resolution[M].Prentice Hall,Englewood Cliffs,NJ,1997
[18]曹三省.光流场估计算法的优化分析.Natural Science Edition Journal of Beijing Broadcasting Institute,Vol.8,No.4(Dec 2001)23-29
[19]HORN B,SCHUNCK B.Determining optical flow[J].Artificial Intelligence,1981,17(4):185-203
[20]薛梅.复原和超分辨率复原算法及应用研究.东南大学硕士学位论文.2002
[21]Nhat Xuan Ngugen.Numerical algorithms for image super-resolution[M].PhD Thesis,Stanford University,2000.
[22]R.C.Hardie,K.j.Barnard,J.G.Bogar,E.E.Armstrong,and E.A.Watson," High Resolution Image Reconstruction from a Sequence of Rotated and Translated Frames and It's Application to an Infrared Imaging System",Optical Engineering,vol.73,no.l,pp247-26,Jan.1998.
[23]Schultz R,Stevenson R L.Extraction of high-resolution frames from video sequence [J].IEEE Trans IP,1996,5(6):996-1011
[24]张新明,沈兰荪.超分辨率复原技术的发展.测控技术.2002,21(5):33-35
[25]B.Vrcel,P.P.Vaidyanathan.Efficient implementation of all digital Interpolation.IEEE Trans.On Image Processing,2001,10(11):1639-1646
[26]N.Nguyen,P.Milanfar,G.Golub.A computationally efficient super-resolution image reconstruction algorithm.IEEE Trans.On Image Processing,2001,10(4):573-583
[27]王小红,陈秀万,潭仲军,赵光椿.一种有效的运动模糊图象恢复算法.计算机工程.2003,29(17):13
[28]陆俊,舒志龙,阮秋琦.基于尺度旋转的图象恢复研究.通信学报.2000,21(7)67-71
[29]XIANG Youjun,Guo Baolong.Fast block matching algorithms for motion estimation.Computer Engineering.Vol.29 No 13.August 2003:62-64
[30]汪孔桥,Jari.A.Kangas.数字图象的质量评价.测控技术.2000,19(5):14-16
[31]Irani M,Peleg S.Motion Analysis for Image Enhancement:Resolution,Occlusion and Image Resolution,1993;(12)
[32]张新明,沈兰荪.超分辨率复原技术的发展,测控技术,2002,21(5)
[33]Michael Elad and Arie Feuer,Senior Member,IEEE.Restoration of a single super-resolution image from several blurred,noisy and understand measured images.IEEE Transaction on image processing,Vol 6.No.12,December 1997:1646-1658
[34]孟昕,张燕平.运动模糊图象恢复的算法研究与分析,计算机技术与发展2007,17(8):73-76
[35]纪现才.视频图像超分辨率复原,北京工业大学硕士学位沦文,2003
[36]焦斌亮,赵文蕾.浅析互有位移图象序列的超分辨率复原,遥测遥控,2006,27(1)
[37]周芳.图象超分辨率复原技术的现状与展望,自动化与仪表,2006(1):10-14
[38]高守传,姚领田等编著.Visual C++实践与提高—数字图象处理与工程应用篇.北京:中国铁道出版社.2005
[39]赵文蕾.基于互有位移序列图象的超分辨率复原技术研究.燕山大学硕士学位论文,2006
[40]刘志军.图象超分辨率复原技术研究,华中科技大学硕士学位论文,2004
[41]J.K.Han,H.M.Kim.Modified cubic convolution scalier with minimum loss of information.Optical engineering,2001,40(4):540-546
[42]钟山等.图象静态超分辨率重建.红外与毫米波学报,2000,(2):153-156