空间遥感相机星上图像复原系统设计
|
摘要
为了能够在轨、实时对空间遥感图像做增强处理,设计了一个基于现场可编程门阵列(FPGA),应用于空间遥感相机的星上实时图像复原系统,实现在轨实时处理遥感图像,增强图像清晰度并有效抑制噪声。图像复原系统采用模块化设计,调制传递函数(MTF)在轨测量计算模块实现了边缘扩展函数计算、线扩展函数计算、归一化MTF计算,以及调制传递函数补偿(MTFC)参数计算与存储等功能;MTFC图像滤波抑噪算法模块实现了二维图像实时滤波以及抑制噪声功能。使用ISE软件的系统生成器模块设计了图像处理算法,简化了系统设计和验证流程。复原系统运行结果表明,图像经过实时复原处理后,图像灰度梯度、点锐度、边缘能量、方差都有大幅提高;复原后图像信噪比与原始图像相比降低很小,对于MTF的中高频域增强。图像复原系统采用模块化设计,实时复原效果好,可灵活应用于多种场合。
In order to process space remote sensing images on orbit in real time, a real-time digital image restoration system for space camera was designed based on field programmable gate array(FPGA) in the paper, which can enhance image definition and suppress the noise effectively. Modular design was adopted in the system. The modulation transfer function(MTF) measurement and calculation module on-orbit has the function of calculating many characteristics, such as the edge spread function(ESF), line spread function(LSF), ESF difference operation, normalization MTF and MTFC parameters. The modulation transfer function(MTFC) image filtering and noise suppression module has the function of filtering and effectively suppressing the noise. The system generator software in ISE was used to design the image processing algorithms, thus simplifying the design structure of system and the process redesign. The real-time processing results of the restoration system showed that the gray gradient, dot sharpness, edge energy and variance all had a huge increase after restoration process, the signal to noise ratio(SNR) of the recovered image was very close to the SNR of original image. Especially the SNR was dramatically enhanced at medium-high frequency of image. The designed image restoration system can be widely used in various fields with better restoration effect.
In order to process space remote sensing images on orbit in real time, a real-time digital image restoration system for space camera was designed based on field programmable gate array(FPGA) in the paper, which can enhance image definition and suppress the noise effectively. Modular design was adopted in the system. The modulation transfer function(MTF) measurement and calculation module on-orbit has the function of calculating many characteristics, such as the edge spread function(ESF), line spread function(LSF), ESF difference operation, normalization MTF and MTFC parameters. The modulation transfer function(MTFC) image filtering and noise suppression module has the function of filtering and effectively suppressing the noise. The system generator software in ISE was used to design the image processing algorithms, thus simplifying the design structure of system and the process redesign. The real-time processing results of the restoration system showed that the gray gradient, dot sharpness, edge energy and variance all had a huge increase after restoration process, the signal to noise ratio(SNR) of the recovered image was very close to the SNR of original image. Especially the SNR was dramatically enhanced at medium-high frequency of image. The designed image restoration system can be widely used in various fields with better restoration effect.
引文
[1]CHOI T.IKONOS Satelfite on Orbit Modulation Transfer Function(MTF)Measurement Using Edge and Pulse Method[Z].A Thesis Submitted in Partial Fulfillment of the Requirements for the Master of Science Major in Engineering South Dakota State University,2002.
[2]KOHM K.Modulation Tansfer Function Measurement Method and Results for the Orbview-3 High Resultion Imaging Satellite[C].Proceedings of ISPRS 2004.Istanbul,Turkey,Julyl 2-23,2004.
[3]顾行发,李小英,闵祥军,等.CBERS-02卫星CCD相机MTF在轨测量及图像MTF补偿[J].中国科学E辑信息科学,2005,35(增刊):26-40.GU Xingfa,LI Xiaoying,MIN Xiangjun,et al.CBERS-02 Satellite CCD Camera MTF On-Orbit Measurement and MTF Compensation[J].Science in China Ser.E Information Sciences,2005,35(suppl):26-40.(in Chinese)
[4]DU H,VOSS K J.Effects of Point-spread Function on Calibration and Radiometric Accuracy of CCD Camera[J].Applied Optics,2004,43(3):665-670.
[5]孟伟,金龙旭,李国宁,等.调制传递函数在遥感图像复原中的应用[J].红外与激光工程,2014,43(5):1690-1696.MENG wei,JIN Longxu,LI Guoning,et al.Application of MTF in Remote Sensing Image Restoration[J].Infrared and Laser Engineering,2014,43(5):1690-1696.(in Chinese)
[6]吴昀昭,宫鹏.“北京一号”小卫星MTF在轨测量与图像复原[J].遥感应用,2007,40(4):49-53.WU Junzhao,GONG peng.On-orbit MTF Estimation and Restoration of Beijing-1 Images[J].Remote Sensing Application,2007,40(4):49-53.(in Chinese)
[7]SCHOWENGERDT R A,ARCHWAMCTY C,WRIGLEY R C.Landsat Thematic Mapper Image-derived MTF[J].Photogrammetric Engineering and Remote Sensing,1985,51(9):1395-1406.
[8]RUIZ C P.LOPEZ F J A.Restoring SPOT Images Using PSF-derived Deconvolution Filters[J].International Journal of Remote Sensing,2002,23(12):2379-2391.
[9]汪畅,顾行发,余涛,等.资源三号卫星在轨MTF测量与图像复原[J].计算机工程,2014,40(4):237-246.WANG Chang,GU Xingfa,YU Tao,et al.On-orbit MTF Measurement and Image Restoration for ZY-3 Satellite[J].Computer Engineering,2014,40(4):237-246.(in Chinese)
[10]周楠,齐文雯,曹世翔,等.基于空域的自适应MTFC遥感图像复原算法[J].航天返回与遥感,2015,36(4):104-109.(in Chinese)ZHOU Nan,QI Wenwen,CAO Shixiang,et al.Adaptive MTFC Restoration Algorathm of Remote Sensing Images Based on Spatial Domain[J].Spacecraft Recovery&Remote Sensing,2015,36(4):104-109.(in Chinese)
[11]张朋,刘团结,王宏琦.线阵CCD相机MTF的系统模型估计法与图像复原[J].光学技术,2009,35(3):394-398.ZHANG Peng,LIU Tuanjie,WANG Hongqi.MTF Estimation Based on System Model for Linear CCD Camera and Image Recovery[J].Optical,Technique,2009,35(3):394-398.(in Chinese)
[12]柴雅琼,冯钟葵,齐东楷,等.改进的MTF遥感影像复原算法研究[J].遥感应用,2012(1):78-83.CHAI Yaqiong,FENG Zhongkui,QI Dongkai,et al.An Improved MTFC Restoration Algorithm for Remote Sensing Image[J].Remote Sensing Application,2012(1):78-83.(in Chinese)
[13]贺小军,金光,杨秀彬,等.星载相机轨道末期成像模型及图像复原算法[J].测绘学报,2010,39(6):579-584.HE Xiaojun,JIN Guang,YANG Xiubin,et al.Imageing Model and Image Recovering Algorithms of Spaceborne Camera In the End of Orbit Life[J].Acta Geodaetica et Cartographica Sinica,2010,39(6):579-584.(in Chinese)
[14]谢冰,焦斌亮.基于航天TDICCD相机像移分析的PSF估计及图像复原算法研究[J].宇航学报,2010,31(3):936-940.XIE Bing,JIAO Binliang.The PSF Estimation Method and Image Restoration Algorithm Based on Image-Motion Analysis of Spaceborne TDICCD Camera[J].Journal of Astronautics,2010,31(3):936-940.(in Chinese)
[15]陈奋,赵忠明.遥感影像反卷积复原处理[J].数据采集与处理,2008,23(2):168-175.CHEN Fen,ZHAO Zhongming.Deconvolution of Remote Sensing Images[J].Journal of Data Acquisition and Processing,2008,23(2):168-175.(in Chinese)
[16]智喜洋,张伟,侯晴宇,等.基于空不变图像复原的光学遥感成像系统优化[J].光学精密工程,2013,23(5):1490-1497.ZHI Xiyang,ZHANG Wei,HOU Qingyu,et al.Optimization for Optical Remote Sensing Imaging System Based on Space-invariant Image Restoration[J].Optics and Precision Engineering,2013,23(5):1490-1497.(in Chinese)
[17]洪汉玉,张天序.基于多分辨率盲目去卷积的气动光学效应退化图像复原算法[J].计算机学报,2004,27(7):952-962.HONG Hanyu,ZHANG Tianxu.Investigation of Restoration Algorithm for Degraded Imaged Caused by Aero-optics Effects Using Multi-resolution Blind Deconvolution[J].Chinese Journal of Computers,2004,27(7):952-962.(in Chinese)
[18]李盛阳,朱重光.DMC卫星图像MTF分析及其复原方法研究[J].遥感学报,2005,9(4):475-479.LI Shengyang,ZHU Chongguang.DMC Satellite Image MTF Analysis and Restoration Method Research[J].Journal of Remote Sensing,2005,9(4):475-479.(in Chinese)
[19]陈强,戴奇燕,夏德深.基于MTF理论的遥感图像复原[J].中国图象图形学报,2005,11(9):1299-1305.CHEN Qiang,DAI Jiyan,XIA Deshen.Restoration of Remote Sensing Images Based on MTF Theory[J].Journal of Image and Graphics,2005,11(9):1299-1305.(in Chinese)
[20]王先华,乔延利,洪津.遥感图像恢复与遥感器MTF在轨检测技术[J].遥感技术与应用,2006,21(5):440-444.WANG Xianhua,QIAO Yanli,HONG Jin.A Technique of RS Image Restoration and In-flight Measurement of Remote Sensor MTF[J].Remote Sensing Technology and Application,2006,21(5):440-444.(in Chinese)
[2]KOHM K.Modulation Tansfer Function Measurement Method and Results for the Orbview-3 High Resultion Imaging Satellite[C].Proceedings of ISPRS 2004.Istanbul,Turkey,Julyl 2-23,2004.
[3]顾行发,李小英,闵祥军,等.CBERS-02卫星CCD相机MTF在轨测量及图像MTF补偿[J].中国科学E辑信息科学,2005,35(增刊):26-40.GU Xingfa,LI Xiaoying,MIN Xiangjun,et al.CBERS-02 Satellite CCD Camera MTF On-Orbit Measurement and MTF Compensation[J].Science in China Ser.E Information Sciences,2005,35(suppl):26-40.(in Chinese)
[4]DU H,VOSS K J.Effects of Point-spread Function on Calibration and Radiometric Accuracy of CCD Camera[J].Applied Optics,2004,43(3):665-670.
[5]孟伟,金龙旭,李国宁,等.调制传递函数在遥感图像复原中的应用[J].红外与激光工程,2014,43(5):1690-1696.MENG wei,JIN Longxu,LI Guoning,et al.Application of MTF in Remote Sensing Image Restoration[J].Infrared and Laser Engineering,2014,43(5):1690-1696.(in Chinese)
[6]吴昀昭,宫鹏.“北京一号”小卫星MTF在轨测量与图像复原[J].遥感应用,2007,40(4):49-53.WU Junzhao,GONG peng.On-orbit MTF Estimation and Restoration of Beijing-1 Images[J].Remote Sensing Application,2007,40(4):49-53.(in Chinese)
[7]SCHOWENGERDT R A,ARCHWAMCTY C,WRIGLEY R C.Landsat Thematic Mapper Image-derived MTF[J].Photogrammetric Engineering and Remote Sensing,1985,51(9):1395-1406.
[8]RUIZ C P.LOPEZ F J A.Restoring SPOT Images Using PSF-derived Deconvolution Filters[J].International Journal of Remote Sensing,2002,23(12):2379-2391.
[9]汪畅,顾行发,余涛,等.资源三号卫星在轨MTF测量与图像复原[J].计算机工程,2014,40(4):237-246.WANG Chang,GU Xingfa,YU Tao,et al.On-orbit MTF Measurement and Image Restoration for ZY-3 Satellite[J].Computer Engineering,2014,40(4):237-246.(in Chinese)
[10]周楠,齐文雯,曹世翔,等.基于空域的自适应MTFC遥感图像复原算法[J].航天返回与遥感,2015,36(4):104-109.(in Chinese)ZHOU Nan,QI Wenwen,CAO Shixiang,et al.Adaptive MTFC Restoration Algorathm of Remote Sensing Images Based on Spatial Domain[J].Spacecraft Recovery&Remote Sensing,2015,36(4):104-109.(in Chinese)
[11]张朋,刘团结,王宏琦.线阵CCD相机MTF的系统模型估计法与图像复原[J].光学技术,2009,35(3):394-398.ZHANG Peng,LIU Tuanjie,WANG Hongqi.MTF Estimation Based on System Model for Linear CCD Camera and Image Recovery[J].Optical,Technique,2009,35(3):394-398.(in Chinese)
[12]柴雅琼,冯钟葵,齐东楷,等.改进的MTF遥感影像复原算法研究[J].遥感应用,2012(1):78-83.CHAI Yaqiong,FENG Zhongkui,QI Dongkai,et al.An Improved MTFC Restoration Algorithm for Remote Sensing Image[J].Remote Sensing Application,2012(1):78-83.(in Chinese)
[13]贺小军,金光,杨秀彬,等.星载相机轨道末期成像模型及图像复原算法[J].测绘学报,2010,39(6):579-584.HE Xiaojun,JIN Guang,YANG Xiubin,et al.Imageing Model and Image Recovering Algorithms of Spaceborne Camera In the End of Orbit Life[J].Acta Geodaetica et Cartographica Sinica,2010,39(6):579-584.(in Chinese)
[14]谢冰,焦斌亮.基于航天TDICCD相机像移分析的PSF估计及图像复原算法研究[J].宇航学报,2010,31(3):936-940.XIE Bing,JIAO Binliang.The PSF Estimation Method and Image Restoration Algorithm Based on Image-Motion Analysis of Spaceborne TDICCD Camera[J].Journal of Astronautics,2010,31(3):936-940.(in Chinese)
[15]陈奋,赵忠明.遥感影像反卷积复原处理[J].数据采集与处理,2008,23(2):168-175.CHEN Fen,ZHAO Zhongming.Deconvolution of Remote Sensing Images[J].Journal of Data Acquisition and Processing,2008,23(2):168-175.(in Chinese)
[16]智喜洋,张伟,侯晴宇,等.基于空不变图像复原的光学遥感成像系统优化[J].光学精密工程,2013,23(5):1490-1497.ZHI Xiyang,ZHANG Wei,HOU Qingyu,et al.Optimization for Optical Remote Sensing Imaging System Based on Space-invariant Image Restoration[J].Optics and Precision Engineering,2013,23(5):1490-1497.(in Chinese)
[17]洪汉玉,张天序.基于多分辨率盲目去卷积的气动光学效应退化图像复原算法[J].计算机学报,2004,27(7):952-962.HONG Hanyu,ZHANG Tianxu.Investigation of Restoration Algorithm for Degraded Imaged Caused by Aero-optics Effects Using Multi-resolution Blind Deconvolution[J].Chinese Journal of Computers,2004,27(7):952-962.(in Chinese)
[18]李盛阳,朱重光.DMC卫星图像MTF分析及其复原方法研究[J].遥感学报,2005,9(4):475-479.LI Shengyang,ZHU Chongguang.DMC Satellite Image MTF Analysis and Restoration Method Research[J].Journal of Remote Sensing,2005,9(4):475-479.(in Chinese)
[19]陈强,戴奇燕,夏德深.基于MTF理论的遥感图像复原[J].中国图象图形学报,2005,11(9):1299-1305.CHEN Qiang,DAI Jiyan,XIA Deshen.Restoration of Remote Sensing Images Based on MTF Theory[J].Journal of Image and Graphics,2005,11(9):1299-1305.(in Chinese)
[20]王先华,乔延利,洪津.遥感图像恢复与遥感器MTF在轨检测技术[J].遥感技术与应用,2006,21(5):440-444.WANG Xianhua,QIAO Yanli,HONG Jin.A Technique of RS Image Restoration and In-flight Measurement of Remote Sensor MTF[J].Remote Sensing Technology and Application,2006,21(5):440-444.(in Chinese)