空间相机像移探测方法的研究进展
|
摘要
以不同像移探测需求为导向,梳理了像移探测方法的发展脉络,将像移探测历程划分为基于工程参数的像移计算、基于联合相关器的像移估计和基于遥感图像的像移探测三个阶段;客观分析了每个阶段所解决的问题及面临的瓶颈;结合空间相机的发展趋势,剖析了目前像移探测方法中迫切需要解决的三个关键科学问题,为宽频带像移探测提供了一种可能的研究思路。
Taking different requirements for image motion detection as orientation,the development of image motion detection methods is traced,and the whole detection process of image motion is clarified as three stages:image motion calculation based on engineering parameters,image motion estimation based on joint optical correlators,and image motion detection based on remote sensing images.For each stage,the existing solved problems and the remaining technical bottlenecks are analyzed objectively.In combination with the development trend of space cameras,three pivotal scientific problems that need to be solved in the existing image motion detection methods are deeply analyzed.This study provides a possible research thought for wide-band image motion detection.
Taking different requirements for image motion detection as orientation,the development of image motion detection methods is traced,and the whole detection process of image motion is clarified as three stages:image motion calculation based on engineering parameters,image motion estimation based on joint optical correlators,and image motion detection based on remote sensing images.For each stage,the existing solved problems and the remaining technical bottlenecks are analyzed objectively.In combination with the development trend of space cameras,three pivotal scientific problems that need to be solved in the existing image motion detection methods are deeply analyzed.This study provides a possible research thought for wide-band image motion detection.
引文
[1] Ge Y J,Zhao J,Yang F.Survey on high resolution optical remote sensing satellite platform technology[J].International Space,2013(5):2-8.葛玉君,赵键,杨芳.高分辨率光学遥感卫星平台技术综述[J].国际太空,2013(5):2-8.
[2] 高分辨率对地观测[EB/OL].[2018-09-17].http:∥www.cheos.org.cn/.
[3] Wikipedia. GeoEye-1[EB/OL].[2018-09-17].https:∥en.wikipedia.org/wiki/GeoEye-1.
[4] Wikipedia.WorldView-4[EB/OL].[2018-09-17].https:∥en.wikipedia.org/wiki/GeoEye-2.
[5] Blanchet G,Lebeque L,Fourest S,et al.PleiadesHR innovative techniques for radiometric image quality commissioning[J].International Archives of the Photogrammerty,Remote Sensing and Spatial Information Sciences,2012(B1):513-518.
[6] Cheng P.Kompsat-3satellite[J].Geoinformatics,2014,33(4):487-496.
[7] Du Y M.Design and analysis of focusing mechanism in high resolution space camera[D].Changchun:Changchun Institute of Optics,Fine Mechanics and Physics,Chinese Academy of Sciences,2018:1-3.杜一民.高分辨率空间相机调焦机构设计与分析[D].长春:中国科学院长春光学精密机械与物理研究所,2018:1-3.
[8] Wang J Q,Yu P,Yan C X,et al.Space optical remote sensor image motion velocity vector computational modeling,error budget and synthesis[J].Chinese Optics Letters,2005,3(7):414-417.
[9] Janschek K,Tchernykh V,Dyblenko S.Integrated camera motion compensation by real-time image motion tracking and image deconvolution[C]∥Proceedings of 2005 IEEE/ASME International Conference on Advanced Intelligent Mechatronics,July 24-28,2005,Monterey,CA,USA.New York:IEEE,2005:1437-1444.
[10] Lu P L,Li Y C,Jin L X,et al.Image motion velocity field model of space camera with large field and analysis on three-axis attitude stability of satellite[J].Optics and Precision Engineering,2016,24(9):2173-2182.路朋罗,李永昌,金龙旭,等.大视场空间相机的像移速度场模型及卫星三轴姿态稳定度分析[J].光学精密工程,2016,24(9):2173-2182.
[11] Toyoshima M.In-orbit measurements of spacecraft microvibrations for satellite laser communication links[J].Optical Engineering,2010,49(8):083604.
[12] Park G,Lee D O,Han J H.Development of multidegree-of-freedom microvibration emulator for efficient jitter test of spacecraft[J].Journal of Intelligent Material Systems and Structures,2014,25(9):1069-1081.
[13] Prashant A R,Madheswaran M,Kartik V,et al.System development for micro vibration measurements on spacecrafts[C]∥International Conference on Control, Instrumentation,Communication and Computational Technologies(ICCICCT),December 16-17,2016,Kumaracoil,India.New York:IEEE,2016:98-103.
[14] He S,Xu Z,Wang X,et al.Design and testing of a parallel manipulator for space micro-vibration simulation[C]∥Conference Towards Autonomous Robotic Systems.Cham:Springer,2017:86-100.
[15] Liu H Q,Xu S Y,Wang D.Space camera image motion measurement based on images from time delayed integration sensors overlapped area[J].Acta Optica Sinica,2014,34(2):0212001.刘海秋,徐抒岩,王栋.基于空间相机时间延迟积分传感器拼接区图像的像移测量[J].光学学报,2014,34(2):0212001.
[15] Liu H Q,Xu S Y,Wang D,et al.Space camera image motion measurement based on images from time delayed integration sensors overlapped area[J].Acta Optica Sinica,2014,34(2):0212001.刘海秋,徐抒岩,王栋,等.基于空间相机时间延迟积分传感器拼接区图像的像移测量[J].光学学报,2014,34(2):0212001.
[16] Liu H Q.High resolution space camera image motion measurement based on images from TDICCD overlapping area[D]. Changchun:Changchun Institute of Optics,Fine Mechanics and Physics,Chinese Academy of Sciences,2015:2-3.刘海秋.基于TDICCD拼接区图像的高分相机像移测量研究[D].长春:中国科学院长春光学精密机械与物理研究所,2015:2-3.
[17] Janschek K,Tchernykh V,Dyblenko S.Performance analysis of opto-mechatronic image stabilization for a compact space camera[J]. Control Engineering Practice,2007,15(3):333-347.
[18] Miller B M, Rubinovich E Y. Image motion compensation at charge-coupled device photographing in delay-integration mode[J]. Automation and Remote Control,2007,68(3):564-571.
[19] Wang J Q,Yu P,Yan C X.Space optical remote sensor image motion velocity vector computational modeling[J].Acta Optica Sinica,2005,24(12):1585-1589.王家骐,于平,颜昌翔.航天光学遥感器像移速度矢计算数学模型[J].光学学报,2005,24(12):1585-1589.
[20] Yan D J,Li W X,Wu W P,et al.Aircraft′s large attitude angles′usage in image motion compensation calculation of space camera[J].Infrared and Laser Engineering,2014,43(4):1200-1205.闫得杰,李伟雄,吴伟平,等.空间相机像移补偿计算中飞行器大姿态角使用方法[J].红外与激光工程,2014,43(4):1200-1205.
[21] Wang Y Q,Yan C X.Foundation and computation realization of space-borne hyperspectral imager′s motion compensation math model[J]. Laser &Optoelectronics Progress,2014,51(12):121103.汪逸群,颜昌翔.星载成像光谱仪运动补偿数学模型的建立与计算实现[J].激光与光电子学进展,2014,51(12):121103.
[22] Sabelhaus P,Bolek J,Scott S,et al.On-orbit ACDS performance of the Landsat 7 spacecraft[J].American Astronautical Society,2001:AAS 01-007.
[23] Mattson S,Bartels A,Boyd A.Continuing analysis of spacecraft jitter in LROC-NAC[J].American Naturalist,2011,152(3):321-337.
[24] Teshima Y,Iwasaki A. Correction of attitude fluctuation of terra spacecraft using ASTER/SWIR imagery with parallax observation[J]. IEEE Transactions on Geoscience and Remote Sensing,2008,46(1):222-227.
[25] Liu S J,Tong X H,Wang F X,et al.Attitude jitter detection based on remotely sensed images and dense ground controls:A case study for Chinese ZY-3satellite[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2016,9(12):5760-5766.
[26] Jiang Y H,Zhang G,Tang X M,et al.Detection and correction of relative attitude errors for ZY1-02C[J].IEEE Transactions on Geoscience and Remote Sensing,2014,52(12):7674-7683.
[27] Cheng P Q.Digital signal processing tutorial[M].Beijing:Tsinghua University Press,1998:75-83.程佩青.数字信号处理教程[M].北京:清华大学出版社,1998:75-83.
[28] Tchernykh V, Beck M, Janschek K. Optical correlator based optical flow processor for real time visual navigation[M]∥Obinata G,Dutta A Vision Systems:Application. Rijeka, Croatia:In Tech Education and Publishing,2007.
[29] Dai C Y,Ge P,Li Q,et al.Image displacement measurement using double phase-encoding joint transform correlator[J].Acta Optica Sinica,2011,31(7):0712004.戴朝约,葛鹏,李奇,等.基于双相位编码联合变换相关器的图像位移探测算法[J].光学学报,2011,31(7):0712004.
[30] Fan C,Li Y C,Jin T,et al.Noise immunity research on the measurement method of image motion of the space camera based on optical correlator[J].Journal of Astronautics,2011,32(12):2635-2641.樊超,李英才,靳婷,等.联合变换相关法测量空间相机像移的抗噪性研究[J].宇航学报,2011,32(12):2635-2641.
[31] Tao S P.Research on the TDI technology in the digital domain for CMOS space cameras[D].Changchun:Changchun Institute of Optics,Fine Mechanics and Physics, Chinese Academy of Sciences,2013:1-2.陶淑苹.航天CMOS相机数字域TDI技术研究[D].长春:中国科学院长春光学精密机械与物理研究所,2013:1-2.
[32] Mcewen A,Banks M,Baugh N,et al.The high resolution imaging science experiment(HiRISE)during MRO′s primary science phase(PSP)[J].Icarus,2010,205(1):2-37.
[33] Bely P Y,Lupie O L,Hershey J L.Line-of-sight jitter of the Hubblespace telescope[J].Proceedings of SPIE,1993,1945:55-61.
[34] Mattson S,Boyd A,Kirk R L.HiJACK:Correcting spacecraft jitter in HiRISE images of Mars[J].Health Management Technology,2009,33(5):A162.
[35] Tong X H,Ye Z,Liu S J.Essential technology and application of jitter detection and compensation for high resolution satellites[J].Acta Geodaetica et Cartographica Sinica,2017,46(10):1500-1508.童小华,叶真,刘世杰.高分辨率卫星颤振探测补偿的关键技术方法与应用[J].测绘学报,2017,46(10):1500-1508.
[36] Wang M,Fan C,Pan J,et al.Image jitter detection and compensation using a high-frequency angular displacement method for Yaogan-26remote sensing satellite[J].ISPRS Journal of Photogrammetry &Remote Sensing,2017,130:32-43.
[37] Tong X H, Xu Y S, Ye Z,et al. Attitude oscillation detection of the ZY-3satellite by using multispectral parallax images[J]. IEEE Transactions on Geoscience and Remote Sensing,2015,53(6):3522-3534.
[38] Liu H Q,Wang D,Yan D J,et al.Study on blind band elimination in jitter estimation[J].Chinese Optics Letters,2014,12(10):101203.
[39] Liu H Q,Yan D J,Wang D.Space camera image motion model analysis caused by spacecraft vibration[J].Acta Optica Sinica,2014,34(6):0612001.刘海秋,闫得杰,王栋.飞船振动引起的空间相机像移模型分析[J].光学学报,2014,34(6):0612001.
[40] Liu H Q,Wang D,Xu S Y.Research on multiplicity of solution in space camera image motion measurement based on images from TDI sensor overlapped area[J].Acta Optica Sinica,2014,34(12):1212002.刘海秋,王栋,徐抒岩.基于空间相机TDI传感器重叠区图像的像移测量方法中的多解性研究[J].光学学报,2014,34(12):1212002.
[41] Li W X. Research on method of image motion compensation of space high resolution cameras′collecting scene agilely[D].Changchun:Changchun Institute of Optics,Fine Mechanics and Physics,Chinese Academy of Sciences,2012:33-55.李伟雄.高分辨率空间相机敏捷成像的像移补偿方法研究[D].长春:中国科学院长春光学精密机械与物理研究所,2012:33-55.
[2] 高分辨率对地观测[EB/OL].[2018-09-17].http:∥www.cheos.org.cn/.
[3] Wikipedia. GeoEye-1[EB/OL].[2018-09-17].https:∥en.wikipedia.org/wiki/GeoEye-1.
[4] Wikipedia.WorldView-4[EB/OL].[2018-09-17].https:∥en.wikipedia.org/wiki/GeoEye-2.
[5] Blanchet G,Lebeque L,Fourest S,et al.PleiadesHR innovative techniques for radiometric image quality commissioning[J].International Archives of the Photogrammerty,Remote Sensing and Spatial Information Sciences,2012(B1):513-518.
[6] Cheng P.Kompsat-3satellite[J].Geoinformatics,2014,33(4):487-496.
[7] Du Y M.Design and analysis of focusing mechanism in high resolution space camera[D].Changchun:Changchun Institute of Optics,Fine Mechanics and Physics,Chinese Academy of Sciences,2018:1-3.杜一民.高分辨率空间相机调焦机构设计与分析[D].长春:中国科学院长春光学精密机械与物理研究所,2018:1-3.
[8] Wang J Q,Yu P,Yan C X,et al.Space optical remote sensor image motion velocity vector computational modeling,error budget and synthesis[J].Chinese Optics Letters,2005,3(7):414-417.
[9] Janschek K,Tchernykh V,Dyblenko S.Integrated camera motion compensation by real-time image motion tracking and image deconvolution[C]∥Proceedings of 2005 IEEE/ASME International Conference on Advanced Intelligent Mechatronics,July 24-28,2005,Monterey,CA,USA.New York:IEEE,2005:1437-1444.
[10] Lu P L,Li Y C,Jin L X,et al.Image motion velocity field model of space camera with large field and analysis on three-axis attitude stability of satellite[J].Optics and Precision Engineering,2016,24(9):2173-2182.路朋罗,李永昌,金龙旭,等.大视场空间相机的像移速度场模型及卫星三轴姿态稳定度分析[J].光学精密工程,2016,24(9):2173-2182.
[11] Toyoshima M.In-orbit measurements of spacecraft microvibrations for satellite laser communication links[J].Optical Engineering,2010,49(8):083604.
[12] Park G,Lee D O,Han J H.Development of multidegree-of-freedom microvibration emulator for efficient jitter test of spacecraft[J].Journal of Intelligent Material Systems and Structures,2014,25(9):1069-1081.
[13] Prashant A R,Madheswaran M,Kartik V,et al.System development for micro vibration measurements on spacecrafts[C]∥International Conference on Control, Instrumentation,Communication and Computational Technologies(ICCICCT),December 16-17,2016,Kumaracoil,India.New York:IEEE,2016:98-103.
[14] He S,Xu Z,Wang X,et al.Design and testing of a parallel manipulator for space micro-vibration simulation[C]∥Conference Towards Autonomous Robotic Systems.Cham:Springer,2017:86-100.
[15] Liu H Q,Xu S Y,Wang D.Space camera image motion measurement based on images from time delayed integration sensors overlapped area[J].Acta Optica Sinica,2014,34(2):0212001.刘海秋,徐抒岩,王栋.基于空间相机时间延迟积分传感器拼接区图像的像移测量[J].光学学报,2014,34(2):0212001.
[15] Liu H Q,Xu S Y,Wang D,et al.Space camera image motion measurement based on images from time delayed integration sensors overlapped area[J].Acta Optica Sinica,2014,34(2):0212001.刘海秋,徐抒岩,王栋,等.基于空间相机时间延迟积分传感器拼接区图像的像移测量[J].光学学报,2014,34(2):0212001.
[16] Liu H Q.High resolution space camera image motion measurement based on images from TDICCD overlapping area[D]. Changchun:Changchun Institute of Optics,Fine Mechanics and Physics,Chinese Academy of Sciences,2015:2-3.刘海秋.基于TDICCD拼接区图像的高分相机像移测量研究[D].长春:中国科学院长春光学精密机械与物理研究所,2015:2-3.
[17] Janschek K,Tchernykh V,Dyblenko S.Performance analysis of opto-mechatronic image stabilization for a compact space camera[J]. Control Engineering Practice,2007,15(3):333-347.
[18] Miller B M, Rubinovich E Y. Image motion compensation at charge-coupled device photographing in delay-integration mode[J]. Automation and Remote Control,2007,68(3):564-571.
[19] Wang J Q,Yu P,Yan C X.Space optical remote sensor image motion velocity vector computational modeling[J].Acta Optica Sinica,2005,24(12):1585-1589.王家骐,于平,颜昌翔.航天光学遥感器像移速度矢计算数学模型[J].光学学报,2005,24(12):1585-1589.
[20] Yan D J,Li W X,Wu W P,et al.Aircraft′s large attitude angles′usage in image motion compensation calculation of space camera[J].Infrared and Laser Engineering,2014,43(4):1200-1205.闫得杰,李伟雄,吴伟平,等.空间相机像移补偿计算中飞行器大姿态角使用方法[J].红外与激光工程,2014,43(4):1200-1205.
[21] Wang Y Q,Yan C X.Foundation and computation realization of space-borne hyperspectral imager′s motion compensation math model[J]. Laser &Optoelectronics Progress,2014,51(12):121103.汪逸群,颜昌翔.星载成像光谱仪运动补偿数学模型的建立与计算实现[J].激光与光电子学进展,2014,51(12):121103.
[22] Sabelhaus P,Bolek J,Scott S,et al.On-orbit ACDS performance of the Landsat 7 spacecraft[J].American Astronautical Society,2001:AAS 01-007.
[23] Mattson S,Bartels A,Boyd A.Continuing analysis of spacecraft jitter in LROC-NAC[J].American Naturalist,2011,152(3):321-337.
[24] Teshima Y,Iwasaki A. Correction of attitude fluctuation of terra spacecraft using ASTER/SWIR imagery with parallax observation[J]. IEEE Transactions on Geoscience and Remote Sensing,2008,46(1):222-227.
[25] Liu S J,Tong X H,Wang F X,et al.Attitude jitter detection based on remotely sensed images and dense ground controls:A case study for Chinese ZY-3satellite[J].IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing,2016,9(12):5760-5766.
[26] Jiang Y H,Zhang G,Tang X M,et al.Detection and correction of relative attitude errors for ZY1-02C[J].IEEE Transactions on Geoscience and Remote Sensing,2014,52(12):7674-7683.
[27] Cheng P Q.Digital signal processing tutorial[M].Beijing:Tsinghua University Press,1998:75-83.程佩青.数字信号处理教程[M].北京:清华大学出版社,1998:75-83.
[28] Tchernykh V, Beck M, Janschek K. Optical correlator based optical flow processor for real time visual navigation[M]∥Obinata G,Dutta A Vision Systems:Application. Rijeka, Croatia:In Tech Education and Publishing,2007.
[29] Dai C Y,Ge P,Li Q,et al.Image displacement measurement using double phase-encoding joint transform correlator[J].Acta Optica Sinica,2011,31(7):0712004.戴朝约,葛鹏,李奇,等.基于双相位编码联合变换相关器的图像位移探测算法[J].光学学报,2011,31(7):0712004.
[30] Fan C,Li Y C,Jin T,et al.Noise immunity research on the measurement method of image motion of the space camera based on optical correlator[J].Journal of Astronautics,2011,32(12):2635-2641.樊超,李英才,靳婷,等.联合变换相关法测量空间相机像移的抗噪性研究[J].宇航学报,2011,32(12):2635-2641.
[31] Tao S P.Research on the TDI technology in the digital domain for CMOS space cameras[D].Changchun:Changchun Institute of Optics,Fine Mechanics and Physics, Chinese Academy of Sciences,2013:1-2.陶淑苹.航天CMOS相机数字域TDI技术研究[D].长春:中国科学院长春光学精密机械与物理研究所,2013:1-2.
[32] Mcewen A,Banks M,Baugh N,et al.The high resolution imaging science experiment(HiRISE)during MRO′s primary science phase(PSP)[J].Icarus,2010,205(1):2-37.
[33] Bely P Y,Lupie O L,Hershey J L.Line-of-sight jitter of the Hubblespace telescope[J].Proceedings of SPIE,1993,1945:55-61.
[34] Mattson S,Boyd A,Kirk R L.HiJACK:Correcting spacecraft jitter in HiRISE images of Mars[J].Health Management Technology,2009,33(5):A162.
[35] Tong X H,Ye Z,Liu S J.Essential technology and application of jitter detection and compensation for high resolution satellites[J].Acta Geodaetica et Cartographica Sinica,2017,46(10):1500-1508.童小华,叶真,刘世杰.高分辨率卫星颤振探测补偿的关键技术方法与应用[J].测绘学报,2017,46(10):1500-1508.
[36] Wang M,Fan C,Pan J,et al.Image jitter detection and compensation using a high-frequency angular displacement method for Yaogan-26remote sensing satellite[J].ISPRS Journal of Photogrammetry &Remote Sensing,2017,130:32-43.
[37] Tong X H, Xu Y S, Ye Z,et al. Attitude oscillation detection of the ZY-3satellite by using multispectral parallax images[J]. IEEE Transactions on Geoscience and Remote Sensing,2015,53(6):3522-3534.
[38] Liu H Q,Wang D,Yan D J,et al.Study on blind band elimination in jitter estimation[J].Chinese Optics Letters,2014,12(10):101203.
[39] Liu H Q,Yan D J,Wang D.Space camera image motion model analysis caused by spacecraft vibration[J].Acta Optica Sinica,2014,34(6):0612001.刘海秋,闫得杰,王栋.飞船振动引起的空间相机像移模型分析[J].光学学报,2014,34(6):0612001.
[40] Liu H Q,Wang D,Xu S Y.Research on multiplicity of solution in space camera image motion measurement based on images from TDI sensor overlapped area[J].Acta Optica Sinica,2014,34(12):1212002.刘海秋,王栋,徐抒岩.基于空间相机TDI传感器重叠区图像的像移测量方法中的多解性研究[J].光学学报,2014,34(12):1212002.
[41] Li W X. Research on method of image motion compensation of space high resolution cameras′collecting scene agilely[D].Changchun:Changchun Institute of Optics,Fine Mechanics and Physics,Chinese Academy of Sciences,2012:33-55.李伟雄.高分辨率空间相机敏捷成像的像移补偿方法研究[D].长春:中国科学院长春光学精密机械与物理研究所,2012:33-55.