无序高空间分辨率影像快速拼接方法
|
摘要
遥感影像拼接技术作为影像成图的重要手段,一直是遥感领域研究的热点。在保证拼接精度的同时,如何提高拼接效率,成为低空遥感技术应急应用的难点。针对低空航空遥感影像成像姿态变化剧烈、数据量大等特点,提出针对无序影像改进的基于稀疏矩阵的光束平差SURF拼接算法,即对无序影像进行特征选取和匹配,自行判断相邻和相间位置信息,配准平差中引入稀疏矩阵进行加速。方法在保证精度的同时,极大提高了航空相机影像拼接算法的速度,能很好地解决无人机影像高建筑物的拼接错位问题。无人机倾斜数据集拼接和航空相机影像拼接的结果验证了利用本算法进行高空间分辨率影像拼接的精度和效率。
Remote sensing image mosaic technology,an important means of image mapping,has been the focus of remote sensing research over years.In order to ensure the stitching precision,finding proper methods to accelerate mosaicking efficiency is one of the great challenges in the emergence application with low altitude remote sensing.For the low-altitude aerial remote sensing imagery,the attitude changes drastically,the data volume is large,and so on.An improved SURF splicing algorithm is proposed based on sparse matrix for the disordered image,which selects and matches the disordered image and judges its neighbors by itself.With the interposition position information,the sparse matrix is used to accelerate the registration adjustment.This method can greatly improve the speed of the aerial camera image mosaic algorithm while ensuring the accuracy,and can well solve the problem of the mosaic misplacement of the high-rise buildings of the drone image.The proposed algorithm is then verified by UAV tilt photography image dataset and aerial image dataset,and the mosaicking results demonstrate the merits of our method.
Remote sensing image mosaic technology,an important means of image mapping,has been the focus of remote sensing research over years.In order to ensure the stitching precision,finding proper methods to accelerate mosaicking efficiency is one of the great challenges in the emergence application with low altitude remote sensing.For the low-altitude aerial remote sensing imagery,the attitude changes drastically,the data volume is large,and so on.An improved SURF splicing algorithm is proposed based on sparse matrix for the disordered image,which selects and matches the disordered image and judges its neighbors by itself.With the interposition position information,the sparse matrix is used to accelerate the registration adjustment.This method can greatly improve the speed of the aerial camera image mosaic algorithm while ensuring the accuracy,and can well solve the problem of the mosaic misplacement of the high-rise buildings of the drone image.The proposed algorithm is then verified by UAV tilt photography image dataset and aerial image dataset,and the mosaicking results demonstrate the merits of our method.
引文
[1]龙强.无人机遥感在应急测绘保障任务中的应用[J].科技资讯,2017,15(18):15—16.Long Qiang.Application of UAV remote sensing in emergency mapping support tasks[J].Science&Technology Information,2017,15(18):15—16.
[2]孙和利,彭政杰,李娟,等.基于GPU的无人机遥感影像快速拼接[J].地理空间信息,2017,15(2):9—11.Sun Heli,Peng Zhengjie,Li Juan,et al.Fast splicing of remote sensing images of UAV based on GPU[J].Geospatial Information,2017,15(2)9—11.
[3]Malagi V P,Babu D R R,Malagi V P,et al.Rotation-invariant fast feature based image registration for motion compensation in aerial image sequences[M].Proceedings of International Conference on Cognition and Recognition,2018.
[4]罗天银,张平,黄青伦.倾斜摄影空三结果优化及检查研究[J].测绘,2017,40(1):22—24.Luo Tianyin,Zhang Ping,Huang Qinglun.Optimization and inspection of the results of tilting photography[J].Surveying,2017,40(1):22—24.
[5]Cheng Z,Li Z.An aerial image mosaic method based on UAV position and attitude information[J].Acta Geodaetica Et Cartographica Sinica,2016,45(6):698—705.
[6]喻钧,张强,陈中伟,等.一种数码迷彩的拼接算法[J].光学技术,2017,43(4):339—342.Yu Jun,Zhang Qiang,Chen Zhongwei,et al.A splicing algorithm for digital camouflage[J].Optical Technique,2017,43(4):339—342.
[7]Alismail H S,Browning B,Lucey S.Photometric bundle adjustment for vision-based SLAM[C]∥13th Asian Conference on Computer Vision and Pattern Recognition.Jaipei,Taiwan:Springer,2016:324—341.
[8]陶俊.投影器的标定方法[J].光学技术,2007,33(3):464—467.Tao Jun.Calibration method of projector[J].Optical Technique,2007,33(3):464—467.
[9]郭忠磊,赵志勇,滕惠忠,等.无人机影像自检校光束法区域网平差精度分析[J].海洋测绘,2016,36(2):75—78.Guo Zhonglei,Zhao Zhiyong,Teng Huizhong,et al.Analysis of adjustment of regional network adjustment of UAV image self-checking beam method[J].Ocean Mapping,2016,36(2):75—78.
[10]张春森,朱师欢,臧玉府,等.顾及曝光延迟的无人机GPS辅助光束法平差方法[J].测绘学报,2017,46(5):565—572.Zhang Chunsen,Zhu Shihuan,Yan Yufu,et al.GPS-assisted beam adjustment method for drones with exposure delay[J].Acta Geoda Sinica,2017,46(5):565—572.
[11]Xu Bin,Li Yingcheng,Liu Xiaolong,et al.The application of bundle block adjustment with constraint conditions in platform calibration of four-head aerial digital camera[J].Acta Geodaetica et Cartographica Sinica,2014,43(1):66—73.
[12]Zhen Y,Sun Z,Li J,et al.An airborne remote sensing image mosaic algorithm based on feature points[C]//Sixth International Conference on Instrumentation&Measurement,Computer,Communication and Control.Harbin,China:IEEE,2016:202—205.
[13]耿迅,徐青,邢帅,等.四元数火星快车立体测绘影像光束法平差[J].测绘科学,2016,41(1):23—27.Geng Xun,Xu Qing,Xing Shuai,et al.Beam alignment of quaternion mars express stereo mapping image[J].Journal of Surveying and Mapping,2016,41(1):23—27.
[14]张佳霖.基于匹配的图像拼接技术的研究[D].西安:西安科技大学,2016.Zhang Jialin.Research on image mosaic technology based on matching[D].Xi'an:Xi'an University of Science and Technology,2016.
[15]宋佳乾,汪西原.基于改进SIFT特征点匹配的图像拼接算法[J].计算机测量与控制,2015,23(2):512—515.Song Jiaqian,Wang Xiyuan.Image mosaic algorithm based on improved SIFT feature point matching[J].Journal of Computer Measurement and Control,2015,23(2):512—515.
[16]陈浩.基于SURF特征匹配算法的全景图像拼接[D].西安:西安电子科技大学,2010.Chen Hao.Panoramic image stitching based on SURF feature matching algorithm[D].Xi'an:Xidian University,2010.
[17]王雨曦,亓洪兴,马彦鹏,等.画幅扫描红外成像实时拼接中的光束法平差[J].红外与激光工程,2016,45(01):167—172.Wang Yuqi,Pei Hongxing,Ma Yanpeng,et al.Beam adjustment in real-time splicing of frame scanning infrared imaging[J].Infrared and Laser Engineering,2016,45(01):167—172.
[18]刘春,李巍岳,雷伟刚,等.基于光束法自由网平差的无人机影像严格拼接[J].同济大学学报:自然科学版,2012,40(5):757—762.Liu Chun,Li Weiyue,Lei Weigang,et al.Strict mosaic of UAV images based on free network adjustment[J].Journal of Tongji University:Natural Science,2012,40(5):757—762.
[19]Triggs B,McLauchlan P F,Hartley R I,et al.Bundle adjustment—A modern synthesis[M].Heidelberg:Springer,2000:298—372.
[20]Shi Yi,Liu Changjie,Guo Yin,et al.Measurement system of geometric parameters for overhead line system based on binocular vision[J].Infrared and Laser Engineering,2014,43(6):1936—1942.
[21]赵海涛,张兵,左正立,等.基于光束法平差的POS系统视准轴偏差检校[J].国土资源遥感,2012,24(3):22—28.Zhao Haitao,Zhang Bing,Zuo Zhengli,et al.Calibration of alignment axis deviation of POS system based on beam adjustment[J].Remote Sensing For Land&Resources,2012,24(3):22—28.
[22]Manolis I A L,Argyros A A.SBA:A software package for generic sparse bundle adjustment[J].ACM Transactions on Mathematical Software,2009,36(1):1—30.
[2]孙和利,彭政杰,李娟,等.基于GPU的无人机遥感影像快速拼接[J].地理空间信息,2017,15(2):9—11.Sun Heli,Peng Zhengjie,Li Juan,et al.Fast splicing of remote sensing images of UAV based on GPU[J].Geospatial Information,2017,15(2)9—11.
[3]Malagi V P,Babu D R R,Malagi V P,et al.Rotation-invariant fast feature based image registration for motion compensation in aerial image sequences[M].Proceedings of International Conference on Cognition and Recognition,2018.
[4]罗天银,张平,黄青伦.倾斜摄影空三结果优化及检查研究[J].测绘,2017,40(1):22—24.Luo Tianyin,Zhang Ping,Huang Qinglun.Optimization and inspection of the results of tilting photography[J].Surveying,2017,40(1):22—24.
[5]Cheng Z,Li Z.An aerial image mosaic method based on UAV position and attitude information[J].Acta Geodaetica Et Cartographica Sinica,2016,45(6):698—705.
[6]喻钧,张强,陈中伟,等.一种数码迷彩的拼接算法[J].光学技术,2017,43(4):339—342.Yu Jun,Zhang Qiang,Chen Zhongwei,et al.A splicing algorithm for digital camouflage[J].Optical Technique,2017,43(4):339—342.
[7]Alismail H S,Browning B,Lucey S.Photometric bundle adjustment for vision-based SLAM[C]∥13th Asian Conference on Computer Vision and Pattern Recognition.Jaipei,Taiwan:Springer,2016:324—341.
[8]陶俊.投影器的标定方法[J].光学技术,2007,33(3):464—467.Tao Jun.Calibration method of projector[J].Optical Technique,2007,33(3):464—467.
[9]郭忠磊,赵志勇,滕惠忠,等.无人机影像自检校光束法区域网平差精度分析[J].海洋测绘,2016,36(2):75—78.Guo Zhonglei,Zhao Zhiyong,Teng Huizhong,et al.Analysis of adjustment of regional network adjustment of UAV image self-checking beam method[J].Ocean Mapping,2016,36(2):75—78.
[10]张春森,朱师欢,臧玉府,等.顾及曝光延迟的无人机GPS辅助光束法平差方法[J].测绘学报,2017,46(5):565—572.Zhang Chunsen,Zhu Shihuan,Yan Yufu,et al.GPS-assisted beam adjustment method for drones with exposure delay[J].Acta Geoda Sinica,2017,46(5):565—572.
[11]Xu Bin,Li Yingcheng,Liu Xiaolong,et al.The application of bundle block adjustment with constraint conditions in platform calibration of four-head aerial digital camera[J].Acta Geodaetica et Cartographica Sinica,2014,43(1):66—73.
[12]Zhen Y,Sun Z,Li J,et al.An airborne remote sensing image mosaic algorithm based on feature points[C]//Sixth International Conference on Instrumentation&Measurement,Computer,Communication and Control.Harbin,China:IEEE,2016:202—205.
[13]耿迅,徐青,邢帅,等.四元数火星快车立体测绘影像光束法平差[J].测绘科学,2016,41(1):23—27.Geng Xun,Xu Qing,Xing Shuai,et al.Beam alignment of quaternion mars express stereo mapping image[J].Journal of Surveying and Mapping,2016,41(1):23—27.
[14]张佳霖.基于匹配的图像拼接技术的研究[D].西安:西安科技大学,2016.Zhang Jialin.Research on image mosaic technology based on matching[D].Xi'an:Xi'an University of Science and Technology,2016.
[15]宋佳乾,汪西原.基于改进SIFT特征点匹配的图像拼接算法[J].计算机测量与控制,2015,23(2):512—515.Song Jiaqian,Wang Xiyuan.Image mosaic algorithm based on improved SIFT feature point matching[J].Journal of Computer Measurement and Control,2015,23(2):512—515.
[16]陈浩.基于SURF特征匹配算法的全景图像拼接[D].西安:西安电子科技大学,2010.Chen Hao.Panoramic image stitching based on SURF feature matching algorithm[D].Xi'an:Xidian University,2010.
[17]王雨曦,亓洪兴,马彦鹏,等.画幅扫描红外成像实时拼接中的光束法平差[J].红外与激光工程,2016,45(01):167—172.Wang Yuqi,Pei Hongxing,Ma Yanpeng,et al.Beam adjustment in real-time splicing of frame scanning infrared imaging[J].Infrared and Laser Engineering,2016,45(01):167—172.
[18]刘春,李巍岳,雷伟刚,等.基于光束法自由网平差的无人机影像严格拼接[J].同济大学学报:自然科学版,2012,40(5):757—762.Liu Chun,Li Weiyue,Lei Weigang,et al.Strict mosaic of UAV images based on free network adjustment[J].Journal of Tongji University:Natural Science,2012,40(5):757—762.
[19]Triggs B,McLauchlan P F,Hartley R I,et al.Bundle adjustment—A modern synthesis[M].Heidelberg:Springer,2000:298—372.
[20]Shi Yi,Liu Changjie,Guo Yin,et al.Measurement system of geometric parameters for overhead line system based on binocular vision[J].Infrared and Laser Engineering,2014,43(6):1936—1942.
[21]赵海涛,张兵,左正立,等.基于光束法平差的POS系统视准轴偏差检校[J].国土资源遥感,2012,24(3):22—28.Zhao Haitao,Zhang Bing,Zuo Zhengli,et al.Calibration of alignment axis deviation of POS system based on beam adjustment[J].Remote Sensing For Land&Resources,2012,24(3):22—28.
[22]Manolis I A L,Argyros A A.SBA:A software package for generic sparse bundle adjustment[J].ACM Transactions on Mathematical Software,2009,36(1):1—30.