基于平行直线组的可见光与红外图像配准算法
|
摘要
为实现可见光与红外图像配准,方便维修人员辨识电路板红外图像中的器件,提出一种新型的基于平行线组的可见光与红外图像的自动配准算法。首先,使用Canny算法提取图像边缘,并使用8邻域链码对其进行编码;然后,利用Freeman准则进行直线检测并提取平行线组;最后,利用图像中的平行线经仿射变换后仍为平行线的约束特性,将直线配准转换为点配准,利用鲁棒点匹配算法实现平行线间的配准。实验表明,当2幅配准图像中包含丰富的平行线时,算法能够充分利用图像中平行线在仿射变换时的平行约束性,实现可见光与红外图像的快速自动配准,且算法具有较好配准精度。
To match the visible and infrared images and make it convenient for maintenance staffs to recognize the components in infrared image,an novel automatic registration algorithm between the visible and infrared images based on parallel lines was proposed.Firstly,Canny algorithm was used to extract the edge of the image and the edge encoded by eight fields chain code.Secondly,Freeman guidelines were used to detect the lines and the parallel lines extracted for registration.Finally,because the parallel lines remain parallel lines after the affine transformation,line registration was changed to point registration.The robust point matching(RPM)algorithm was used to match the parallel lines.The experimental results show that the proposed method can make full use of the parallel lines that remain parallel after affine transformation and realize automatic registration between the visible and infrared images quickly and efficiently.
To match the visible and infrared images and make it convenient for maintenance staffs to recognize the components in infrared image,an novel automatic registration algorithm between the visible and infrared images based on parallel lines was proposed.Firstly,Canny algorithm was used to extract the edge of the image and the edge encoded by eight fields chain code.Secondly,Freeman guidelines were used to detect the lines and the parallel lines extracted for registration.Finally,because the parallel lines remain parallel lines after the affine transformation,line registration was changed to point registration.The robust point matching(RPM)algorithm was used to match the parallel lines.The experimental results show that the proposed method can make full use of the parallel lines that remain parallel after affine transformation and realize automatic registration between the visible and infrared images quickly and efficiently.
引文
[1]ALLRED L G,HOWARD T R,SERPEN G.Thermal imaging is the sole basis for repairing circuit cards in the F-16flight control panel[C]//AUTOTESTCON'96,Dayton:Test Technology and Commercialization,1996:418-424.
[2]WANG Li,CHENG Baoying,WANG Kun.Research and design for infrared diagnostic system of aviation electronic components[C]//2010International Conference on Intelligent System Design and Engineering Application.Changsha:IEEE,2010:140-142.
[3]WANG Menghui,CHUNG Y K,SUNG W T.Using thermal image matter-element to design a circuit board fault diagnosis system[J].Expert Systems with Applications,2011,38(2):6164-6169.
[4]刘少鹏,郝群,宋勇.基于PHLST的红外与可见光图像融合算法[J].光子学报,2011,40(1):107-111.LIU Shaopeng,HAO Qun,SONG Yong.Fusion algorithm of visible and infrared images based on polyharmonic local sine transform[J].Acta Photonica Sinica,2011,40(1):107-111.(in Chinese).
[5]凌志刚,梁彦,潘泉,等.一种鲁棒的红外与可见光多级景象匹配算法[J].航空学报,2010,31(6):1185-1195.LING Zhigang,LIANG Yan,PAN Quan,et al.A robust multi-level scene matching algorithm for infrared and visible light image[J].Acta Aeronautica et Astronautica Sinica,2010,31(6):1185-1195.(in Chinese).
[6]朱英宏,李俊山,杨威,等.红外与可见光图像特征点边缘描述与匹配算法[J].计算机辅助设计与图形学学报,2013,25(6):857-864.ZHU Yinghong,LI Junshan,YANG Wei,et al.A feature points description and matching algorithm for edge in IR/visual images[J].Journal of ComputerAided Design&Computer Graphics,2013,25(6):857-864.(in Chinese).
[7]廉蔺,李国辉,张军,等.基于参数分步估计的红外与可见光图像自动配准算法[J].电子学报,2012,40(9):1829-1838.LIAN Lin,LI Guohui,ZHANG Jun,et al.An automatic algorithm for infrared and visible image registration based on parameter step estimation[J].Acta Electronica Sinica,2012,40(9):1829-1838.(in Chinese).
[8]LI Bin,GUO Huijuan,LIU Boang,et al.Multi-sensor image registration based on geometric affine invariant[C]//Control and Decision Conference(CCDC).Guiyang:IEEE,2013:4472-4776.
[9]FLORIAN D,KOCK H,PLANKENSTEINER K,et al.Auto focus and image registration techniques for infrared imaging of microelectronic devices[J].Measurment Science and Technology,2013,14(7):285-290.
[10]KERN J P,PATTICHIS M S.Robust multispectral image registration using mutual-information models[J].IEEE Transactions on Geoscience and Remote Sensing,2007,45(5):1494-1505.
[11]KIM Y S,LEE J H,RA J B.Multi-sensor image registration based on intensity and edge orientation information[J].Pattern Recognition,2008,41(11):3356-3365.
[12]LEE J H,KIM Y S,LEE D,et al.Robust CCD and IR image registration using gradient-based statistical information[J].IEEE Signal Processing Letters,2010,17(4):347-350.
[13]HRKAC T,KALAFATIC Z,KRAPAC J.Infraredvisual image registration based on corners and Hausdorff distance[M].Berlin Heidelberg:Springer,2007:383-392.
[14]YANG Weiping,WANG Xuezhi,MORAN B,et al.Efficient registration of optical and infrared images via modified Sobel edging for plant canopy temperature estimation[J].Computers&Electrical Engineering,2012,38(5):1213-1221.
[15]HAN Jungong,PAUWELS E J,De ZEEU P.Visible and infrared image registration in man-made environments employing hybrid visual features[J].Pattern Recognition Letters,2013,34(1):42-51.
[16]侯晴宇,武春风,赵明,等.基于似然函数最速下降的红外与可见光图像配准[J].光子学报,2011,40(3):433-438.HOU Qingyu,WU Chunfeng,ZHAO Ming,et al.IR/visible image registration based on the steepest descent of the likelihood function[J].Acta Photonica Sinica,2011,40(3):433-438.(in Chinese).
[17]廉蔺,李国辉,张军,等.基于边缘最优映射的红外和可见光图像自动配准算法[J].自动化学报,2012,38(4):570-581.LIAN Lin,LI Guohui,ZHANG Jun,et al.An automatic registration algorithm of infrared and visible images based on optimal mapping of edges[J].Acta Automatica Sinica,2012,38(4):570-581.(in Chinese).
[18]RANGRAJAN A,CHUI H,MJOLSNESS E,et al.A robust point-matching algorithm for autoradiograph alignment[J].Medical Image Analysis,1997,1(4):379-398.
[19]CHUI H,RAMBO J,DUNCAN J,et al.Registration of cortical anatomical structures via robust 3D point matching[C]//Information Processing in Medical Imaging.Berlin Heidelberg:Springer,1999:168-181.
[20]ZHENG Y,DOERMANN D.Robust point matching for non-rigid shapes:A relaxation labeling based approach,1334217[R].Maryland:IEEE,2004.
[21]WANG Zhiheng,WU Fuchao,HU Zhanyi.MSLD:A robust descriptor for line matching[J].Pattern Recognition,2009,42(5):941-953.
[2]WANG Li,CHENG Baoying,WANG Kun.Research and design for infrared diagnostic system of aviation electronic components[C]//2010International Conference on Intelligent System Design and Engineering Application.Changsha:IEEE,2010:140-142.
[3]WANG Menghui,CHUNG Y K,SUNG W T.Using thermal image matter-element to design a circuit board fault diagnosis system[J].Expert Systems with Applications,2011,38(2):6164-6169.
[4]刘少鹏,郝群,宋勇.基于PHLST的红外与可见光图像融合算法[J].光子学报,2011,40(1):107-111.LIU Shaopeng,HAO Qun,SONG Yong.Fusion algorithm of visible and infrared images based on polyharmonic local sine transform[J].Acta Photonica Sinica,2011,40(1):107-111.(in Chinese).
[5]凌志刚,梁彦,潘泉,等.一种鲁棒的红外与可见光多级景象匹配算法[J].航空学报,2010,31(6):1185-1195.LING Zhigang,LIANG Yan,PAN Quan,et al.A robust multi-level scene matching algorithm for infrared and visible light image[J].Acta Aeronautica et Astronautica Sinica,2010,31(6):1185-1195.(in Chinese).
[6]朱英宏,李俊山,杨威,等.红外与可见光图像特征点边缘描述与匹配算法[J].计算机辅助设计与图形学学报,2013,25(6):857-864.ZHU Yinghong,LI Junshan,YANG Wei,et al.A feature points description and matching algorithm for edge in IR/visual images[J].Journal of ComputerAided Design&Computer Graphics,2013,25(6):857-864.(in Chinese).
[7]廉蔺,李国辉,张军,等.基于参数分步估计的红外与可见光图像自动配准算法[J].电子学报,2012,40(9):1829-1838.LIAN Lin,LI Guohui,ZHANG Jun,et al.An automatic algorithm for infrared and visible image registration based on parameter step estimation[J].Acta Electronica Sinica,2012,40(9):1829-1838.(in Chinese).
[8]LI Bin,GUO Huijuan,LIU Boang,et al.Multi-sensor image registration based on geometric affine invariant[C]//Control and Decision Conference(CCDC).Guiyang:IEEE,2013:4472-4776.
[9]FLORIAN D,KOCK H,PLANKENSTEINER K,et al.Auto focus and image registration techniques for infrared imaging of microelectronic devices[J].Measurment Science and Technology,2013,14(7):285-290.
[10]KERN J P,PATTICHIS M S.Robust multispectral image registration using mutual-information models[J].IEEE Transactions on Geoscience and Remote Sensing,2007,45(5):1494-1505.
[11]KIM Y S,LEE J H,RA J B.Multi-sensor image registration based on intensity and edge orientation information[J].Pattern Recognition,2008,41(11):3356-3365.
[12]LEE J H,KIM Y S,LEE D,et al.Robust CCD and IR image registration using gradient-based statistical information[J].IEEE Signal Processing Letters,2010,17(4):347-350.
[13]HRKAC T,KALAFATIC Z,KRAPAC J.Infraredvisual image registration based on corners and Hausdorff distance[M].Berlin Heidelberg:Springer,2007:383-392.
[14]YANG Weiping,WANG Xuezhi,MORAN B,et al.Efficient registration of optical and infrared images via modified Sobel edging for plant canopy temperature estimation[J].Computers&Electrical Engineering,2012,38(5):1213-1221.
[15]HAN Jungong,PAUWELS E J,De ZEEU P.Visible and infrared image registration in man-made environments employing hybrid visual features[J].Pattern Recognition Letters,2013,34(1):42-51.
[16]侯晴宇,武春风,赵明,等.基于似然函数最速下降的红外与可见光图像配准[J].光子学报,2011,40(3):433-438.HOU Qingyu,WU Chunfeng,ZHAO Ming,et al.IR/visible image registration based on the steepest descent of the likelihood function[J].Acta Photonica Sinica,2011,40(3):433-438.(in Chinese).
[17]廉蔺,李国辉,张军,等.基于边缘最优映射的红外和可见光图像自动配准算法[J].自动化学报,2012,38(4):570-581.LIAN Lin,LI Guohui,ZHANG Jun,et al.An automatic registration algorithm of infrared and visible images based on optimal mapping of edges[J].Acta Automatica Sinica,2012,38(4):570-581.(in Chinese).
[18]RANGRAJAN A,CHUI H,MJOLSNESS E,et al.A robust point-matching algorithm for autoradiograph alignment[J].Medical Image Analysis,1997,1(4):379-398.
[19]CHUI H,RAMBO J,DUNCAN J,et al.Registration of cortical anatomical structures via robust 3D point matching[C]//Information Processing in Medical Imaging.Berlin Heidelberg:Springer,1999:168-181.
[20]ZHENG Y,DOERMANN D.Robust point matching for non-rigid shapes:A relaxation labeling based approach,1334217[R].Maryland:IEEE,2004.
[21]WANG Zhiheng,WU Fuchao,HU Zhanyi.MSLD:A robust descriptor for line matching[J].Pattern Recognition,2009,42(5):941-953.