红外焦平面非均匀校正及图像增强研究
摘要
红外技术是20世纪初新出的一种不可见光技术,目前已被广泛应用于军事和民事领域,如红外探测,红外监视等。而红外探测焦平面作为红外技术的核心部分,起着关键的作用。近年来,由于非制冷微测辐射热计型红外焦平面阵列的制造技术有了重大突破,使得红外系统的体积变小、重量变轻、价格不断降低,极大地推动了红外系统在民事用途的各个领域中的推广。我国的红外技术研究起步比较晚,与先进的国家还有较大的差距,因此研究红外技术显得紧迫且有意义。
红外焦平面上存在的非均匀性是目前大家广泛讨论的问题,本文先简单介绍目前红外热成像技术的发展状况,及一些红外探测器分类。分析红外探测器非均匀产生的原因,对目前国内广泛的应用两类非均匀校正算法做了深入的研究,即基于定标的非均匀校正算法和基于场景的自适应算法。在此基础上提出了一种改进的神经网络自适应算法,并将随机信号处理中收敛因子的估算应用到该算法。
其次,为了下一步在硬件上实现神经网络自适应算法,本文在FPGA开发板上设计了一套能存储两帧红外图像的存储系统。其主要存储器是该开发板自带的DDR SDRAM。另外,对红外探测器的特性做了详细的介绍,在常用图像增强算法的基础上,结合实验室实际的需要,选择了一种线性增强算法和自适应计算均值相结合的算法,并在此算法上做了一定的改进,对探测器输出的数据做准适应的图像增强处理,并在FPGA上将该算法实现。实验结果表明,本文的设计都实现了预期的目标。
Infrared technology is a new invisible ray technology in the beginning of the 20th century and currently it is widely applied in the military and civilian field,such as infrared detecting,infrared stakeout and so on.Infrared focal plane plays a key role as the core of the infrared technology.Recently,as the manufacture technology of uncooled microbolometer infrared focal plane array got a great breakthrough,it made infrared system's weight more lighter,its volume more smaller and its price more cheaper.It does greatly accelerate the promotion of the infrared system to be applied in every aspect of the civilian field.The study of the infrared technology began relatively late in our country,so there is still large gap when compared with the developed countries.Therefore,it is urgent and meaningful to do the study.
We all know that the non-uniformity in IRFPA(Infrared focal plane array) is widely discussed for the moment.Firstly,the paper plans to briefly introduce the development status of the infrared technology and some sorts of infrared imaging system in modern times.By the way,the paper also analyses the causes of non-uniformity in IRFPA,and studies the two sorts of the non-uniformity correction algorithms in IRFPA in the country.For example:the non-uniformity algorithm on the base of scaling and scene.On this basis,the paper brings forward an improved adaptive algorithm of NN(Neural Network).
Secondly,the paper devises a suit of infrared image memory system that could put in two frame images on FPGA in order to run the adaptive algorithm of NN,and its main memory is DDR SDRAM which is owned by the development board.Finally the paper does detailed presentation of the characteristic of the infrared thermal imager that is often used by the lab.On the basis of the common image enhancing algorithm,when considering the requirements of our lab,the paper selects an algorithm that combines a linear enhancement algorithm and an adaptive calculation of the mean value algorithm,carries out the image enhancement processing with the output data from the thermal imager,and runs the algorithm on FPGA.The experiment indicates that all the schemes in the paper achieve the desired objectives.
红外焦平面上存在的非均匀性是目前大家广泛讨论的问题,本文先简单介绍目前红外热成像技术的发展状况,及一些红外探测器分类。分析红外探测器非均匀产生的原因,对目前国内广泛的应用两类非均匀校正算法做了深入的研究,即基于定标的非均匀校正算法和基于场景的自适应算法。在此基础上提出了一种改进的神经网络自适应算法,并将随机信号处理中收敛因子的估算应用到该算法。
其次,为了下一步在硬件上实现神经网络自适应算法,本文在FPGA开发板上设计了一套能存储两帧红外图像的存储系统。其主要存储器是该开发板自带的DDR SDRAM。另外,对红外探测器的特性做了详细的介绍,在常用图像增强算法的基础上,结合实验室实际的需要,选择了一种线性增强算法和自适应计算均值相结合的算法,并在此算法上做了一定的改进,对探测器输出的数据做准适应的图像增强处理,并在FPGA上将该算法实现。实验结果表明,本文的设计都实现了预期的目标。
Infrared technology is a new invisible ray technology in the beginning of the 20th century and currently it is widely applied in the military and civilian field,such as infrared detecting,infrared stakeout and so on.Infrared focal plane plays a key role as the core of the infrared technology.Recently,as the manufacture technology of uncooled microbolometer infrared focal plane array got a great breakthrough,it made infrared system's weight more lighter,its volume more smaller and its price more cheaper.It does greatly accelerate the promotion of the infrared system to be applied in every aspect of the civilian field.The study of the infrared technology began relatively late in our country,so there is still large gap when compared with the developed countries.Therefore,it is urgent and meaningful to do the study.
We all know that the non-uniformity in IRFPA(Infrared focal plane array) is widely discussed for the moment.Firstly,the paper plans to briefly introduce the development status of the infrared technology and some sorts of infrared imaging system in modern times.By the way,the paper also analyses the causes of non-uniformity in IRFPA,and studies the two sorts of the non-uniformity correction algorithms in IRFPA in the country.For example:the non-uniformity algorithm on the base of scaling and scene.On this basis,the paper brings forward an improved adaptive algorithm of NN(Neural Network).
Secondly,the paper devises a suit of infrared image memory system that could put in two frame images on FPGA in order to run the adaptive algorithm of NN,and its main memory is DDR SDRAM which is owned by the development board.Finally the paper does detailed presentation of the characteristic of the infrared thermal imager that is often used by the lab.On the basis of the common image enhancing algorithm,when considering the requirements of our lab,the paper selects an algorithm that combines a linear enhancement algorithm and an adaptive calculation of the mean value algorithm,carries out the image enhancement processing with the output data from the thermal imager,and runs the algorithm on FPGA.The experiment indicates that all the schemes in the paper achieve the desired objectives.
引文
[1]Wang Bing-Jian,Wang Da-Bao,Lai Rui."An improved non-uniformity correctrion algorithm for IRFPA based on neural network".2008 Congress on Image and Signal Processing.P547-551.
[2]Alain MANISSADJIAN,Philippe TRIBOLET,Philippe CHORIER,Patricia COSTA.Sofradir infrared detector products:the past and the future[J].SPIE.2000,Vol.4130:480-495.
[3]张丹耀,赖永生.动态红外测温技术在变电站中的应用[J].产品与技术,No.3.2009:P80-83.
[4]阿力塔,徐秀廷,宋娟娟.短波近红外光谱技术对葡萄酒中总糖含量快速测定的研究[J].分析测试学报,Vol.28.No.2,2009:P177-180.
[5]周庆成,张香芹,车鑫.高效近红外光谱分析技术在药物分析中的应用[J].No.3.2009:P13-14.
[6]张华斌,张庆中.红外焦平面阵列技术现状和发掌趋势[J].传感器世界,May 2005:P6-10.
[7]陈海生.非致冷红外焦平面热成像技术的进展[J].红外技术与器件,Vol.32002:P14-17.
[8]蔡毅.红外系统中的扫描型和凝视型FPA[J].红外技术,Vol.23 No.1Jan.2001:P3-8.
[9]刘武,孙国正.多色红外焦平面器件的现状、发展趋势及军事应用分析[J].红外技术,Vol.26 No.3,May,2004:P1-5.
[10]何力.第三代红外焦平面基础技术的研究进展[J].红外与激光工程,Vol.36,No.5,Oct,2007:P676-701.
[11]李琼花,杨家德等.非致冷凝视红外焦平面阵列的特点及应用[J].重庆工学院学报,Vol.17,No.1,Feb.2003:P48-50.
[12]于小兵.微型杜瓦瓶及致冷器在红外系统中的应用[J].应用光学.No.1,2000:P38-41.
[13]Elisabeth BROCHIER,Philippe TRIBOLET,Philippe CHORIER,Patricia COSTA.Cooled large IR starting arrays:towards third generation[J].SPIE.2004,;Vol.5251:P26-36.
[14]闫文成.热释电红外焦平面阵列非均匀性校正研究[M].南京:南京理工大学,2004.
[15]魏同立.红外焦平面技术的重要进展[J].南京:东南大学,1994.
[16]孙志君.21世纪的红外焦平面阵列技术军用前景[J].现代防御技术,No.3,Vol.31.2003:P48-54.
[17]孙志君.红外焦平面阵列技术新军事装备应用[J].传感器世界,2004.
[18]张亚琴,郁标.红外成像无损检测技术基本原理及其应用范围[J].上海地质,No.4,Vol.84,2002:P47-52.
[19]杨正兴,谈新权,尚小冬.红外焦平面阵列非均匀性校正算法研究与实现[J].红外技术,No.3,Vol.26,2004.
[20]张小军,赵亦工.红外焦平面阵列非均匀性校正的综合处理算法[J].红外技术,Vol.25;No.3,2003:P34-38.
[21]邢素霞.非制冷红外热成像系统研究[D].南京:南京理工大学.2005.
[22]袁祥辉.固体图像传感器及其应用[M].重庆大学出版社,1996.
[23]代少升.红外焦平面阵列实时非均匀性校正研究[D].重庆:重庆大学,2004.
[24]曹永超,红外图像实时非均匀性校正技术研究[D].天津:天津大学,2006.
[25]王钰.实时红外图像非均匀校正技术研究[J].红外于毫米波学报,No.2,1999:P1-5.
[26]陈锐,谈新权.红外图像非均匀性校正方法综述[J].红外技术,No.1,Vol.24,2002:P1-3.
[27]Scribner D A,Adaptive of IRFPA nonuniformity correction for IR focal plane arrays usingneural networks[J],SPIE,1991,Vol.1541:P100-108.
[28]杨少林.基于场景的焦平面阵列非均匀性校正算法研究[J].浙江大学学报,2006,40(7):P1150-1153.
[29]Sophia Tzimopoulou,Alan H.Lettington.Scene based techniques for nonuniformity correction of infrared focal plane arrays.SPIE.1998,vol.3436.pp:172-183.
[30]D.A.Scribner,K.A.Sarkady,J.T.Caulfield,etal.Nonuniformity correction for staringfocal planearrays usingscene-basedtechniques.SPIE.1990,Vol.1308.pp:224-233.
[31]祝永坚.红外焦平面阵列非均匀性实时校正技术研究[J].红外,No.12,2005:P1-5.
[32]杨少林.基于场景的焦平面阵列非均匀性校正算法研究[J].浙江大学学报.2006,40(7):P1150-1153.
[33]陆光华,彭学愚,张林让,毛用才.随机信号处理[M].西安:西安电子科技大学出版社,2002:P66-73.
[34]红外焦平面阵列特性参数测试技术规范[S].国标GB/T17444-1998.
[35]Donald E.Thomas,Philip R.Moorby.硬件描述语言Verilog第四版[M].北京:清华大学出版社,2001.
[36]朱明程.FPGA技术的最新发展[J].电子技术应用,1997,23(2):P1-4.
[37]王诚,薛小刚.FPGA/CPLD设计工具Xilinx ISE使用详解[M].北京:人民邮电出版社,2005.
[38]夏宇闻.Verilog数字系统设计教程[M].北京:北京航空航天大学出版社,2003.
[39]黄均鼐,俞承芳,蒋慧文等.可编程逻辑器件设计[M].上海:复旦大学出版社,1997.
[40]曾繁泰,陈美金.VHDL程序设计[M].北京:清华大学出版社,2001.4.
[41]JESD79E:Double Data Rate(DDR)SDRAM Specification.JEDEC Standard.
[42]MT46V8M16 Datasheet.Micron Technology,Inc.
[43]Xilinx Memory Interface Generator(MIG)1.6 User Guide.Xilinx,Inc.
[44]XAPP768c:Interfacing Sparatan-3 Devices with 166 MHz or 333 Mb/s DDR SDRAM Memories.Xilinx,Inc.
[45]赵鑫,蒋亮.VHDL与数字电路设计[M].北京:机械工业出版社,2005.6.
[46]徐向飞.基于VHDL的FIFO存储器的设计[M].南京:南京工业职业技术学院学报,2007.12.
[47]384×288 Lwir Uncooled Microbolometer Detector Technical Specification ULIS.UL03081 datasheet,2005.
[48]王岳环.基于FPGA的实时红外图像线性增强算法[J].微计算机信息.May 25,2007:P190-194.
[49]Kenneth R.Castlemen著,朱志刚,林学闫等 译.数字图像处理[M].电子工业出版社.
[50]黄本雄,王永红,胡海.基于直方图的热像显示算法研究[J].华中科技大学学报(自然科学版),2004,11.
[51]章毓晋.图像处理和分析[M].北京,清华大学出版社,1999.
[2]Alain MANISSADJIAN,Philippe TRIBOLET,Philippe CHORIER,Patricia COSTA.Sofradir infrared detector products:the past and the future[J].SPIE.2000,Vol.4130:480-495.
[3]张丹耀,赖永生.动态红外测温技术在变电站中的应用[J].产品与技术,No.3.2009:P80-83.
[4]阿力塔,徐秀廷,宋娟娟.短波近红外光谱技术对葡萄酒中总糖含量快速测定的研究[J].分析测试学报,Vol.28.No.2,2009:P177-180.
[5]周庆成,张香芹,车鑫.高效近红外光谱分析技术在药物分析中的应用[J].No.3.2009:P13-14.
[6]张华斌,张庆中.红外焦平面阵列技术现状和发掌趋势[J].传感器世界,May 2005:P6-10.
[7]陈海生.非致冷红外焦平面热成像技术的进展[J].红外技术与器件,Vol.32002:P14-17.
[8]蔡毅.红外系统中的扫描型和凝视型FPA[J].红外技术,Vol.23 No.1Jan.2001:P3-8.
[9]刘武,孙国正.多色红外焦平面器件的现状、发展趋势及军事应用分析[J].红外技术,Vol.26 No.3,May,2004:P1-5.
[10]何力.第三代红外焦平面基础技术的研究进展[J].红外与激光工程,Vol.36,No.5,Oct,2007:P676-701.
[11]李琼花,杨家德等.非致冷凝视红外焦平面阵列的特点及应用[J].重庆工学院学报,Vol.17,No.1,Feb.2003:P48-50.
[12]于小兵.微型杜瓦瓶及致冷器在红外系统中的应用[J].应用光学.No.1,2000:P38-41.
[13]Elisabeth BROCHIER,Philippe TRIBOLET,Philippe CHORIER,Patricia COSTA.Cooled large IR starting arrays:towards third generation[J].SPIE.2004,;Vol.5251:P26-36.
[14]闫文成.热释电红外焦平面阵列非均匀性校正研究[M].南京:南京理工大学,2004.
[15]魏同立.红外焦平面技术的重要进展[J].南京:东南大学,1994.
[16]孙志君.21世纪的红外焦平面阵列技术军用前景[J].现代防御技术,No.3,Vol.31.2003:P48-54.
[17]孙志君.红外焦平面阵列技术新军事装备应用[J].传感器世界,2004.
[18]张亚琴,郁标.红外成像无损检测技术基本原理及其应用范围[J].上海地质,No.4,Vol.84,2002:P47-52.
[19]杨正兴,谈新权,尚小冬.红外焦平面阵列非均匀性校正算法研究与实现[J].红外技术,No.3,Vol.26,2004.
[20]张小军,赵亦工.红外焦平面阵列非均匀性校正的综合处理算法[J].红外技术,Vol.25;No.3,2003:P34-38.
[21]邢素霞.非制冷红外热成像系统研究[D].南京:南京理工大学.2005.
[22]袁祥辉.固体图像传感器及其应用[M].重庆大学出版社,1996.
[23]代少升.红外焦平面阵列实时非均匀性校正研究[D].重庆:重庆大学,2004.
[24]曹永超,红外图像实时非均匀性校正技术研究[D].天津:天津大学,2006.
[25]王钰.实时红外图像非均匀校正技术研究[J].红外于毫米波学报,No.2,1999:P1-5.
[26]陈锐,谈新权.红外图像非均匀性校正方法综述[J].红外技术,No.1,Vol.24,2002:P1-3.
[27]Scribner D A,Adaptive of IRFPA nonuniformity correction for IR focal plane arrays usingneural networks[J],SPIE,1991,Vol.1541:P100-108.
[28]杨少林.基于场景的焦平面阵列非均匀性校正算法研究[J].浙江大学学报,2006,40(7):P1150-1153.
[29]Sophia Tzimopoulou,Alan H.Lettington.Scene based techniques for nonuniformity correction of infrared focal plane arrays.SPIE.1998,vol.3436.pp:172-183.
[30]D.A.Scribner,K.A.Sarkady,J.T.Caulfield,etal.Nonuniformity correction for staringfocal planearrays usingscene-basedtechniques.SPIE.1990,Vol.1308.pp:224-233.
[31]祝永坚.红外焦平面阵列非均匀性实时校正技术研究[J].红外,No.12,2005:P1-5.
[32]杨少林.基于场景的焦平面阵列非均匀性校正算法研究[J].浙江大学学报.2006,40(7):P1150-1153.
[33]陆光华,彭学愚,张林让,毛用才.随机信号处理[M].西安:西安电子科技大学出版社,2002:P66-73.
[34]红外焦平面阵列特性参数测试技术规范[S].国标GB/T17444-1998.
[35]Donald E.Thomas,Philip R.Moorby.硬件描述语言Verilog第四版[M].北京:清华大学出版社,2001.
[36]朱明程.FPGA技术的最新发展[J].电子技术应用,1997,23(2):P1-4.
[37]王诚,薛小刚.FPGA/CPLD设计工具Xilinx ISE使用详解[M].北京:人民邮电出版社,2005.
[38]夏宇闻.Verilog数字系统设计教程[M].北京:北京航空航天大学出版社,2003.
[39]黄均鼐,俞承芳,蒋慧文等.可编程逻辑器件设计[M].上海:复旦大学出版社,1997.
[40]曾繁泰,陈美金.VHDL程序设计[M].北京:清华大学出版社,2001.4.
[41]JESD79E:Double Data Rate(DDR)SDRAM Specification.JEDEC Standard.
[42]MT46V8M16 Datasheet.Micron Technology,Inc.
[43]Xilinx Memory Interface Generator(MIG)1.6 User Guide.Xilinx,Inc.
[44]XAPP768c:Interfacing Sparatan-3 Devices with 166 MHz or 333 Mb/s DDR SDRAM Memories.Xilinx,Inc.
[45]赵鑫,蒋亮.VHDL与数字电路设计[M].北京:机械工业出版社,2005.6.
[46]徐向飞.基于VHDL的FIFO存储器的设计[M].南京:南京工业职业技术学院学报,2007.12.
[47]384×288 Lwir Uncooled Microbolometer Detector Technical Specification ULIS.UL03081 datasheet,2005.
[48]王岳环.基于FPGA的实时红外图像线性增强算法[J].微计算机信息.May 25,2007:P190-194.
[49]Kenneth R.Castlemen著,朱志刚,林学闫等 译.数字图像处理[M].电子工业出版社.
[50]黄本雄,王永红,胡海.基于直方图的热像显示算法研究[J].华中科技大学学报(自然科学版),2004,11.
[51]章毓晋.图像处理和分析[M].北京,清华大学出版社,1999.