卫星多源遥感图象象素级融合技术研究
|
摘要
多源遥感图象数据融合(也称信息融合)是近年来遥感领域和图象工程领域的研究热点。本论文针对多光谱图象传感器数据与全色图象传感器数据进行双源融合。利用多光谱图象高光谱信息与全色图象高空间信息两者之间的互补性，研究在尽可能保留原光谱信息的前提下，提高空间分辨率的象素级图象融合算法。
论文在研究数据融合的基本概念和基本原理及遥感图象融合预处理的过程与步骤的基础上，具体分析了象素级融合的常用方案，及其相关的IHS，YIQ，PCA，HPF四种传统的经典算法。同时，在研究主客观两方面融合结果评价标准的前提下，比较了多波段融合中各种算法的优缺点，以及单波段融合法中HPF(高通滤波)法与小波变换法的异同。作者在重点研究基于小波变换融合算法的过程中，取得了如下一些具有新意性的成果：
1．提出了一种新的基于特征量积的融合判决依据。这种特征量积是在经典的IHS彩色空间变换和小波多分辨率分析的基础上，利用图象高频小波系数的多个特征量来定义的。
2．在选定特征量积作为判决依据的基础上，用“选择性叠加融合”替代了常见的“选择性融合”的融合思路。
3．将上述两者综合运用，形成了一种图象象素级融合新算法。
通过一组多光谱图象和全色图象数据进行了融合仿真试验，将本文算法与IHS、HPF等传统经典算法和归一化矩算法的试验结果作了比较。结果表明了本文算法的有效性，并且能在保留多光谱图象光谱信息的同时，使多光谱图象的空间分辨率有了提高。
In recent years, multisensor image fusion has attracted many attentions in remote sensing area and image project area. This paper focuses on image fusion between multispectral images and panchromatic images. In order to enhance the result image's spatial resolution with preserving spectral information, research on algorithms is developed in next chapters.
This dissertation firstly studies the cardinal concepts and theories of multisensor data fusion (information fusion). At the same time, this paper introduces steps and procedures of pretreatment in remote sensing image fusion. Afterwards, the paper systematically research the techniques used in pixel-level image fusion and four traditional algorithms (IHS, YIQ, PCA, HPF). Based on making out evaluation criteria of result image in impersonality and personality, merits and demerits of algorithms on multi-band image fusion are discussed. At the same time, HPF(high pass filter) method is compared with wavelet method among single-band image fusion methods. Author stresses the research on the details of algorithm based on wavelet transform, and gets such fresh ideas as:
1. This paper puts forward a new measurement based on feature product. Feature product was defined with feature moments of the wavelet coefficients with high frequency component under different resolutions, based on transform of IHS and wavelet multiresolution analysis.
2. Based on the measurement of feature product, a new idea that additive select fusion take the place of select fusion is introduced.
3. According to the local feature product and the new idea ,a new pixel-level image fusion algorithm is produced.
At last, computer simulations of image fusion are carried out by a group of multispectal images and panchromatic images. Compared with the result of IHS , HPF traditional fusion methods and the normalized correlation moment method, it is proved the validity of this method ,which can improve spatial resolution of the result images with preserving spectral information.
论文在研究数据融合的基本概念和基本原理及遥感图象融合预处理的过程与步骤的基础上，具体分析了象素级融合的常用方案，及其相关的IHS，YIQ，PCA，HPF四种传统的经典算法。同时，在研究主客观两方面融合结果评价标准的前提下，比较了多波段融合中各种算法的优缺点，以及单波段融合法中HPF(高通滤波)法与小波变换法的异同。作者在重点研究基于小波变换融合算法的过程中，取得了如下一些具有新意性的成果：
1．提出了一种新的基于特征量积的融合判决依据。这种特征量积是在经典的IHS彩色空间变换和小波多分辨率分析的基础上，利用图象高频小波系数的多个特征量来定义的。
2．在选定特征量积作为判决依据的基础上，用“选择性叠加融合”替代了常见的“选择性融合”的融合思路。
3．将上述两者综合运用，形成了一种图象象素级融合新算法。
通过一组多光谱图象和全色图象数据进行了融合仿真试验，将本文算法与IHS、HPF等传统经典算法和归一化矩算法的试验结果作了比较。结果表明了本文算法的有效性，并且能在保留多光谱图象光谱信息的同时，使多光谱图象的空间分辨率有了提高。
In recent years, multisensor image fusion has attracted many attentions in remote sensing area and image project area. This paper focuses on image fusion between multispectral images and panchromatic images. In order to enhance the result image's spatial resolution with preserving spectral information, research on algorithms is developed in next chapters.
This dissertation firstly studies the cardinal concepts and theories of multisensor data fusion (information fusion). At the same time, this paper introduces steps and procedures of pretreatment in remote sensing image fusion. Afterwards, the paper systematically research the techniques used in pixel-level image fusion and four traditional algorithms (IHS, YIQ, PCA, HPF). Based on making out evaluation criteria of result image in impersonality and personality, merits and demerits of algorithms on multi-band image fusion are discussed. At the same time, HPF(high pass filter) method is compared with wavelet method among single-band image fusion methods. Author stresses the research on the details of algorithm based on wavelet transform, and gets such fresh ideas as:
1. This paper puts forward a new measurement based on feature product. Feature product was defined with feature moments of the wavelet coefficients with high frequency component under different resolutions, based on transform of IHS and wavelet multiresolution analysis.
2. Based on the measurement of feature product, a new idea that additive select fusion take the place of select fusion is introduced.
3. According to the local feature product and the new idea ,a new pixel-level image fusion algorithm is produced.
At last, computer simulations of image fusion are carried out by a group of multispectal images and panchromatic images. Compared with the result of IHS , HPF traditional fusion methods and the normalized correlation moment method, it is proved the validity of this method ,which can improve spatial resolution of the result images with preserving spectral information.
引文
1. Hall D L, Llinas J. An introduction to multisensor data fusion[J]. Proceedings of the IEEE, 1997, 85(1):6～23.
2. Wald L. Some terms of reference in data fusion[J]. IEEE Transactions on Geoscience and Remote Sensing, 1999, 37(3): 1190～1193.
3．康耀红．数据融合理论与应用[M]．西安：西安电子科技大学出版社，1997．11．
4．唐文彬．基于多传感器数据融合的目标识别研究[D]．西北工业大学硕士学位论文．1998．2．
5．刘晓龙．多源遥感图象信息保持型融合技术的研究[J]．中国图象图形学报，2001，6(7)：636～641．
6．张永生．遥感图象信息系统[M]．北京：科学出版社，2000．4．
7．王小睿、吴信才．遥感多图象的自动配准方法[J]．中国图象图象学报，1997，2(10)：733～739．
8. F Sunar, N Musaoglu. Merging multiresolution SPOT P and Landsat TM data:the effects and advantages[J]. INT. J. Remote Sensing, 1998, 19(2):219～224.
9. Z Mao, D Pan, H Huang and W Huang. Automatic registration of SeaWiFS and AVHRR imagery[J]. INT. J. Remote Sensing,2001,22(9): 1725～1735.
10．郭骜，基于多传感器数据融合的目标识别研究[D]．西北工业大学硕士学位论文．2000．2．
11．张斌、朱正中、葛成辉、吴佑寿．一种基于边缘轮廓信息的多源遥感图象子象素匹配定位方法[J]．中国图象图形学报,2000,5(10)：830～835．
12．朱述龙、张占睦．遥感图象获取与分析[M]．北京：科学出版社，2000．4．
13. K R Castleman. Digital image processing[M]. Newsey: Prentice Hall Press, 1996.
14．赵荣椿、赵忠明、崔甦生．数字图象处理导论[M]．西安：西北工业大学出版社，1996．7．
15．容观澳．计算机图象处理[M]．北京：清华大学出版社，2000．2．
16．贾永红，李德仁，孙家柄，刘继林．四种IHS变换用于SAR与 TM 影象复合比较[J]．遥感学报，1998，2(2)：103～106．
17. C Pohl, J L Van Genderen. Multisensor image fusion in remote sensing: concepts, methods and applications[J]. INT. J. Remote Sensing, 1998, 19(5):823～854.
18．杨炬，梁继民，杨万海，裴继红．基于进化策略和HIS变换的图象融合方法[J]．电子学报，2001，29(10)：1388～1391．
19. Te-Min Tu, Shun-Chi Su, Hsuen-Chyun shyu, Ping ShengHuang. Efficient intensity hue saturation based image fusion with saturation compensation[J]. Optical Engineering, 2001: 40(5), 720～728.
20. J Zhou, D L Civco, J A Silander. A wavelet transform method to merge Landsat TM and SPOT panchromatic data[J]. INT. J. Remote Sensing, 1998, 19(4):743～757.
21. LIU JIAN GUO, J McM.MOORE and J D HAIGH. Simulated reflelctance technique for ATM image enchancement[J]. INT.J.Remote Sensing,1997, 18(2):243～254.
22. Scheunders P, De Backer S. Fusion and merging of multispectral images using multiscale fundamental forms[J]. Journal of the Optical Society of America A, 18 (10), 2001: 2468～2477.
23．王建，鲁安新，郭庭天，苗春．Brovey图象融合在引大灌区土地覆盖调查中的应用[J]．遥感技术与应用，2001，16(3)，173～177．
24．陈得超，周海波，陈中原，吴健平．TM与SPOT影象融合算法比较研究[J]．遥感技术与应用，2001，16(2)，110～115．
25. E.Ricchetti. Visible-infrared and radar imagery fusion for geological application:a new approach using DEM and sun-illumination model[J]. INT.J. Remote Sensing,2001, 22(11):2219～2230.
26. E.Ricchetti. Visible-infrared and radar imagery fusion for geological application:a new approach using DEM and sun-illumination model[J]. INT.J. Remote Sensing,2001, 22(11):2219～2230.
27. Zhang Y. A new merging method and its spectral and spatial effects[J] . INT. J. Remote Sensing, 1999, 20(10):2003～2014.
28．孙家柄，刘继林，李军．多源遥感影象融合[J]．遥感学报，1998，2(1)：47～50．
29．刘晓龙．多源遥感图象信息保持型融合技术的研究[J]．中国图象图形学报，2001，6(7)，636～641．
30. John C P. Combining multispectral data of differing spatial resolution[J]. IEEE Transactions on Geoscience and Remote Sensing,1999,37 (3): 1199～1203.
31. Liu JianGuo. Balance contrast enhancement technique and its application in image colour composition. INT.J. Remote Sensing, 1991, 12(10):2133～2151.
32．金剑秋，王章野，江照意，彭却生．多光谱图象的真实感融合[J]．中国图象图形学报，2002，7(9)，926～931．
33. S G Mallat. A Theory for Multiresolution Signal Decomposition: The Wavelet Representation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1989,11(7): 674～698.
34. Scheunders P, De Backer S. Fusion and merging of multispectral images using multiscale fundamental forms[J]. Journal of the Optical Society of America A, 18 (10), 2001: 2468～2477.
35. Scheunders P, De Backer S. Multispectral image fusion and merging using multiscale fundamental forms[J]. Proc. ICIP01, IEEE International Conference on Image Processing, Thessaloniki, Greece, Ⅰ, 2001:902～905.
36．王文杰，唐娉，朱重光．一种基于小波变换的图象融合算法[J]．中国图象图形学报，2001，6(11)，1131～1134．
37．浦恬，方庆喆，倪国强．基于对比度的多分辨率图象融合[J]．电子学报，2000，18(12)，116～118．
38．朱常青，王倩，杨晓梅．基于多进制小波的SPOT全色影象和多光谱遥感影象融合[J]．测绘学报，2000，29(20)，132～136．
39. D A Yocky. Image merging and data fusion by means of the discrete two-dimensional wavelet transform[J]. J. Opt. Soc. Am. 1995, A, 12(9), 1834～1841.
40．李军，林宗坚．基于特征的遥感影象数据融合方法[J]．中国图象图形学报，1997，2(2、3)：103～107．
41. B GarguetDuport. The use of multiresolution analysis and wavelets transform for merging spot panchromatic and multispectral image data[J]. PE&RS, 1996,62(9): 1057～1066.
42．何国金，李克鲁，胡德永，从柏林，张震华．多卫星遥感数据的信息融合：理论、方法与实践[J]．中国图象图形学报，1999，4(9)：744～750．
43. Wald L, Ranchin T, Mangolini M. Fusion of satellite images of different spatial resolution: Assessing the quality of resulting images[J] PE&RS, 1997,63(6):691～699.
44. J Nunez, X Otazu, O Fors, A Prades, V Pala, R Arbiol. Multiresolutionbased image fusion with additive wavelet decomposition[J]. IEEE Transactions on Geoscience and Remote Sensing, 1999,37(3): 1204～1211.
45．李军，周月琴，李德仁．小波变换用于高分辨率全色影象与多光谱影象的融合研究[J]．遥感学报，1999，3(2)：116～122．
46．彭玉华．小波变换与工程应用[M]．北京：科学出版社，1999．
47．程正兴．小波分析算法与应用[M]．西安：西安交通大学出版社，1997．
48．谷延锋、张晔、张俊萍．基于归一化矩的多分辨率遥感图象融合[J]．中国图象图形学报，2002，7(11)：1220～1224．
49. J Nunez, X Otazu, O Fors, A Prades, V Pala, and R Arbiol. Multiresolutionbased image fusion with additive wavelet decomposition[J]. IEEE Transactions on Geoscience and Remote Sensing, 1999, 37(3):1204～1211.
2. Wald L. Some terms of reference in data fusion[J]. IEEE Transactions on Geoscience and Remote Sensing, 1999, 37(3): 1190～1193.
3．康耀红．数据融合理论与应用[M]．西安：西安电子科技大学出版社，1997．11．
4．唐文彬．基于多传感器数据融合的目标识别研究[D]．西北工业大学硕士学位论文．1998．2．
5．刘晓龙．多源遥感图象信息保持型融合技术的研究[J]．中国图象图形学报，2001，6(7)：636～641．
6．张永生．遥感图象信息系统[M]．北京：科学出版社，2000．4．
7．王小睿、吴信才．遥感多图象的自动配准方法[J]．中国图象图象学报，1997，2(10)：733～739．
8. F Sunar, N Musaoglu. Merging multiresolution SPOT P and Landsat TM data:the effects and advantages[J]. INT. J. Remote Sensing, 1998, 19(2):219～224.
9. Z Mao, D Pan, H Huang and W Huang. Automatic registration of SeaWiFS and AVHRR imagery[J]. INT. J. Remote Sensing,2001,22(9): 1725～1735.
10．郭骜，基于多传感器数据融合的目标识别研究[D]．西北工业大学硕士学位论文．2000．2．
11．张斌、朱正中、葛成辉、吴佑寿．一种基于边缘轮廓信息的多源遥感图象子象素匹配定位方法[J]．中国图象图形学报,2000,5(10)：830～835．
12．朱述龙、张占睦．遥感图象获取与分析[M]．北京：科学出版社，2000．4．
13. K R Castleman. Digital image processing[M]. Newsey: Prentice Hall Press, 1996.
14．赵荣椿、赵忠明、崔甦生．数字图象处理导论[M]．西安：西北工业大学出版社，1996．7．
15．容观澳．计算机图象处理[M]．北京：清华大学出版社，2000．2．
16．贾永红，李德仁，孙家柄，刘继林．四种IHS变换用于SAR与 TM 影象复合比较[J]．遥感学报，1998，2(2)：103～106．
17. C Pohl, J L Van Genderen. Multisensor image fusion in remote sensing: concepts, methods and applications[J]. INT. J. Remote Sensing, 1998, 19(5):823～854.
18．杨炬，梁继民，杨万海，裴继红．基于进化策略和HIS变换的图象融合方法[J]．电子学报，2001，29(10)：1388～1391．
19. Te-Min Tu, Shun-Chi Su, Hsuen-Chyun shyu, Ping ShengHuang. Efficient intensity hue saturation based image fusion with saturation compensation[J]. Optical Engineering, 2001: 40(5), 720～728.
20. J Zhou, D L Civco, J A Silander. A wavelet transform method to merge Landsat TM and SPOT panchromatic data[J]. INT. J. Remote Sensing, 1998, 19(4):743～757.
21. LIU JIAN GUO, J McM.MOORE and J D HAIGH. Simulated reflelctance technique for ATM image enchancement[J]. INT.J.Remote Sensing,1997, 18(2):243～254.
22. Scheunders P, De Backer S. Fusion and merging of multispectral images using multiscale fundamental forms[J]. Journal of the Optical Society of America A, 18 (10), 2001: 2468～2477.
23．王建，鲁安新，郭庭天，苗春．Brovey图象融合在引大灌区土地覆盖调查中的应用[J]．遥感技术与应用，2001，16(3)，173～177．
24．陈得超，周海波，陈中原，吴健平．TM与SPOT影象融合算法比较研究[J]．遥感技术与应用，2001，16(2)，110～115．
25. E.Ricchetti. Visible-infrared and radar imagery fusion for geological application:a new approach using DEM and sun-illumination model[J]. INT.J. Remote Sensing,2001, 22(11):2219～2230.
26. E.Ricchetti. Visible-infrared and radar imagery fusion for geological application:a new approach using DEM and sun-illumination model[J]. INT.J. Remote Sensing,2001, 22(11):2219～2230.
27. Zhang Y. A new merging method and its spectral and spatial effects[J] . INT. J. Remote Sensing, 1999, 20(10):2003～2014.
28．孙家柄，刘继林，李军．多源遥感影象融合[J]．遥感学报，1998，2(1)：47～50．
29．刘晓龙．多源遥感图象信息保持型融合技术的研究[J]．中国图象图形学报，2001，6(7)，636～641．
30. John C P. Combining multispectral data of differing spatial resolution[J]. IEEE Transactions on Geoscience and Remote Sensing,1999,37 (3): 1199～1203.
31. Liu JianGuo. Balance contrast enhancement technique and its application in image colour composition. INT.J. Remote Sensing, 1991, 12(10):2133～2151.
32．金剑秋，王章野，江照意，彭却生．多光谱图象的真实感融合[J]．中国图象图形学报，2002，7(9)，926～931．
33. S G Mallat. A Theory for Multiresolution Signal Decomposition: The Wavelet Representation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1989,11(7): 674～698.
34. Scheunders P, De Backer S. Fusion and merging of multispectral images using multiscale fundamental forms[J]. Journal of the Optical Society of America A, 18 (10), 2001: 2468～2477.
35. Scheunders P, De Backer S. Multispectral image fusion and merging using multiscale fundamental forms[J]. Proc. ICIP01, IEEE International Conference on Image Processing, Thessaloniki, Greece, Ⅰ, 2001:902～905.
36．王文杰，唐娉，朱重光．一种基于小波变换的图象融合算法[J]．中国图象图形学报，2001，6(11)，1131～1134．
37．浦恬，方庆喆，倪国强．基于对比度的多分辨率图象融合[J]．电子学报，2000，18(12)，116～118．
38．朱常青，王倩，杨晓梅．基于多进制小波的SPOT全色影象和多光谱遥感影象融合[J]．测绘学报，2000，29(20)，132～136．
39. D A Yocky. Image merging and data fusion by means of the discrete two-dimensional wavelet transform[J]. J. Opt. Soc. Am. 1995, A, 12(9), 1834～1841.
40．李军，林宗坚．基于特征的遥感影象数据融合方法[J]．中国图象图形学报，1997，2(2、3)：103～107．
41. B GarguetDuport. The use of multiresolution analysis and wavelets transform for merging spot panchromatic and multispectral image data[J]. PE&RS, 1996,62(9): 1057～1066.
42．何国金，李克鲁，胡德永，从柏林，张震华．多卫星遥感数据的信息融合：理论、方法与实践[J]．中国图象图形学报，1999，4(9)：744～750．
43. Wald L, Ranchin T, Mangolini M. Fusion of satellite images of different spatial resolution: Assessing the quality of resulting images[J] PE&RS, 1997,63(6):691～699.
44. J Nunez, X Otazu, O Fors, A Prades, V Pala, R Arbiol. Multiresolutionbased image fusion with additive wavelet decomposition[J]. IEEE Transactions on Geoscience and Remote Sensing, 1999,37(3): 1204～1211.
45．李军，周月琴，李德仁．小波变换用于高分辨率全色影象与多光谱影象的融合研究[J]．遥感学报，1999，3(2)：116～122．
46．彭玉华．小波变换与工程应用[M]．北京：科学出版社，1999．
47．程正兴．小波分析算法与应用[M]．西安：西安交通大学出版社，1997．
48．谷延锋、张晔、张俊萍．基于归一化矩的多分辨率遥感图象融合[J]．中国图象图形学报，2002，7(11)：1220～1224．
49. J Nunez, X Otazu, O Fors, A Prades, V Pala, and R Arbiol. Multiresolutionbased image fusion with additive wavelet decomposition[J]. IEEE Transactions on Geoscience and Remote Sensing, 1999, 37(3):1204～1211.