眼底图像融合的研究及系统实现
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
眼底图像融合是将对取自不同时间、不同传感器或不同视角的关于眼底图像或者图像序列加以综合的过程。由于眼底图像在眼科是一个客观、标准的诊断方法,图像融合技术在眼底图像中的应用可提供更强的信息解译能力,对分析和记录各种眼睛疾病及其发展有非常重要的作用。
     图像融合过程可分为三个阶段:图像预处理、图像配准与图像融合,各阶段的处理算法很多,目前还没有适用于所有图像的方法,往往需要根据图像本身特征,在处理过程中尽量找到在准确性、速度和鲁棒性上平衡的方案。基于此,本文采用层层递进的结构,在预处理阶段着重考虑了眼底血管的增强问题,提出了基于Hessian矩阵的血管增强方案;考虑到优化算法对图像配准有重要的影响,在配准阶段,本文提出了基于互信息和PSO-NMS的图像配准方案;在融合部分,主要关注基于小波的融合方法,提出了一种基于空间频率和区域最大值的小波变换融合方法,同时整合了眼底图像融合的全过程方案,并将该方案应用到眼底图像融合系统的实现中,以此证明本文方案的实用性。本文具体工作如下:
     ①阐述了图像融合的定义、理论、方法及流程,分别从图像融合处理阶段、配准阶段、融合阶段阐明其中的关键步骤对融合结果的影响,并介绍了当前主要的图像增强、配准及融合方法。
     ②分别在融合的三个阶段提出了针对眼底图像的解决方案。在预处理阶段,为保留眼底图像中血管结构信息,同时降低图像配准的计算复杂度,本文在介绍了几种常见的眼底图像增强方法基础上,提出了一种基于Hessian矩阵的血管增强方法,加上图像校正和平滑,形成眼底图像融合的预处理方案。在配准阶段,重点介绍了基于互信息的相似性测度,以及用于求解复杂问题的粒子群优化算法及其改进,在此基础上,本文应用了一种单纯形法结合粒子群算法的混合优化算法来求解变换参数。结合配准框架,形成了系统的配准方案。在融合阶段,重点介绍了基于小波的图像融合方法,并详细叙述了小波分解和重构过程,在此基础上,本文提出了一种基于空间频率和区域最大值的小波融合方案。
     ③综合预处理、图像配准与融合三个阶段的处理方案,提出了一套眼底图像融合的整体方案。在此基础上形成了眼底图像融合的基本系统架构及功能模,并根据本文所设计的图像融合方案和步骤,开发了一个基于Visual C++的眼底图像融合系统。
Fundus image fusion is a process of integrating the fundus images taken by different sensors or perspectives from the same patient. Since the fundus image is an objective and standard diagnostic tool in ophthalmology, the application of image fusion technology in the fundus image can provide better capacity of information interpretation, which takes a very important role in analyzing and recording of all kinds of eye diseases and their progression.
     The process of image fusion can generally be summarized as three phases: image pre-processing, image registration and image fusion. There are various algorithms for each stage, however, the method of best applicability has not been found yet. It usually needs to consider about the characteristics of the image itself and try to find the best solution on the balance of accuracy, robustness and low time consuming. Therefore, this thesis is written with a progressive structure: In the phase of pre-processing, we focus on the retinal blood vessel enhancement, and a new approach to vascular enhancement based on Hessian matrix is proposed. In the registration phase, this thesis proposes an image registration scheme based on mutual information and the PSO-NMS optimization algorithm. As for the fusion phase, we focus on the wavelet-based image fusion method, and describe the wavelet decomposition and reconstruction process of image in detail, and furthermore, we propose a wavelet-based image fusion scheme using spatial frequency and regional maximum. The proposed schemes are applied in the implementation of a system for fundus image fusion, which would prove the practicality of our proposed schemes.
     Specific work of this thesis is described as follows:
     ①Introduce the definition, theory and methods of image fusion, and explain several essential steps that illustrate results of fusion. Discuss the current methods for image enhancement, registration and fusion.
     ②Solution schemes of fundus image fusion have been proposed respectively in the three phases of image fusion. At the pre-processing phase, in order to preserve the structure information of retinal blood vessels, while reducing the computational complexity of the image, this thesis proposes an approach to vascular enhancement based on Hessian matrix after introduce several common image enhancement methods. Adding to image smoothing and correction, the pre-processing of fundus image is presented. In the registration phase, after introduce similarity measure based on mutual information and improved particle swarm optimization algorithm for complex problems solving, a hybrid PSO combined with simplex method is used to solve the transformation parameters, and furthermore, a registration scheme has been formed based on the registration framework. The fusion phase of this thesis is focusing on the wavelet-based image fusion methods and a wavelet-based fusion scheme using spatial frequency and regional maximum for fundus image is presented after detailed descriptions of the wavelet decomposition and reconstruction is introduced.
     ③Composing the three solution schemes of preprocessing, image registration and fusion, we present an overall scheme for fundus image fusion, which forms the basic system structure and function modules of a system. Therefore, we developed a fundus image fusion system according to the proposed schemes.
引文
[1]阮春,李月卿,王昌元.医学图像融合技术及其应用研究概况[J].医学影像学杂志, 2001, 11(6):408-410
    [2]章鲁,陈瑛,顾顺德.医学图像处理与分析[M] .上海.上海科学技术出版社, 2006,15-16.
    [3]罗述谦,周国宏.医学图像处理与分析[M].北京.科学出版社,2003, 45-46.
    [4]王晓幸,王勤美,包含飞.眼科信息学的发展概述[J].中华眼科杂志, 2006, 42(5). 476-480.
    [5]刘家琦,李凤敏.实用眼科学[M].北京.人民卫生出版社, 2005, 56-60.
    [6]张承芬,刘熙朴.我国眼底病临床和研究工作的现状及发展趋势[J].中华眼科杂志, 2002, 38 (3). 129-131.
    [7]张承芬.眼底病学[M].北京.人民卫生出版社, 1998, 125-130.
    [8]李居朋.眼底图像处理与分析中一些关键问题的研究[D].北京:北京交通大学, 2009.
    [9]陈有信,张承芬.眼底血管造影设备及技术概论[J].继续医学教育, 2006, 20 (21):71-84.
    [10]敬忠良,肖刚,李振华.图像融合:理论与应用[M].北京.高等教育出版社, 2007, 30-32.
    [11]孙玉秋,田金文,柳健等.基于图像金字塔的分维融合算法[J].计算机应用, 2005, 25 (5).
    [12]李鲲鹏.图像融合技术在多领域的广泛应用和发展前景[J].太原科技, 2008, 177 (10).
    [13]尹秉坤.多传感器遥感图像信息融合算法研究[D].武汉:武汉科技大学, 2007.
    [14]陈高.基于特征与灰度的医学图像配准方法[D].厦门:厦门大学, 2009.
    [15]胡钢,刘哲,徐小平.像素级图像融合技术的研究与进展[J].计算机应用研究, 2008,25 (3):650-655.
    [16]王静云,李绍林.医学影像图像融合技术的新进展[J].第四军医大学学报, 2004, 25 (20):1918-1919.
    [17] Macii D,Boni A,De Cecco M. Tutorial 14: multisensor data fusion [J]. IEEE Instrumentation & Measurement Magazine, 2008, 11(3):24-33.
    [18] Chris J, Qiang Gan. State estimation and multi-sensor data fusion using data-based neurofuzzy local linearisation process models. Information Fusion[J].2001.2(1):17-29.
    [19] David L H, Sonya A H.Mathematical Techniques in Multisensor Data Fusion[M].Artech House Inc.Norwood,MA,USA,1992.
    [20] Peli E,Augliere R A,Timberlake G T.Feature-Based Registration of Retinal Images[J].IEEE Transactions on Medical Imaging,1987,6(1):74-81.
    [21] Yitao Liang,Lianlian He,Chao Fan,Feng Wang,Wei Li.Preprocessing study of retinal image based on component extraction[C].IEEE International Symposium on IT in Medicine and Education(ITME),2008,670-672.
    [22] Elena Martinez-Perez M.:Retinal Blood Vessel Segmentation [Z]. http://turing.iimas.unam.mx/
    [23]黄淑英.视网膜图像处理与分析中关键技术研究[D].西安:西安理工大学, 2005.
    [24] Otsu N. A Threshold Selection Method from Gray-Level Histograms[J]. IEEE Transactions on Systems, Man and Cybernetics, 1979, 9(1):62-66.
    [25]冈萨雷斯.数字图像处理(MATLAB版)[M].北京.电子工业出版社, 2005.
    [26]胡小峰,赵辉.图像处理与识别实用案例精选[M].北京.人民邮电出版社, 2004.58-65.
    [27]周海林,王立琦.光学图象几何畸变的快速校正算法[J].中国图象图形学报A辑, 2003, 8(10) :1131-1135.
    [28] Donoho D L. De-noising by soft-thresholding[J]. IEEE Transactions on Information Theory, 1995, 41(3):613-627.
    [29] Astola J, Haavisto P, Neuvo Y. Vector median filter [J]. Proceedings of the IEEE, 1990, 78(4):678-689.
    [30] Wiener N. Extrapolation, Interpolation, and Smoothing of Stationary Time Series[M]. The MIT Press, 1964.
    [31] Du Y P, Parker D L.Vessel enhancement filtering in three dimensional MR angiography[J]. Journal of Magnetic Resonance Imaging, 1995, 5(3):353-359.
    [32] Orkisz M M. Improved vessel visualization in MR angiography by nonlinear anisotropic filtering[J]. Magnetic Resonance in Medicine, 1997, 37(6):914-918.
    [33] Frangi A F, Niessen W J, Vincken K L. Multiscale vessel enhancement filtering[C]. Medical Image Computing and Computer-Assisted Intervention. MA,USA: Lecture Notes in Computer Science,1998,1496:130-137.
    [34] Press W H. The Art of Scientific Computing[M]. UK: Cambridge University Press, 1986, 498-546.
    [35] Lorenz C, Carlsen I, Buzug T M. Multi-scale line segmentation with automatic estimation of width, contrast and tangential direction in 2D and 3D medical images[C].CVRMed-MRCAS. France: Lecture Notes in Computer Science, 1997, 1205: 233-242.
    [36]郭薇,魏颖,周翰逊,薛定宇.基于Hessian矩阵及梯度熵的疑似肺结节检测算法[J].仪器仪表学报,2009,30(8):1702-1706.
    [37] Staal J J,Abramoff M D, Niemeijer M A, et a1.Ridge based vessel segmentation in color images of the retina[J].IEEE Transactions on Medical Imaging,2004, 23(4): 501-509.
    [38] Viergever M, Luijten P. DRIVE: Digital Retinal Images for Vessel Extraction [Z]. http://www.isi.uu.nl/Research/Databases/DRIVE/.
    [39] Hooshyar S, KHAYATI R. Retina Vessel Detection Using Fuzzy Ant Colony Algorithm[C]. CRV.Ottawa,Canada:2010 Canadian Conference on Computer and Robot Vision,2010,10(1109):239-244.
    [40] Niemeijer M, STAAL J, GINNEKEN B, LOOG M A. Comparative study of retinal vessel segmentation methods on a new publicly available database[C].Medical Imaging 2004: Image Processing. San Diego, USA: SPIE Medical Imaging, 2004, 5370:648-656.
    [41] Zana F, Klein J. Segmentation of vessel-like patterns using mathematical morphology and curvature evaluation[J]. IEEE Transactions on Image Processing, 2001,10(7):1010-1019.
    [42] Al-Diri B, Hunter A, Steel D. An active contour model for segmenting and measuring retinal vessels[J].IEEE Transactions on Medical Imaging, 2009, 28(9):1488-97.
    [43] Martinez-Perez M E,Hughes A D,Stanton A V. Scale-space analysis for the characterization of retinal blood vessels[C]. Proceedings on Medical Image Understanding and Analysis, Oxford: Medical Image Computing and Computer-Assisted Intervention, 1999:90-97.
    [44] Chaudhuri S, Chatterjee S, Katz N, Nelson M, Goldbaum M. Detection of blood vessels in retinal images using two-dimensional matched filters[J].IEEE Transactions on Medical Imaging,1989,8(3):263-269.
    [45]宋余庆.数字医学图像[M].北京:清华大学出版社,2008.
    [46]章鲁,陈瑛,顾顺德.医学图像处理与分析[M].上海:上海科学技术出版社, 2006.
    [47] Barbara Z, Jan F. Image registration methods: a survey[J]. Image and Vision Computing. 2003, 21(11): 977-1000.
    [48]冯林,严亮,贺明峰等.图像配准中确定性扰动PV插值算法[J].计算机辅助设计与图形学学报, 2005, 17 (5):908-915.
    [49] Jeffrey T. Interpolation artifacts in multimodality image registration based on maximization of mutual information[J].IEEE transactions on medical imaging,2003,22(7):854-864.
    [50] Mark H, Derek L G, Erika R E. Voxel Similarity Measures for 3D Serial MR Brain Image Registration[C].Lecture Notes in Computer Science on Information Processing in Medical Imaging(IPMI),1999,1613:472-477.
    [51]胡旺.图像融合中的关键技术研究[D].四川:四川大学,2006.
    [52] Shannon C E. A mathematical theory of communication [J], Bell System Technical Journal,1948,27:379-423.
    [53] MRI-PET Registration with Automated Algorithm[J]. Journal of Computer Assisted Tomography, 1993, 17(4): 536-546.
    [54] Studholme C, Hill D L,Hawkes D J.Automated 3-D registration of MR and CT images of the head[J].MedicalImage Analysis,1996,1(2),163-175.
    [55]冯婷.改进的粒子群优化算法(PSO)及其在医学图像配准中的应用[D].上海:上海交通大学:2008.
    [56] Kennedy J, Eberhart R. Particle swarm optimization[C]. IEEE International Conference on Neural Networks. Piscataway : IEEE Press, 1995: 1942-1948.
    [57] Fischer D, Kohlhepp P, Bulling F. An evolutionary algorithm for the registration of 3D surface representations[J]. Pattern Recognition, 1999, 32(3):53-69.
    [58] Lovbjerg M, Rasmuwsen T K, Krink T. Hybrid Particle Swarm Optimiser with Breeding and Subpopulations[C].In: Proc of the third Genetic and Evolution Computation Conference,2001.
    [59] Angeline P J. Using Selection to Improve Particle Swarm Optimization[C]. Proceedings of the1999 Congress on Evolutionary Computation. Piscataway, NJ: IEEE Press, 1999:84-89.
    [60] Jens Gimmler, Thomas Stützle ,Thomas E. Exner. Hybrid Particle Swarm Optimization: An Examination of the Influence of Iterative Improvement Algorithms on Performance[C]. Lecture Notes in Computer Science.2006, 4150: 436-443.
    [61] Nelder J A, Mead R. A simplex method for function minimization[J]. Computer Journal. 1965, 7 :308–313.
    [62] Fan SKS, Zahara E. A hybrid simplex search and particle swarm optimization for unconstrained optimization[J]. European Journal of Operational Research, 2007, 181(2):527-548.
    [63] Liu, Dong C. On the limited memory BFGS method for large scale optimization[J]. Math Program Ser B.1989, 45(3): 503-528.
    [64]秦云霞.图像融合算法研究[D],兰州:兰州大学, 2010.
    [65]贺文飞.像素级图像融合技术研究[D],湖南:国防科技大学, 2006.
    [66] Toet A, Sehoumans N, Ijspeert J K. Perceptual Evaluation of Different Nighttime Imaging Modalities[C].Proceedings of the 3rd International Conference on Information Fusion.Paris,2000.
    [67] Burt P J, Adelson E H. The Laplacian Pyramid as a Compact Image Code[J].IEEE Transactions on Communications,31(4):1983,532-540.
    [68] Toet A, Valeton J M,van Ruyven L J.Merging thermal and visual images by a contrast pyramid[J].Optical Engineering,1989,7(28):789-792.
    [69] Toet, A,Ijspeert J K. Fusion of visible and thermal imagery improves situational awareness[C].In Processing of SPIE on Enhanced and Synthetic vision,1997,3088:177-188
    [70] Mallat S G. A theory for multi-resolution signal decomposition: the wavelet representation[J]. Pattern Analysis and Machine Intelligence.1989,11(7).674-693.
    [71] Yocky D A. Image merging and data fusion by means of the discrete two-dimensional wavelet transform[J]. Journal of the Optical Society of America.1995,12(9):1834-1841.
    [72]周兰花,周付根.基于小波变换极大模的多模医学图像融合[J].中国体视学与图像分析.2003,8(4): 225-228.
    [73] Mallat S G. Multi-frequency channel decomposition of images and wavelet models [J]. IEEE Transaction and Acoustics, Speech and Signal Processing.1989, 37(12):2091-2110.
    [74] Lallier E,arooq M.A real time pixel-level based image fusion via adaptive weight averaging[C],Proceedings of the Third International Conference on Information Fusion(FUSION 2000),2000.
    [75] Burt P J, Kolczynski R J. Enhanced image capture through fusion[C].Fourth International Conference on Computer Vision, 1993.
    [76] Daubechies I, Teschke G. Variational image restoration by means of wavelets: Simultaneous decomposition, deblurring,and denoising. Applied and Computational Harmonic Analysis [J].2005, 19(1):1-16.
    [77] Chunhua Guo, Tongqing Wang, Junyong Ye, Liang Lei. Retinal Image Fusion Based on Lifting Wavelet Transform[C]. 7th World Congress on Intelligent Control and Automatio(WCICA 2008), 2008:8511-8515.
    [78] Trolltech ASA. Qt 4.2白皮书[Z]. http://qtcn.org/bbs/read.php?tid=18573.
    [79] Daniel Molkentin. The Book of Qt 4:The art of building Qt applications[M].No Starch Press,2007.
    [80]潘爱民.COM原理与应用[M].北京:清华大学出版社,2001.
    [81]邹劲松.基于Windows Media Foundation的播放器实现[J].电子科技,2008:21(12):61-63.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700