构件内部裂缝缺陷的三维重建算法研究
|
摘要
借助计算机断层扫描技术可以很容易得到一系列含有内部缺陷信息的二维图像,在某些应用方面具有很大的局限性,因为它需要借助相关工程人员的空间想象以及经验来判断内部缺陷的三维形态。在实际应用中为进一步精确确定内部缺陷的密度分布、形状、空间位置以及尺寸等信息,需要将这些断层图像重建为三维模型。本文以此为背景,对重要构件内部裂缝缺陷断层图像的三维重建算法进行比较细致的研究。
首先,针对传统表面重建未考虑相邻切片图像信息的关联性,提出了特征跟踪的表面重建算法。区域预测、区域变形和表面绘制是实现裂缝缺陷快速重建的关键。预测是根据当前切片图像区域对下一个切片图像的区域进行预估。由于预测的结果和实际区域不一致采用区域变形技术得到实际的区域。最后对得到的区域进行表面绘制完成三维重建。本算法在很大程度上减少不必要的检测,为大规模数据三维重建提供可能,尤其是裂缝区域只占整个体数据中很少一部分。
其次,针对目前大部分表面重建方法无法得到缺陷内部信息的缺点,提出了一种新的基于有限元网格的方法,首先通过图像分割实现裂缝区域体素的提取,然后对生成的体素进行网格的构建,最后通过平滑处理消除网格之间存在的阶梯状界面,实现了缺陷表面及内部的重建。
最后,借助OpenGL函数对重建的物体进行三维显示,并构建出重建系统的整体框架,定义若干个核心的类。该重建系统提供了OpenGL支持的三维显示界面、二维图像预处理结果的显示界面以及所有断层图像预览的显示界面等。
A series of 2D images which comprise the internal defect information can be obtained with CT scan easily, In some applications, this technology has significant limitations, because it needs the space-related imagination and experience of engineer to determine the three dimensional shape of internal defects. In practice, further precise determination of the density distribution within the defect, shape, spatial position, size and other information, you will need three-dimensional model of these slices images. This paper takes this as a background and carries on a series of research for the 3D reconstruction algorithm of slice-images for internal crack defect of important component systematically.
Firstly, due to traditional surface reconstruction does not consider the relevance of adjacent slice images, we propose the surface reconstruction algorithm using feature tracking. Regional prediction, regional deformation and surface rendering are the key to the reconstruction of crak defect. Prediction is intended to estimate the region of following slice images based on the current image. Due to the difference between the predicted region and the actual region we can get the actual region through region morphing. Finally, the region is applied surface rendering to complete the Three-dimensional reconstruction. The algorithm can reduce unnecessary testing, and make the three-dimensional reconstruction of large-scale data possible especially when the crack region is a fraction of the entire body of data.
Secondly, as most of current surface reconstruction methods can not obtain the inner information of defect, we propose a new method based on finite element mesh. The first step, extract the voxels of crack regions through image segmentation. Secondly, generate the mesh using the voxels extracted from the last step. Finally eliminate the jagged interfaces through surface smoothing. Thus, we can reconstruct the whole cracks, including surface and internal.
Finally, reconstruction object is displayed by OpenGL. This paper constructs the whole framework of system, and defines some pivotal classes. The reconstruction System provides several browser windows, including, OpenGL support for the 3D interface, 2D images preprocessing interface, displaying all slice-images interface.
首先,针对传统表面重建未考虑相邻切片图像信息的关联性,提出了特征跟踪的表面重建算法。区域预测、区域变形和表面绘制是实现裂缝缺陷快速重建的关键。预测是根据当前切片图像区域对下一个切片图像的区域进行预估。由于预测的结果和实际区域不一致采用区域变形技术得到实际的区域。最后对得到的区域进行表面绘制完成三维重建。本算法在很大程度上减少不必要的检测,为大规模数据三维重建提供可能,尤其是裂缝区域只占整个体数据中很少一部分。
其次,针对目前大部分表面重建方法无法得到缺陷内部信息的缺点,提出了一种新的基于有限元网格的方法,首先通过图像分割实现裂缝区域体素的提取,然后对生成的体素进行网格的构建,最后通过平滑处理消除网格之间存在的阶梯状界面,实现了缺陷表面及内部的重建。
最后,借助OpenGL函数对重建的物体进行三维显示,并构建出重建系统的整体框架,定义若干个核心的类。该重建系统提供了OpenGL支持的三维显示界面、二维图像预处理结果的显示界面以及所有断层图像预览的显示界面等。
A series of 2D images which comprise the internal defect information can be obtained with CT scan easily, In some applications, this technology has significant limitations, because it needs the space-related imagination and experience of engineer to determine the three dimensional shape of internal defects. In practice, further precise determination of the density distribution within the defect, shape, spatial position, size and other information, you will need three-dimensional model of these slices images. This paper takes this as a background and carries on a series of research for the 3D reconstruction algorithm of slice-images for internal crack defect of important component systematically.
Firstly, due to traditional surface reconstruction does not consider the relevance of adjacent slice images, we propose the surface reconstruction algorithm using feature tracking. Regional prediction, regional deformation and surface rendering are the key to the reconstruction of crak defect. Prediction is intended to estimate the region of following slice images based on the current image. Due to the difference between the predicted region and the actual region we can get the actual region through region morphing. Finally, the region is applied surface rendering to complete the Three-dimensional reconstruction. The algorithm can reduce unnecessary testing, and make the three-dimensional reconstruction of large-scale data possible especially when the crack region is a fraction of the entire body of data.
Secondly, as most of current surface reconstruction methods can not obtain the inner information of defect, we propose a new method based on finite element mesh. The first step, extract the voxels of crack regions through image segmentation. Secondly, generate the mesh using the voxels extracted from the last step. Finally eliminate the jagged interfaces through surface smoothing. Thus, we can reconstruct the whole cracks, including surface and internal.
Finally, reconstruction object is displayed by OpenGL. This paper constructs the whole framework of system, and defines some pivotal classes. The reconstruction System provides several browser windows, including, OpenGL support for the 3D interface, 2D images preprocessing interface, displaying all slice-images interface.
引文
1程云勇,张定华.一种基于工业CT的航空发动机涡轮叶片生产检测系统关键技术研究.制造技术与机床. 2004,1:27-29
2刘怀喜,张恒,马润香.复合材料无损检测方法.无损检测. 2003,12(25):631-656
3倪培君,王爱华.工业CT技术在卫星产品检测中的应用. 2000年国际CT和三维断面成像理论与应用会议论文集. 2000.9:119-123
4刘松平,郭恩明.复合材料无损检测技术的现状与展望.第13届复合材料国际学术会议. 2001,3:30~32
5 DUAN Li-ming. Method of generating numerical control codes directly based on industrial computed tomography image. Computer Integrated Manufacturing Systems. 2008-07
6 DennisM J. Industrial computed tomography. Metals Handbook(Vol.17 Nondestructive Evaluation and Quality Control)ASMM etals Park, 1989,(3):379-382.
7 Bartscher M., Hilpert, U., Goebbels, J., Weidemann, G. Enhancement and Proof of Accuracy of Industrial Computed Tomography (CT) Measurements, Annals of the CIRP Vol. 56/1/2007, Dresden, Germany, August 2007
8赵俊红,王珏.工CT图像三维重建及剥离显示.无损检测. 2004,26(4):171-176
9陈积懋,张颖.复合材料无损检测的新进展.航空制造技术. 1998,(5):17-19
10徐惠娟,黄启忠.工业CT在C/C复合材料无损检测中的应用.新型碳材料, 1998, 13(2):25-28
11徐丽,张幸红,韩杰才.射线检测在复合材料无损检测中的应用.无损检测,2004.9(24):450-456
12曹玉玲,陈存柱.铸件的工业CT三维检测技术. CT理论与应用研究, 2003, 12(3):36-39
13吴凤和,张晓峰.基于参数域映射及B样条插值的三维重构方法.中国激光, 2007,34(7):977-982
14李扬,郑莹娜.基于极大图像熵的均质材料内部缺陷ICT诊断.机械工程学报,2005,41(11):43-46
15王沫楠,孙立宁.基于CT图像的组织建模与仿真方法.哈尔滨工业大学学报, 2008,40(7):1071-1075
16王璿.基于散乱点数据的三维重建并行实现.燕山大学学报, 2008,32(4):345-350
17 Dastarac D. Industrial computed tomography: control and digitalisation international symposium on computerized tomography for industrial applications and image processing in radiology. Germany Proceedings BB 672CD published by DGZFP[C] , Berlin : 1999.
18 William H Green , Joseph M Wells. Nondestructive Characterization of Impact Damage in Metallic/ Nonmetallic Composites Using X2ray Computed Tomography Imaging.Report Number ARL2TR22399, Weapons and Materials Research Directorate ,US: Army Research Laboratory ,2001.
19 Oster R, Eurocopter, Munich D. Computed tomography as a non-destructive test method for fiber main rotorblades in development, services and maintenance [A]. International Symposium on Computerized Tomography for Industrial Applications and Image Processing in Radiology, Berlin:Germany Proceedings BB 672CD published by DGZFP ,1999.
20 William H Green, Patrick Sincebaugh. Nondestructive evaluation of complex composites using advanced computed tomography (CT) imaging. Report Number ARL2TR2400, Weapons and Materials Research Directorate,US: Army Research Laboratory , 2001.
21王高飞.基ICT的三维重构技术的研究.北京航空航天大学硕士学位论文. 2003:12-35
22林丽华,卢清萍,颜永年.面向RP的CT图像反求技术.计算机辅助设计与制造. 1998,9:48-50
23 Herman G T, Zheng J, Bucho ltz C. Shaped2based interpolation. IEEE CG&A. 1992,12 (3):69-79
24章毓晋.图象分割.北京:科学出版社, 2001:123-135
25林瑶,田捷.医学图像分割方法综述.模式识别与人工智能. 2002,15(2):l92-204.
26 Sahoo P K,Soltani S,Wang A K C.A Survey of Thresholding Techniques.Computer Vision,Graphics and Image Processing. l988,4l(2):233-260
27邱明,张二虎.医学图像分割方法.计算机工程与设计. 2007,26(6):1557~1559
28 S.Z.Li.Markov Random Field Modeling in Computer Vision. Tokyo: Springer Verlag. 1995:25-34
29 Wen-Feng Kuo,Chi-Yuan Linc,Yung-Nien Sun. Brain MR images segmentation using statistical ratio: Mapping between watershed and competitive Hopfield clustering network algorithms. Computer Methods and Programs in Biomedicine. 2008,91(3):191-198
30 Jaime S. Cardoso, Pedro Carvalho,Luís F. Teixeiraa. Partition-distance methods for assessing spatial segmentations of images and videos. Computer Vision and Image Understanding. 2009,113(7):811-823
31 Joe-Air Jiang, Hsiang-Yun Chang, Ke-Han Wu. An adaptive image segmentation algorithm for X-ray quarantine inspection of selected fruits. Computers and Electronics in Agriculture. 2008,60(2):190-200
32 Antonis Daskalakis, Dimitris Glotsos, Spiros Kostopoulos. A comparative study of individual and ensemble majority vote cDNA microarray image segmentation schemes, originating from a spot-adjustable based restoration framework. Computer Methods and Programs in Biomedicine. 2009,95(1):72-88
33 J. Marker, I. Braude, K. Museth, D. Breen, Contour-based surface reconstruction using implicit curve fitting, and distance field filtering and interpolation, in: Proceedings of the International Workshop on Volume Graphics, 2006: 95-102
34 Y. C. Chen, Y. C. Chen, A. S. Chiang, K. S. Hsieh. A reliable surface reconstruction system in biomedicine. Comput Methods Prog Biomed. 2007,86(2):141-152
35 A. Lienhard, O. Greevy and O. Nierstrasz, Tracking objects to detect feature dependencies, Proceedings international conference on program comprehension, IEEE Computer Society, 2007 : 59-68
36 F. Reinders, F. H. Post, H. J. W. Spoelder. Visualization of timedependent data using feature tracking and event detection. In The Visual Computer. 2001,17(1):55-71
37 A. Adam, E. Rivlin, I. Shimshoni and D. Reinitz, Robust real-time unusual event detection using multiple fixed-location monitors, IEEE Transactions on Pattern Analysis and Machine Intelligence 2008. 30(3):555-560.
38 KOLLER D, WEBER J, MALICK J. Robust multiple car tracking with occlusion reasioning. In:Proceedings of the European conference on computer vision. 1994:189-196
39 S. M. Bhandarkar, X. Luo, R. Daniels, E. W. Tollner. A Novel Feature-based Tracking Approach to the Detection, Localization and 3-D Reconstruction of Internal Defects in Hardwood Logs Using Computer Tomography. Pattern Analysis and Applications. 2006,9:155-175
40 F. von Hundelshausen, R. Rojas. Tracking regions and edges by shrinking and growing. In Proceedings of the RoboCup 2003 International Symposium, Padova, Italy. 2003:20-25
41 Rolf Adams, Leanne Bischof. Seeded Region Growing. IEEE Trans .Pattern Anal .Machine Intell. 1994,16(6):641-647
42 Runzhen Huang , Kwan-Liu Ma, RGVis: Region Growing Based Techniques for Volume Visualization, Proceedings of the 11th Pacific Conference on Computer Graphics and Applications, 2006:355-343.
43 William E.Lorsen, Harvey E.Cline. Marching Cubes: a high resolution 3D surface construction algorithm. 1987,21(4):163-169
44何晖光,田捷,赵明昌,杨骅.基于分割的三维医学图像表面重建算法.软件学报. 2002,13(2):219-226
45 Enmark M, Lucas G, Odette GR. An electric potential drop technique for characterizing part-through surface cracks. J Nucl Mater (The Netherlands). 1992:1038-1041
46 Makoto A, Masumi S. Nondestructive sizing of a 3D surface crack generated in a railway component using closely coupled probes for direct-current potential drop technique. Eng Fract Mech. 2005,72:319-334
47 Knight MJ, Brennan FP, Dover WD. Effect of residual stress on ACFM crackmeasurements in drill collar threaded connections. NDT&E Int. 2004,37:337-343
48 Zerwer A, Polak MA, Santamarina JC. Rayleigh wave propagation for the detection of near surface discontinuities: Finite element modeling. Struct Eng. 2001,128: 240-248.
49 Ravichandran AS, Larsen JM. Microstructure and crack-shape effects on the growth behavior of small fatigue cracks in Ti-24Al-11Nb. Mater Sci Eng A. 1992,153:499-507
50 Ballard D., Brown C. Computer Vision. Englewood Cliffs. NJ: Prentice Hall. 1982:21-33
51 Davies E. Machine Vision: Theory, Algorithms and Practicalities. New York: Academic. 1990:120-124
52 Gonzalez Woods RR. Digital Image Processing. Indianapolis, IN: Addison Wesley Publishing. 1992:33-35
53 Schneiders R. A grid-based algorithm for the generation of hexahedral element meshes. Engr Comput. 1996,12:168-177
54任少卿,王明泉,杨静,李志刚.基于工业CT断层图像的三维可视化.中国体视学与图像分析, 2007,(01) .
55黄永丽,宋宝卫.基于OpenGL的三维重构及可视化处理技术.郑州轻工业学院学报. 2008,23(3):60-63
56郭涛,平西建.基于OpenGL的三维地形可视化技术研究.计算机工程与设计. 2008,29(1):193-195
2刘怀喜,张恒,马润香.复合材料无损检测方法.无损检测. 2003,12(25):631-656
3倪培君,王爱华.工业CT技术在卫星产品检测中的应用. 2000年国际CT和三维断面成像理论与应用会议论文集. 2000.9:119-123
4刘松平,郭恩明.复合材料无损检测技术的现状与展望.第13届复合材料国际学术会议. 2001,3:30~32
5 DUAN Li-ming. Method of generating numerical control codes directly based on industrial computed tomography image. Computer Integrated Manufacturing Systems. 2008-07
6 DennisM J. Industrial computed tomography. Metals Handbook(Vol.17 Nondestructive Evaluation and Quality Control)ASMM etals Park, 1989,(3):379-382.
7 Bartscher M., Hilpert, U., Goebbels, J., Weidemann, G. Enhancement and Proof of Accuracy of Industrial Computed Tomography (CT) Measurements, Annals of the CIRP Vol. 56/1/2007, Dresden, Germany, August 2007
8赵俊红,王珏.工CT图像三维重建及剥离显示.无损检测. 2004,26(4):171-176
9陈积懋,张颖.复合材料无损检测的新进展.航空制造技术. 1998,(5):17-19
10徐惠娟,黄启忠.工业CT在C/C复合材料无损检测中的应用.新型碳材料, 1998, 13(2):25-28
11徐丽,张幸红,韩杰才.射线检测在复合材料无损检测中的应用.无损检测,2004.9(24):450-456
12曹玉玲,陈存柱.铸件的工业CT三维检测技术. CT理论与应用研究, 2003, 12(3):36-39
13吴凤和,张晓峰.基于参数域映射及B样条插值的三维重构方法.中国激光, 2007,34(7):977-982
14李扬,郑莹娜.基于极大图像熵的均质材料内部缺陷ICT诊断.机械工程学报,2005,41(11):43-46
15王沫楠,孙立宁.基于CT图像的组织建模与仿真方法.哈尔滨工业大学学报, 2008,40(7):1071-1075
16王璿.基于散乱点数据的三维重建并行实现.燕山大学学报, 2008,32(4):345-350
17 Dastarac D. Industrial computed tomography: control and digitalisation international symposium on computerized tomography for industrial applications and image processing in radiology. Germany Proceedings BB 672CD published by DGZFP[C] , Berlin : 1999.
18 William H Green , Joseph M Wells. Nondestructive Characterization of Impact Damage in Metallic/ Nonmetallic Composites Using X2ray Computed Tomography Imaging.Report Number ARL2TR22399, Weapons and Materials Research Directorate ,US: Army Research Laboratory ,2001.
19 Oster R, Eurocopter, Munich D. Computed tomography as a non-destructive test method for fiber main rotorblades in development, services and maintenance [A]. International Symposium on Computerized Tomography for Industrial Applications and Image Processing in Radiology, Berlin:Germany Proceedings BB 672CD published by DGZFP ,1999.
20 William H Green, Patrick Sincebaugh. Nondestructive evaluation of complex composites using advanced computed tomography (CT) imaging. Report Number ARL2TR2400, Weapons and Materials Research Directorate,US: Army Research Laboratory , 2001.
21王高飞.基ICT的三维重构技术的研究.北京航空航天大学硕士学位论文. 2003:12-35
22林丽华,卢清萍,颜永年.面向RP的CT图像反求技术.计算机辅助设计与制造. 1998,9:48-50
23 Herman G T, Zheng J, Bucho ltz C. Shaped2based interpolation. IEEE CG&A. 1992,12 (3):69-79
24章毓晋.图象分割.北京:科学出版社, 2001:123-135
25林瑶,田捷.医学图像分割方法综述.模式识别与人工智能. 2002,15(2):l92-204.
26 Sahoo P K,Soltani S,Wang A K C.A Survey of Thresholding Techniques.Computer Vision,Graphics and Image Processing. l988,4l(2):233-260
27邱明,张二虎.医学图像分割方法.计算机工程与设计. 2007,26(6):1557~1559
28 S.Z.Li.Markov Random Field Modeling in Computer Vision. Tokyo: Springer Verlag. 1995:25-34
29 Wen-Feng Kuo,Chi-Yuan Linc,Yung-Nien Sun. Brain MR images segmentation using statistical ratio: Mapping between watershed and competitive Hopfield clustering network algorithms. Computer Methods and Programs in Biomedicine. 2008,91(3):191-198
30 Jaime S. Cardoso, Pedro Carvalho,Luís F. Teixeiraa. Partition-distance methods for assessing spatial segmentations of images and videos. Computer Vision and Image Understanding. 2009,113(7):811-823
31 Joe-Air Jiang, Hsiang-Yun Chang, Ke-Han Wu. An adaptive image segmentation algorithm for X-ray quarantine inspection of selected fruits. Computers and Electronics in Agriculture. 2008,60(2):190-200
32 Antonis Daskalakis, Dimitris Glotsos, Spiros Kostopoulos. A comparative study of individual and ensemble majority vote cDNA microarray image segmentation schemes, originating from a spot-adjustable based restoration framework. Computer Methods and Programs in Biomedicine. 2009,95(1):72-88
33 J. Marker, I. Braude, K. Museth, D. Breen, Contour-based surface reconstruction using implicit curve fitting, and distance field filtering and interpolation, in: Proceedings of the International Workshop on Volume Graphics, 2006: 95-102
34 Y. C. Chen, Y. C. Chen, A. S. Chiang, K. S. Hsieh. A reliable surface reconstruction system in biomedicine. Comput Methods Prog Biomed. 2007,86(2):141-152
35 A. Lienhard, O. Greevy and O. Nierstrasz, Tracking objects to detect feature dependencies, Proceedings international conference on program comprehension, IEEE Computer Society, 2007 : 59-68
36 F. Reinders, F. H. Post, H. J. W. Spoelder. Visualization of timedependent data using feature tracking and event detection. In The Visual Computer. 2001,17(1):55-71
37 A. Adam, E. Rivlin, I. Shimshoni and D. Reinitz, Robust real-time unusual event detection using multiple fixed-location monitors, IEEE Transactions on Pattern Analysis and Machine Intelligence 2008. 30(3):555-560.
38 KOLLER D, WEBER J, MALICK J. Robust multiple car tracking with occlusion reasioning. In:Proceedings of the European conference on computer vision. 1994:189-196
39 S. M. Bhandarkar, X. Luo, R. Daniels, E. W. Tollner. A Novel Feature-based Tracking Approach to the Detection, Localization and 3-D Reconstruction of Internal Defects in Hardwood Logs Using Computer Tomography. Pattern Analysis and Applications. 2006,9:155-175
40 F. von Hundelshausen, R. Rojas. Tracking regions and edges by shrinking and growing. In Proceedings of the RoboCup 2003 International Symposium, Padova, Italy. 2003:20-25
41 Rolf Adams, Leanne Bischof. Seeded Region Growing. IEEE Trans .Pattern Anal .Machine Intell. 1994,16(6):641-647
42 Runzhen Huang , Kwan-Liu Ma, RGVis: Region Growing Based Techniques for Volume Visualization, Proceedings of the 11th Pacific Conference on Computer Graphics and Applications, 2006:355-343.
43 William E.Lorsen, Harvey E.Cline. Marching Cubes: a high resolution 3D surface construction algorithm. 1987,21(4):163-169
44何晖光,田捷,赵明昌,杨骅.基于分割的三维医学图像表面重建算法.软件学报. 2002,13(2):219-226
45 Enmark M, Lucas G, Odette GR. An electric potential drop technique for characterizing part-through surface cracks. J Nucl Mater (The Netherlands). 1992:1038-1041
46 Makoto A, Masumi S. Nondestructive sizing of a 3D surface crack generated in a railway component using closely coupled probes for direct-current potential drop technique. Eng Fract Mech. 2005,72:319-334
47 Knight MJ, Brennan FP, Dover WD. Effect of residual stress on ACFM crackmeasurements in drill collar threaded connections. NDT&E Int. 2004,37:337-343
48 Zerwer A, Polak MA, Santamarina JC. Rayleigh wave propagation for the detection of near surface discontinuities: Finite element modeling. Struct Eng. 2001,128: 240-248.
49 Ravichandran AS, Larsen JM. Microstructure and crack-shape effects on the growth behavior of small fatigue cracks in Ti-24Al-11Nb. Mater Sci Eng A. 1992,153:499-507
50 Ballard D., Brown C. Computer Vision. Englewood Cliffs. NJ: Prentice Hall. 1982:21-33
51 Davies E. Machine Vision: Theory, Algorithms and Practicalities. New York: Academic. 1990:120-124
52 Gonzalez Woods RR. Digital Image Processing. Indianapolis, IN: Addison Wesley Publishing. 1992:33-35
53 Schneiders R. A grid-based algorithm for the generation of hexahedral element meshes. Engr Comput. 1996,12:168-177
54任少卿,王明泉,杨静,李志刚.基于工业CT断层图像的三维可视化.中国体视学与图像分析, 2007,(01) .
55黄永丽,宋宝卫.基于OpenGL的三维重构及可视化处理技术.郑州轻工业学院学报. 2008,23(3):60-63
56郭涛,平西建.基于OpenGL的三维地形可视化技术研究.计算机工程与设计. 2008,29(1):193-195