基于网络的医学CT三维重建系统关键技术研究
|
摘要
医学图像三维重建是目前医学可视化领域的研究热点,属于多学科交叉,涉及到计算机图形学、图像处理、生物医学工程等多种技术,在诊断医学、手术规划及模拟仿真等方面有广泛应用。
基于网络的医学CT三维重建系统,通过将CT三维重建技术,基于图像渲染的技术以及网络通信技术融合,为目前医疗诊断可视化提供了一种新的手段。系统采用高速服务器进行大数据量的医学CT三维重建处理、数据传输以及处理结果的实时渲染,系统的客户端结合服务器端内存渲染的结果与基于图像的渲染技术,让用户实时查看服务器端三维重建的结果,服务器端还提供给用户处理结果下载的功能。
在三维重建技术实现方面,研究改进了移动立方体算法,新增了8种基本拓扑架构,消除了传统移动立方体算法法线的二义性。另外,针对三维重建后可能出现的后期处理大规模数据,对传统计算传递闭包的分组算法作了改进,将算法复杂度由O(n3)降低到O(kn2)。在客户端的渲染实现方面,采用了一种的新的基于多幅深度图像的渲染算法,不仅解决了基于单幅深度图像渲染需要不断更换参考帧的弱点,而且还成功的解决了由于网络的不稳性而不能远程实时浏览三维重建结果的难题。
通过对系统的服务器的功能测试与算法的性能测试,新改进的CT三维重建算法消除了原有算法所带来的黑斑,对512×512×34的CT序列重建只需要2s左右的时间。系统的客户端基于多幅深度图像渲染算法,在普通pc机上帧率可达到20fps以上,而且渲染的结果十分接近几何真实渲染的效果。
3D reconstruction for medical images is a hot subject of medical images processing, belonging to multi-disciplinary subject, involved in computer graphics and image processing in biomedicine engineering. It is widely used in simulation of surgery, diagnoses, emulator and etc.
The 3D reconstruction,image-based rendering and network are combined by a new architecture based on internet. It turns on a new way for medical visualization. The high speed servers are used to deal with CT 3D reconstruction in this architecture. And the technique of image-based rendering and internet are joined in its client. Because of this technology , the user can remotely view the result of 3D reconstruction. In addition, it is convenience for user to download the result.
The implement of the 3D reconstruction in server is based on the advanced marching cubes. There are another 8 base cases are add to the algorithm. It is very successful to solve the confusion of the face in the marching cubes. On the other side, we improve the algorithm of the segmentation. The rendering in client are implemented by a new depth images-based rendering. This algorithm avoids the weakness of the single image-based rendering. It is necessary to change the reference image for the single image-based rendering. And this algorithm is not affected by the network. It can solve the problem of the 3d remote view.
After functional and performance tests in server, the black spots have been removed with the advanced algorithm. It takes only 10 second for 512×512×34 CT images. The images-based rendering can reach the speed of more then 20fps in client. The result of its rendering is very nearly to the drawing of geometry-based rendering.
基于网络的医学CT三维重建系统,通过将CT三维重建技术,基于图像渲染的技术以及网络通信技术融合,为目前医疗诊断可视化提供了一种新的手段。系统采用高速服务器进行大数据量的医学CT三维重建处理、数据传输以及处理结果的实时渲染,系统的客户端结合服务器端内存渲染的结果与基于图像的渲染技术,让用户实时查看服务器端三维重建的结果,服务器端还提供给用户处理结果下载的功能。
在三维重建技术实现方面,研究改进了移动立方体算法,新增了8种基本拓扑架构,消除了传统移动立方体算法法线的二义性。另外,针对三维重建后可能出现的后期处理大规模数据,对传统计算传递闭包的分组算法作了改进,将算法复杂度由O(n3)降低到O(kn2)。在客户端的渲染实现方面,采用了一种的新的基于多幅深度图像的渲染算法,不仅解决了基于单幅深度图像渲染需要不断更换参考帧的弱点,而且还成功的解决了由于网络的不稳性而不能远程实时浏览三维重建结果的难题。
通过对系统的服务器的功能测试与算法的性能测试,新改进的CT三维重建算法消除了原有算法所带来的黑斑,对512×512×34的CT序列重建只需要2s左右的时间。系统的客户端基于多幅深度图像渲染算法,在普通pc机上帧率可达到20fps以上,而且渲染的结果十分接近几何真实渲染的效果。
3D reconstruction for medical images is a hot subject of medical images processing, belonging to multi-disciplinary subject, involved in computer graphics and image processing in biomedicine engineering. It is widely used in simulation of surgery, diagnoses, emulator and etc.
The 3D reconstruction,image-based rendering and network are combined by a new architecture based on internet. It turns on a new way for medical visualization. The high speed servers are used to deal with CT 3D reconstruction in this architecture. And the technique of image-based rendering and internet are joined in its client. Because of this technology , the user can remotely view the result of 3D reconstruction. In addition, it is convenience for user to download the result.
The implement of the 3D reconstruction in server is based on the advanced marching cubes. There are another 8 base cases are add to the algorithm. It is very successful to solve the confusion of the face in the marching cubes. On the other side, we improve the algorithm of the segmentation. The rendering in client are implemented by a new depth images-based rendering. This algorithm avoids the weakness of the single image-based rendering. It is necessary to change the reference image for the single image-based rendering. And this algorithm is not affected by the network. It can solve the problem of the 3d remote view.
After functional and performance tests in server, the black spots have been removed with the advanced algorithm. It takes only 10 second for 512×512×34 CT images. The images-based rendering can reach the speed of more then 20fps in client. The result of its rendering is very nearly to the drawing of geometry-based rendering.
引文
[1] M.WJones and M.Chen. A New Approach to the Construction of Surfaces from Contour Data. Proceedings of Eurographics’94,1994, 13(3):75-84
[2] E.Bittar, N.Tsingos and M.P.Gascuel. Automatic Reconstruction of Unstructured Data: Combining Medical Axis with Implicit Surfaces . Proceedings Eurographics'95, 1995,14(3) :457-468
[3] YBresler, J.A.Fessler,and A .Macovski. A Bayesian. Approach to Reconstruction from Incomplete Projections of A Multiple Object 3D Domain. IEEE Trans. Patt.Anal.Mach. Intell On, 1989, 11 (8): 840-858
[4] Kaufman A, 3D Volume Visualization. Advances in Compute Graphics 4, Springer-Verlag, 1991, 201-206
[5] J.Wilhelms, et al .Topological Considerations in Isosurface Generation. San Diego Workshop on Volume Visualization.1991, 132-137
[6] H.E.Cline, et al. Two Algorithms for Three-Dimensional Reconstruction of Tomograms. Med Phys,1988, 3(15): 136-141
[7] William E.Lorensen, Harvey E. Cline ,Marching Cubes: A high resolution 3D surface construction algorithm. SIGGRAPH '87, Anaheim, 1987, 6: 27-31
[8] M.J.Durst. Leters: Additional Reference to "Marching Cubes". Computer Graphics, 1988, 22(2): 50-56
[9] GTHerman, and H.K.Liu. Three-Dimensional Display of Human Organs from Computed Tomograms. Computer Graphics Image Processing,1979, 6:1-9
[10] Lippman A.Movie maps: an application of the optical video disc to computer graphics. Computer Graphics(Proc. SIGGRAPH’80), 1980, 32-43
[11] R.Szeliski and H.-Y. Shum. Creating full view panoramic image mosaics and texture-mapped models. Computer Graphics(SIGGRAPH’97), 1997, 8: 251-258
[12] Dave Shreiner, Mason Woo and etc. OpenGL programming Guide Fifth Edition, 353-355
[13]章勤,虢伟.一种新的多幅深度图像的三维重建技术.华中科技大学学报(已录用)
[14]管伟光.体数据可视化极其在医学中的应用:博士论文.北京:中国科学院自动化研究所图书馆, 1995
[15] Doi,and A .Koide. An Efficient Method of Triangulating Eugi-Valued Surfaces by Using Tetrahedral Cells. IE ICE Transactions, 1991, 214-224
[16] Klemp, McIrvin and Boyd. Poly Paint-A Three-dimensional Rendering Package. American Meteorology Society Proceedings, Sixth International Conference. Interactive Information and Processing Systems,1990, 266-272
[17]唐泽圣等.三维数据场可视化.北京:清华大学出版社, 1999, 112-128
[18]马颂德,张正友.计算机视觉—计算理论与算法基础.北京:科学出版社, 1998, 157-160
[19] G.M.Nielson, and B.Hamann. The Asymptotic Decider: Resolving the Ambiguity in Marching Cubes. IEEE Proceedings of Visualization’91, 1991, 83-91
[20]管伟光.体视化技术及其应用.北京:电子工业出版社, 1998, 48-56
[21]周勇,唐泽圣.用自适应的三线性逼近方法构造等值面.计算机学报, 17(增刊), 1994, 1-10
[22] http://www.rsine.com/
[23] F.S.Hill.JR. Computer Graphics Using OpenGL Second Edition.北京:科学出版社, 2004, 1: 283-285
[24]张益新,沈雁.算法引论.长沙:国防科技大学出版社, 1995, 8: 135-141
[25]沈傲东.医学影像三维重建方法研究:硕士论文.西安:西安电子科技大学图书馆, 2003
[26] E.H.Adelson and J.Bergen. The plenoptic function and the elements of early vision. In Computational Models of Visual Processing, MIT Press Cambridge. MA, 1991, 3-20
[27] M.Okutomi and T.Kanade. A multiple baseline stereo. IEEE Transactions on Pattern Analysis and Machine Interlligence, 1993, 15(4):353-363
[28] H.Y.Shum and R.Szeliski. Stereo reconstruction from multiperspective panoramas. Computer Vision, 1999. The Proceedings of the Seventh IEEE International Conference on, 1999, 1: 14-21
[29] Kang S B, Szeliski R.3-D scene data recovery using omni-derectional multibaseline stereo. In IEEE Computer Society Conference on Computer Visionand Pattern Recognition (CVPR'96). San Francisco, CA, IEEE Computer Society Press. 1996, 364-370
[30] S .J. Gortler,R . rzeszczuk ,R.Szeliski and M .F. Cohen. The lumigraph. In Computer Graphics Proceedings. Annual Conference Series, Proc SIGGRAPH'96 ( New Orleans), 1996, 8: 43-54
[31] M .Levoy and P.Hanrahan. Light field rendering. In Computer Graphics Proceedings, Annual Conference Series, Proc.SIGGRAPH'96( New Orleans),August 1996.ACM SIGGRAPH 1996, 8: 31-42
[32] Carolina Cruz-Neira. Virtual reality overview. Overview of virtual reality system Course Notes 23 of SIGGRAPH'93, 1993, 124-130
[33] S .Chen and L.Williams.View interpolation for image synthesis. Computer Graphics (SIGGRAPH'93 ), 1993, 8: 279-288
[34] Simon Street. Dijkstra's Algorithm. htp://www.deakin.edu.au/-agoodman/granh/ djkstral.htm
[35] Tong-Yee Lee, Ping-Hsien Lin, Chao-Hung Lin, Yung-Nien Sun, and Xi-Zhang Lin .Interactive 3-D Virtual Colonoscopy System. IEEE Transactions, 1999, 2(3):101-106
[36] Leonard McMillan Jr. An Image-based approach to three-dimensional computer graphics。A dissertation submitted to the faculty of the University of North Carolina at Chapel Hill in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Department of Computer Science,1997
[37] Leonard McMillan and Gary Bishop. Plenoptic Modeling [A].An Image-Based Rendering System. Proceedings of SIGGRAPH 95, 156-162
[38] Zhang Z1. A flexible new technique for camera calibration [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22 (11): 1330-1334
[39]王坤,李永宁.基于图像的渲染.中国民航航天飞行学院学报,2005, 2: 44-48
[40] Maxime Lhuillier and Long Quan. Image-Based Rendering by Joint View Triangulation. IEEE Transactions on circuits and systems for video technology , 2003,11(13): 45-50
[41]李新肖.基于采样的场景建模及其绘制技术研究:博士论文.西安:西安交通大学图书馆, 1999
[2] E.Bittar, N.Tsingos and M.P.Gascuel. Automatic Reconstruction of Unstructured Data: Combining Medical Axis with Implicit Surfaces . Proceedings Eurographics'95, 1995,14(3) :457-468
[3] YBresler, J.A.Fessler,and A .Macovski. A Bayesian. Approach to Reconstruction from Incomplete Projections of A Multiple Object 3D Domain. IEEE Trans. Patt.Anal.Mach. Intell On, 1989, 11 (8): 840-858
[4] Kaufman A, 3D Volume Visualization. Advances in Compute Graphics 4, Springer-Verlag, 1991, 201-206
[5] J.Wilhelms, et al .Topological Considerations in Isosurface Generation. San Diego Workshop on Volume Visualization.1991, 132-137
[6] H.E.Cline, et al. Two Algorithms for Three-Dimensional Reconstruction of Tomograms. Med Phys,1988, 3(15): 136-141
[7] William E.Lorensen, Harvey E. Cline ,Marching Cubes: A high resolution 3D surface construction algorithm. SIGGRAPH '87, Anaheim, 1987, 6: 27-31
[8] M.J.Durst. Leters: Additional Reference to "Marching Cubes". Computer Graphics, 1988, 22(2): 50-56
[9] GTHerman, and H.K.Liu. Three-Dimensional Display of Human Organs from Computed Tomograms. Computer Graphics Image Processing,1979, 6:1-9
[10] Lippman A.Movie maps: an application of the optical video disc to computer graphics. Computer Graphics(Proc. SIGGRAPH’80), 1980, 32-43
[11] R.Szeliski and H.-Y. Shum. Creating full view panoramic image mosaics and texture-mapped models. Computer Graphics(SIGGRAPH’97), 1997, 8: 251-258
[12] Dave Shreiner, Mason Woo and etc. OpenGL programming Guide Fifth Edition, 353-355
[13]章勤,虢伟.一种新的多幅深度图像的三维重建技术.华中科技大学学报(已录用)
[14]管伟光.体数据可视化极其在医学中的应用:博士论文.北京:中国科学院自动化研究所图书馆, 1995
[15] Doi,and A .Koide. An Efficient Method of Triangulating Eugi-Valued Surfaces by Using Tetrahedral Cells. IE ICE Transactions, 1991, 214-224
[16] Klemp, McIrvin and Boyd. Poly Paint-A Three-dimensional Rendering Package. American Meteorology Society Proceedings, Sixth International Conference. Interactive Information and Processing Systems,1990, 266-272
[17]唐泽圣等.三维数据场可视化.北京:清华大学出版社, 1999, 112-128
[18]马颂德,张正友.计算机视觉—计算理论与算法基础.北京:科学出版社, 1998, 157-160
[19] G.M.Nielson, and B.Hamann. The Asymptotic Decider: Resolving the Ambiguity in Marching Cubes. IEEE Proceedings of Visualization’91, 1991, 83-91
[20]管伟光.体视化技术及其应用.北京:电子工业出版社, 1998, 48-56
[21]周勇,唐泽圣.用自适应的三线性逼近方法构造等值面.计算机学报, 17(增刊), 1994, 1-10
[22] http://www.rsine.com/
[23] F.S.Hill.JR. Computer Graphics Using OpenGL Second Edition.北京:科学出版社, 2004, 1: 283-285
[24]张益新,沈雁.算法引论.长沙:国防科技大学出版社, 1995, 8: 135-141
[25]沈傲东.医学影像三维重建方法研究:硕士论文.西安:西安电子科技大学图书馆, 2003
[26] E.H.Adelson and J.Bergen. The plenoptic function and the elements of early vision. In Computational Models of Visual Processing, MIT Press Cambridge. MA, 1991, 3-20
[27] M.Okutomi and T.Kanade. A multiple baseline stereo. IEEE Transactions on Pattern Analysis and Machine Interlligence, 1993, 15(4):353-363
[28] H.Y.Shum and R.Szeliski. Stereo reconstruction from multiperspective panoramas. Computer Vision, 1999. The Proceedings of the Seventh IEEE International Conference on, 1999, 1: 14-21
[29] Kang S B, Szeliski R.3-D scene data recovery using omni-derectional multibaseline stereo. In IEEE Computer Society Conference on Computer Visionand Pattern Recognition (CVPR'96). San Francisco, CA, IEEE Computer Society Press. 1996, 364-370
[30] S .J. Gortler,R . rzeszczuk ,R.Szeliski and M .F. Cohen. The lumigraph. In Computer Graphics Proceedings. Annual Conference Series, Proc SIGGRAPH'96 ( New Orleans), 1996, 8: 43-54
[31] M .Levoy and P.Hanrahan. Light field rendering. In Computer Graphics Proceedings, Annual Conference Series, Proc.SIGGRAPH'96( New Orleans),August 1996.ACM SIGGRAPH 1996, 8: 31-42
[32] Carolina Cruz-Neira. Virtual reality overview. Overview of virtual reality system Course Notes 23 of SIGGRAPH'93, 1993, 124-130
[33] S .Chen and L.Williams.View interpolation for image synthesis. Computer Graphics (SIGGRAPH'93 ), 1993, 8: 279-288
[34] Simon Street. Dijkstra's Algorithm. htp://www.deakin.edu.au/-agoodman/granh/ djkstral.htm
[35] Tong-Yee Lee, Ping-Hsien Lin, Chao-Hung Lin, Yung-Nien Sun, and Xi-Zhang Lin .Interactive 3-D Virtual Colonoscopy System. IEEE Transactions, 1999, 2(3):101-106
[36] Leonard McMillan Jr. An Image-based approach to three-dimensional computer graphics。A dissertation submitted to the faculty of the University of North Carolina at Chapel Hill in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Department of Computer Science,1997
[37] Leonard McMillan and Gary Bishop. Plenoptic Modeling [A].An Image-Based Rendering System. Proceedings of SIGGRAPH 95, 156-162
[38] Zhang Z1. A flexible new technique for camera calibration [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22 (11): 1330-1334
[39]王坤,李永宁.基于图像的渲染.中国民航航天飞行学院学报,2005, 2: 44-48
[40] Maxime Lhuillier and Long Quan. Image-Based Rendering by Joint View Triangulation. IEEE Transactions on circuits and systems for video technology , 2003,11(13): 45-50
[41]李新肖.基于采样的场景建模及其绘制技术研究:博士论文.西安:西安交通大学图书馆, 1999