3D虚拟现实内镜手术仿真关键技术研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
随着科技的发展,计算机虚拟技术正在医学领域发挥着重要的作用,其中虚拟手术(又称为手术仿真)越来越多的被医学界所认可,虚拟手术已成为医疗信息学中一个非常重要的应用分支。
     内窥镜手术复杂程度高,要求临床医生具备较高的手眼协调能力,需要经过长时间的训练。使用虚拟现实技术构建虚拟手术环境,实现内镜手术仿真培训,可以解决传统训练方式下成本高、无法重复等缺陷,目前已成为该领域中的一个非常重要的课题。
     目前虚拟手术领域已有的研究成果,其重点在于医学图像的分割、三维重建、物理模型的建立,而对于力反馈模型的研究尚处于起步阶段。
     本文重点研究了三维虚拟现实场景下内窥镜手术仿真中碰撞检测,软组织形变,切割和缝和线打结等关键算法,并对使用这些算法构建内镜手术培训系统进行了探讨。
     在碰撞检测方面,本文针对内镜手术中碰撞的特点,构造手术器械、软体组织的混合碰撞检测模型,提出了一种基于混合层次包围盒检测算法,根据对算法的分析实验结果,该算法可以改善包围盒对手术器械、软体组织的包围紧密度,提高检测碰撞的速度和确定碰撞点的精度。
     在提高器官软体组织形变仿真的计算速度上,根据腹腔器官组织的生物力学特征,提出了改进的受力点寻址算法和基于三角面积匹配邻近点查询算法,通过实验证明该算法可以提高形变仿真的响应速度,提高形变计算的实时性,以及仿真精度。
     在实现软体组织切割仿真方面,针对目前切割仿真算法的缺陷,提出了基于顶点复制的切割分裂算法和基于顶点移动的切割细化算法.通过对比实验验证所提出的算法可以减少网格单元结构的增加,提高切口面的平滑精细程度和切割仿真的响应速度.
     在实现缝合线打结操作仿真上,结合缝合线的特点,构建了缝合线的3维模型,提出了基于连续控制点的缝合线位置变换算法和基于球体包围盒的碰撞检测算法,实现缝合线打结过程的仿真。
With the development of computer technology, the virtual technology is playing an important role in the medical field, the virtual surgery (also known as surgery simulation) has been accepted by the medical field step by step, and the virtual surgery has become a very important branch of the medical informatics.
     The endoscopic surgery is very complicated, so the clinicians must need a long period of training to gain the capacity of good hand-eye coordination. Using virtual reality technology to build up virtual surgery environment and to implement endoscopic surgery simulation training, can solve the defects of high cost and unable-duplicating in the traditional training mode, which currently has become a very important issue.
     According to the current research results of virtual surgery, most reseach focuse ong the medical image segmentation, reconstruction, physical model, the study of force-feedback model is in the initial stage.
     This paper focuses on the key algorithm of collision detection, soft tissue deformation, cutting and suturing-line knotting in the three-dimensional virtual reality simulation of endoscopic surgery, and the construction the training system for endoscopic surgery has been also discussed.
     In collision detection, according to the characteristics of endoscopic surgery, the mixing collision detection models of surgical instruments and soft tissue were build, a detection algorithm based on mixed-level bounding box was brought up. Based on analysis of experiment results, this algorithm can improved bounding tightness of the bounding box for the surgical instruments and the soft tissue, increase the speed of collision detection and the accuracy of the collision point.
     To improve the computing speed of the soft tissue deformation simulation, according to the biomechanical characteristics of the abdominal organs, an improved force-point addressing algorithm and the neighboring points query algorithm based on triangle area matching were brought up. According to the experiment result, these algorithms can improve the response speed of deformation simulation, the real-time characteristics and the accuracy of deformation simulation computing.
     In the realization of soft tissue cutting simulation, to consider the defects in current cutting simulation algorithm, a new cutting-splitting algorithm based on vertex replication and a new cutting-fining algorithm based on vertex moving were proposed. Comparing the experiment results, these algorithms can reduce the increase number of the grid cell after cutting, and improve the cut surface of the smooth sophistication, increase the speed of cutting simulation response.
     In the realization of suturing-line knotting similation, to conside the characteristics of suturing-line, the 3-D model of suturing-line was build, a transformating algorithm of the suturing-line's position based on continuous control points and a collision detection algorithm based on sphere bounding were proposed, the simulation of suturing-line's knotting process was achieved.
引文
1. 牟少辉.面向虚拟手术系统的力反馈的研究与实现[D].山东大学2008,04.
    2.黄国秀.虚拟现实及其在现代医学中的应用[M].医院管理论坛.2009年06期.
    3.谭珂,郭光友,王勇军,等.虚拟现实技术在医学手术仿真训练中的应用.军医进修学院学报,2002.5,23(1):77-79
    4.王世文,杨兴强,吕伟.交互式虚拟内窥镜系统[J].山东大学学报(工学版),2005,35(1):94-97.
    5.王勇军,吴鹏,郭光友,等.支持力反馈的鼻腔镜虚拟手术仿真系统[J].系统仿真学报,2001,13(3):404—407.
    6. Daniel Bielser, Markus H.Gross. Open surgery simulation. In:James D.Westwood, eds. Medicine Meets Virtual Reality02/10. IOS Press,2002. 57~63
    7.张惠.仿真影像学的关键技术研究[D].南京:东南大学,2003:15-32.
    8. Jeremie Allard, Stephane Cotin; Francois Faure, et al. SOFA-an open source framework for medical simulation. In:James D.Westwood, eds. Medicine Meets Virtual Reality 15. IOS Press,2007,125:13~18
    9.吴鹏,赵龙,王勇军,李思困.一种基于有限元的形变模型算法[J].系统仿真学报,2001,13(5):674-677.
    10. G.Szekely, Ch.Brechbiihler, J.Dual, et al. Virtual reality-based simulation of endoscopic surgery. Presence:Teleoperators and Virtual Environments,2000, 9(3):310~333
    11. Morten Bro-Nielsen. Finite element modeling in surgery simulation. Proceedings of the IEEE,1998,86(3):490~503
    12. Stephane Cotin, Herve Delingette, Nicholas Ayache. A hybrid elastic model for real-time cutting, deformations, and force feedback for surgery training and simulation. The Visual Computer,2000,16(8):437~452
    13. Daniel Bielser, Volker A.Maiwald, Markus H.Gross. Interactive cuts through 3-dimensional soft tissue. Computer Graphics Forum,1999,18:31~38
    14. Daniel Bielser, Markus H.Gross. Interactive simulation of surgical cuts. In: Eighth Pacific Conference on Computer Graphics and Applications (PG'00). Hong Kong, China:IEEE Computer Society Press,2000.116~125
    15. Andrew B.Mor, Takeo Kanade. Modifying soft tissue models:progressive cutting with minimal new element creation. In:S.L. Delp, A.M. DiGioia, B. Jaramaz, eds. Medical Image Computing and Computer-Assisted Intervention(MICCAI 2000). Heidelberg, Berlin:Springer-Verlag,2000,1935(2000):598-607
    16. Han-Wen Nienhuys, A. Frank van der Stappen. A Surgery Simulation Supporting Cuts and Finite Element Deformation. In:Medical Image Computing and Computer-Assisted Intervention(MICCAI 2001). Utrecht, The Netherlands: Springer-Verlag,2001,2208(2010):145-152
    17. D. Bielser, P. Glardon, M. Teschner, et al. A state machine for real-time cutting of tetrahedral meshes. Graphical Models,2004,66(6):398-417
    18. Denis Steinemann, Matthias Harders, Markus Gross, et al. Hybrid cutting of deformable solids. In:IEEE Virtual Reality Conference (VR 2006), IEEE Computer Society Press,2006.35-42
    19. Martin Wicke, Mario Botsch, Markus Gross. A finite element method on convex polyhedra. Computer Graphics Forum,2007,26(3):355~364
    20.王建宁,阎丽霞,石教英.一种基于四面体的软组织切割算法.系统仿真学报,2000,12(5):557-559
    21.阎丽霞.虚拟手术关键技术研究:[D].杭州:浙江大学,2001
    22.贾世宇,潘振宽.虚拟手术中基于最少单元分裂的切割仿真技术.系统仿真学报,2008,20(6):1487-1492
    23.胡志秋.虚拟手术中四面体切割及优化问题研究:[硕士学位论文].青岛:青岛大学,2005
    24.王广伟.基于快速有限元法的虚拟手术技术研究:[硕士学位论文].成都:西南交通大学,2006
    25.熊岳山,罗军,谭珂,等.一种新的基于体元剖分的软组织切割算法.计算机研究与发展,2005,42(12):2132-2136
    26.罗军.虚拟手术中基于有限元模型的切割算法的研究与实现:[硕士学位论文].长沙:国防科学技术大学,2005
    27.熊岳山,徐凯,王彦臻,等.虚拟膝关节镜手术仿真系统的关键技术研究.国防科技大学学报,2007,29(1):76-80
    28. Brown J, Latombe J C, Montgomery K, Real-time knot-tying simulation[J], Visual Computer 2004(20):165-179
    29. Dinesh K,Pai,STRSNDS:Interactive simulation of thin solids using cosserat models[J],Eurographics,2002,21(3):1-6
    30. Moll M,Kavraki L E,Path PLanning for minimal energy curves of constant length[J],in Proc.2004 IEEE Intl.Conf.On robotics and Automation,2004:2826-2861.
    31.李春明.弹性绳系统的动力学建模与计算机仿真.系统仿真学报[J],2008,20(1):62-65,168.
    32.岳龙旺.外科手术机器人缝合打结研究[D].天津大学.2006,6.
    33.夏芳芳.虚拟现实技术及其在现代远程医疗中的应用[J].河南外科学杂志.2007年1期.夏芳芳.虚拟现实技术及其在现代远程医疗中的应用[J].河南外科学杂志.2007年1期.
    34.尹毅东.谈医学虚拟手术的运用[J].中国医学教育技术,2002,16(6):352-356.
    35.张小萍,王君泽,黄希.软组织虚拟手术仿真的关键技术探析[M].南通职业大学学报.2008,第22卷第3期.
    36.吴兰萍,黄克正,霍志璞等.一种用于腹腔镜手术技能培训的虚拟现实系统[J].山东大学学报(工学版),2006,36(4):9-11,80.
    37.邢英杰,张少华,刘晓冰.虚拟手术系统技术现状.计算机工程与应用,2004,40(7):88-90
    38.谭坷,熊岳山等. 一种鼻内窥镜虚拟手术仿真系统[J].计算机工程,2006,32(16):243-一244.
    39.张绍祥,王平安,刘正津,等.首套中国男、女数字化可视人体结构数据的可视化研究.第三军医大学学报,2003,25(5):394-396.
    40. Cynthia D.Bruyns, Kevin Montgomery, Joel Brown, et al. Spring:A general framework for collaborative, real-time surgical simulation. In:James D.Westwood, et al, eds. Medicine Meets Virtual Reality 02/10, IOS Press,2002, 85:296~302.
    41. Cynthia D.Bruyns, Kevin Montgomery. Generalized interactions using virtual tools within the spring framework:cutting. In:James D.Westwood, et al, eds. Medicine Meets Virtual Reality 02/10, IOS Press,2002,85:79~85.
    42. Kim Y J, Lin M, Manocha D. Fast penetration depth estimation using rasterization hardware and hierarchical refinement[C]. Proc of Symposium on Computational Geometry,2003,386-387.
    43.魏迎梅.虚拟环境中碰撞检测问题的研究[D].博士学位论文,长沙:国防科技技术大学,2000.
    44.魏迎梅,王涌,吴泉源,等.于.术仿真中的碰撞检测研究[J].计算机研究与发展,2002,39(1):114-119.
    45. Govindarajun K, Lin M C, Manocha D. Quick-CULLIDE:fast inter-and intra-object collision culling using graphics hardware[C]. Proc of IEEE Virtual Reality.2005,59-66.
    46. Baciu G, Wong W S. Hardware-assisted self-collision for deformable surfaces[A]. In Proceedings of ACM Symposium on Virtual Reality Software and Technology(VRST), ACM Press,2002,129-136.
    47. Teschner M, Kimmerle S, Heidelberger B, et al. Collision detection for deformable objects [J]. Computer Graphics Forum,2004,119-139.
    48.魏迎梅,王涌,吴泉源,等.碰撞检测中的固定方向凸包包围盒的研究[J].软件学报,2001,12(7):1056-1062.
    49.范昭炜,万华根,高曙明.基于图像的快速碰撞检测算法[J].计算机辅助设计与图形学学报,2002,9(14):805-809.
    50.范昭炜,万华根,高曙明.基于流的实时碰撞检测算法[J].软件学报,2004,15(10):1505-1514.
    51.董战鲲,曹青.碰撞检测技术在视景仿真中的设计和应用[J].微型机与应用,2005,24(10):55-58.
    52.梁小红,刘少强.三维织物动感模拟及碰撞检测方法研究[J].电脑与信息技术,2006,14(6):37-39.
    53.贾世宇,潘振宽.虚拟手术中基于Tensor-Mass的变形仿真技术[J].系统仿真学报,2008,20(7),1686-1690.
    54.王彦臻,熊岳山,徐凯等.改进的采用表面网格的弹簧振子模型[J].计算机辅助设计与图形学报,2007,19(2):165-167.
    55.王彦臻.改进的弹簧振子模型及其在虚拟手术中的应用研究[D].长沙:国防科技大学,2006.
    56.纪峰,黄永东.简化质点弹簧模型在牙龈变形仿真中的应用[J].北华大学学报,2007,8(5):447-450.
    57.吴鹏,赵龙,王勇军,李思困.一种基于有限元的形变模型算法[J].系统仿真学报,2001,13(5):674-677.
    58.纪峰、李汝勤,基于粒子-弹簧系统的面料仿真模型[J],纺织学报,2004,25(1):45-56.
    59.鲍春波,王博亮,刘卓,程明.一种用于软组织变形仿真的动态质点弹簧模型[J].系统仿真学报,2006,18(4):847-851.
    60.王晨.基于物理的柔性管形变建模实时仿真[D].杭州:浙江大学,2008.
    61.黄鹏飞.虚拟手术中有限元形变建模及应用[D].上海:上海交通大学,2007.
    62.贾世宇,潘振宽.虚拟手术中基于最少单元分裂的切割仿真技术.系统仿真 学报,2008,20(6):1487-1492
    63.张彦波,手术仿真中软组织切割方法研究:[硕士学位论文].青岛:青岛大学,2007
    64.王建宁,阎丽霞,石教英.一种基于四面体的软组织切割算法.系统仿真学报,2000,1 2(5):557-559
    65.阎丽霞,石教英.一种新的分层模型四面体重构算法.计算机辅助设计与图形学学报,2001,13(7):626-630
    66. Stephane Cotin, Herve Delingette, Nicholas Ayache. A hybrid elastic model for real-time cutting, deformations, and force feedback for surgery training and simulation. The Visual Computer,2000,16(8):437~452
    67.杨林斌.腹腔镜下缝合技术的研究[M].2007年浙江省微创外科学术会议.
    68.唐吉祥.腹腔镜下多种腔内打结方法运用[M].重庆医学.2008年15期.
    69.曾妍文.面向显微外科手术的虚拟血管缝合仿真系统的研究[D].天津大学.2006,1.
    70.刘笑宇,杨洋,李成祥.角膜移植手术中打结作业的力学建模与分析[M].高技术通讯.2007年10期.
    71.张静思.虚拟手术中带力反馈的缝合模拟研究[D].上海交通大学.2008.
    72. Brown J, Latombe J C, Montgomery K, Real-time knot-tying simulation[J], Visual Computer 2004(20):165-179
    73.马登武,叶文,李瑛等.基于包围盒的碰撞检测算法综述[J].系统仿真学报,2006,18(4):1058-1061.
    74.刘涛,王增波,李占利.碰撞检测过程中的包围盒技术及应用研究[J].西安科技大学学报,2006,26(3):395-399.
    75. Otaduy M, Chassot O, Steinemainn D, et al. Balanced hierarchies for collision detection between fracturing objects[C]. In IEEE Virtual Reality,2007.
    76.潘振宽,崔树娟,张继萍等.基于层次包围盒的碰撞检测方法[J].青岛大学学报(自然科学版),2005,18(1):71-76.
    77. Teschner M, Heidelberger B, Miiller M G M, et al. Optimized spatial hashing for collision detection of deformable objects[C]. Proc. Vision, Modeling, and Visualization Conf. (VMV'03),2003,47-54.
    78.李焱,卢晓军,贺汉根.USSCD:一个基于均匀空间分割的快速碰撞检测算法[J].中国图象图形学报,2003,第8卷(A版)第12期:1444-1449.
    79. Larsson T, Akenine-Moller T. Collision detection for continuously deforming bodies[J]. In Eurographics,2001,325-333.
    80.蒋春涛,鲍旭东,郭宏宇.质量一弹簧模型的两种快速算法[J].中国医疗器械新志研究与论著,2004,28(2):102-104
    81. G. Irving, J. Teran, R. Fedkiw. Invertible finite elements for robust simulation of Large deformation[C].In Proceedings of the 2004 ACM SGGRAPH/Eurographics symposium on Computer Animation,2004:131~140.
    82. Eftychios Sifakis, Tamar Shinar, et al. Hybrid Simulation of Deformable Solids[C]. In:D. Metaxas, J. Popovic, eds. Eurographics ACM SIGGRAPH Symposium on Computer Animation. San Diego, California, USA:Symposium on Computer Animation,2007.81~90.
    83. Amy E. Kerdok, Stephane M. Cotin, Mark P. Ottensmeyer, et al. Truth cube: Establishing physical standards for soft tissue simulation[J]. Medical Image Analysis,2003,7:283~291.
    84. K.Sundaraj, C.Laugier, Physically realistic simulation of Large deformations using LEM for interactive applications [J], Proc. of IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS). Lausanne, Switzerland.2002.
    85. Qing-hong Zhu, Yan Chen, Arie Kaufman. Real-time biomechanically-based muscle volume deformation using FEM. Computer Graphics Forum,2001, 17(3):275~284
    86.王超洪,罗立民.虚拟手术系统中的软组织切割模拟.生物医学工程研究,2008,27(1):36-39
    87. JIA Shi-yu, PAN Zhen-kuan. A preliminary study on soft tissue cutting in virtual surgery simulation. Journal of Shanghai University (natural science edition),2004, 10(zl):177~183
    88.孙绪江.虚拟手术中几何建模及虚拟切割等相关技术研究:[硕士学位论文].西安:西北大学,2009
    89.胡志秋.虚拟手术中四面体切割及优化问题研究:[硕士学位论文].青岛:青岛大学,2005
    90. Daniel Bielser, Markus H.Gross. Interactive simulation of surgical cuts. In: Eighth Pacific Conference on Computer Graphics and Applications (PG'00). Hong Kong, China:IEEE Computer Society Press,2000.116~125
    91. Andrew B.Mor. Progressive cutting with minimal new element creation of soft tissue models for interactive surgical simulation:[D]. Pittsburgh, PA, USA: Carnegie Mellon University,2001
    92.熊岳山,罗军,谭珂,等.一种新的基于体元剖分的软组织切割算法.计算机 研究与发展,2005,42(12):2132-2136
    93. Han-Wen Nienhuys, A. Frank van der Stappen. Combining finite element deformation with cutting for surgery simulations. In:A. de Sousa, J.C. Torres, eds. EUROGRAPHICS 2000,2000.274~277
    94. F. Ganovelli, P. Cignoni, C. Montani, R. Scopigno. A multiresolution model for soft objects supporting interactive cuts and lacerations. In:M. Gross, F.R.A. Hopgood, eds. EUROGRAPHICS'00,2000,19(3):271~282
    95. Kevin Montgomery, Cynthia D.Bruyns. Generalized interactions using virtual tools within the spring framework:probing, piercing, cauterizing and ablating. In: James D.Westwood, et al, eds. Medicine Meets Virtual Reality 02/10, IOS Press, 2002,85:74~78
    96. James C.Cavendish, David A.Field, William H.Frey. An approach to automatic three-dimensional finite element mesh generation. International Journal for Numerical Methods in Engineering,1985,21(2):329~347
    97.罗军.虚拟手术中基于有限元模型的切割算法的研究与实现:[硕士学位论文].长沙:国防科学技术大学,2005
    98.蒋学禄,王香桂,毛月娟等.腹腔镜下缝合技术临床应用[J].现代中西医结合杂志.2005,16(10),1356-1357.
    99. Wang F,Burdet E,Dhanik. Dynamic thread for real_time knot_tying,Proc.Haptic Symposium,Proc Joint Eurohaptics and Symposium on Haptic and Teleoperation,IEEE Int.Conf on Virtual Reality(IEEEVR),2005:507-508.
    100. Blazej Kubiak, Nico Pietroni, Marco Fratarcangeli. A Robust Method for Real-Time Thread Simulation.
    101. F Wang,E Burdet,R Vuillemin, H Bleuler. Knot-tying with Visual and Force Feedback for VR Laparoscopic Training. Engineering in Medicine and Biology 27th Annual Conference.IEEE.2005.
    102. Haumann D R. Parertt R E The Behavioral Test—Bed Obtaining Complex Behavior For Simple Rules. Computer,1988(4):332-347.
    103. 潘振宽,高波.手术仿真中基于质点一弹簧模型的人体组织变形仿真[M].青岛大学学报.第18卷第23期,2003:9-14
    104. 朱元峰,孟军,谢光华,马文娟.基于复合层次包围盒的实时碰撞检测研究[M].系统仿真学报.2008年1月,第20卷第2期:372-377
    105. 范昭炜.实时碰撞检测技术研究[D].浙江大学.2003.
    106.王天柱.变形物体碰撞检测技术研究[D].吉林大学.2006.
    107. 魏迎梅,王涌等.刚体在软体对象环境中的碰撞检测的研究[M].计算机学报.2005,9:802-808.
    108. 涂炜旻.虚拟手术中碰撞检测技术的研究[D].哈尔滨工程大学.2007.
    109. 赵伟,李文辉.一种快速的基于球体混合重建的碰撞检测算法[M].计算机科学.2009年7期:164-169.
    110. 杨世文,郑慕侨.摩擦力非线性建模与仿真[J].系统仿真学报,2002,14(10):1365-1368.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700