医疗过程虚拟示教系统中的行为仿真研究
|
摘要
医疗过程虚拟示教系统是虚拟现实技术在医学领域的应用，目的是使用计算机技术来模拟医疗过程中所涉及的各种行为动作，以构成逼真的可视化学习环境，满足医学教育实验教学的需要和发展。
现实的医疗过程包含了纷繁的组织器官的运动行为、病人的反应行为、医生的治疗行为以及各种交互行为等。为了使虚拟示教系统增强逼真感，就必须对以上行为进行模拟。
本文以分娩过程为例，对虚拟示教的部分关键技术和医疗过程虚拟示教系统的实现方法进行了分析和研究，重点研究了医疗过程虚拟示教行为建模和运动规划方法及其实现技术。并完成了原型系统的开发。论文研究工作如下：
(1)分析医疗过程虚拟示教系统的设计目标，对系统的各模块功能进行了描述，研究了系统的技术方案和系统的开发平台。
(2)研究几何建模、物理建模、行为建模的几个关键技术问题，包括虚拟医疗环境的构建、骨骼系统的人体运动仿真、基于三次样条插补的关键帧控制、软体运动仿真等，并提出相应的解决方案。
(3)对医疗过程规划及仿真的设计思想和实现方法进行了研究。以医疗对象的空间矩阵变换这一基本原理为基础，通过三次样条插补的关键帧技术结合动态导入模型技术，进行医疗行为建模与运动规划和医疗过程仿真研究。通过人机交互的方式对虚拟对象的运动路径进行仿真。
(4)以分娩助产训练为对象，利用虚拟现实开发平台EON Studio 5.0结合VC++6.0高级编程语言及JavaScrpit脚本语言在Windows XP系统上进行原型系统的开发。该系统可用于实验教学中的医疗过程模拟、医疗路径规划、医疗操作训练等。
Virtual training system of medical treatment process is one application of the virtual reality in medical field. The main objective is to use the computer technology to simulate the behaviors during the medical treatment process , so as to construct a visualized environment for learning.Meanwhile, the system can meet the needs of experimental training of the medical education.
The real medical process contains numerous movements of organs, the reactions of patients, treating behavior of doctors and their interactive behaviors, etc. In order to enhance the virtual training system highly immersive sense, it is necessary to conduct more simulated.
This dissertation based on the delivery process as an example, analysis and studies some key technologies of the medical virtual training system and the implementation methods of virtual medical training process system. We focus to find a new methed for the virtual behavior modeling of the medical process and movement planning. A prototype system was achived based on these methods. The main contribution is showed below:
(1) We analyze the design objectives of the medical virtual training system, describe the modules' function of the system, study the technology programs and the development platform of the system.
(2) We studies several key technologies issues of the medical virtual training system about the geometric modeling, physical modeling, behavioral modeling the entire process, including construction of the medical virtual environment, Skeleton system of the human motion simulation, key frame control based on the cubic spline interpolation, soft object simulation, and make decisions related to those technologies.
(3) We study the design concept and implementation methods of the medical process planning and simulation. Firstly, based on the matrix transform principle of the medical operation space, we combined the key frame technology of cubic spline interpolation with the dynamic-model loading techniques. Then, we accomplished the medical behavior modeling and motion process planning and medical research simulation.
Finally, based on the platform of VC++6.0, Eon Studio 5.0, JavaScrpit and Windows XP, the prototype of visualized and interactive training in the virtual environment system was accomplished. This system can be used for medical treatment process simulation, medical treatment planning, virtual training in the medical treatment process in experimental training.
现实的医疗过程包含了纷繁的组织器官的运动行为、病人的反应行为、医生的治疗行为以及各种交互行为等。为了使虚拟示教系统增强逼真感，就必须对以上行为进行模拟。
本文以分娩过程为例，对虚拟示教的部分关键技术和医疗过程虚拟示教系统的实现方法进行了分析和研究，重点研究了医疗过程虚拟示教行为建模和运动规划方法及其实现技术。并完成了原型系统的开发。论文研究工作如下：
(1)分析医疗过程虚拟示教系统的设计目标，对系统的各模块功能进行了描述，研究了系统的技术方案和系统的开发平台。
(2)研究几何建模、物理建模、行为建模的几个关键技术问题，包括虚拟医疗环境的构建、骨骼系统的人体运动仿真、基于三次样条插补的关键帧控制、软体运动仿真等，并提出相应的解决方案。
(3)对医疗过程规划及仿真的设计思想和实现方法进行了研究。以医疗对象的空间矩阵变换这一基本原理为基础，通过三次样条插补的关键帧技术结合动态导入模型技术，进行医疗行为建模与运动规划和医疗过程仿真研究。通过人机交互的方式对虚拟对象的运动路径进行仿真。
(4)以分娩助产训练为对象，利用虚拟现实开发平台EON Studio 5.0结合VC++6.0高级编程语言及JavaScrpit脚本语言在Windows XP系统上进行原型系统的开发。该系统可用于实验教学中的医疗过程模拟、医疗路径规划、医疗操作训练等。
Virtual training system of medical treatment process is one application of the virtual reality in medical field. The main objective is to use the computer technology to simulate the behaviors during the medical treatment process , so as to construct a visualized environment for learning.Meanwhile, the system can meet the needs of experimental training of the medical education.
The real medical process contains numerous movements of organs, the reactions of patients, treating behavior of doctors and their interactive behaviors, etc. In order to enhance the virtual training system highly immersive sense, it is necessary to conduct more simulated.
This dissertation based on the delivery process as an example, analysis and studies some key technologies of the medical virtual training system and the implementation methods of virtual medical training process system. We focus to find a new methed for the virtual behavior modeling of the medical process and movement planning. A prototype system was achived based on these methods. The main contribution is showed below:
(1) We analyze the design objectives of the medical virtual training system, describe the modules' function of the system, study the technology programs and the development platform of the system.
(2) We studies several key technologies issues of the medical virtual training system about the geometric modeling, physical modeling, behavioral modeling the entire process, including construction of the medical virtual environment, Skeleton system of the human motion simulation, key frame control based on the cubic spline interpolation, soft object simulation, and make decisions related to those technologies.
(3) We study the design concept and implementation methods of the medical process planning and simulation. Firstly, based on the matrix transform principle of the medical operation space, we combined the key frame technology of cubic spline interpolation with the dynamic-model loading techniques. Then, we accomplished the medical behavior modeling and motion process planning and medical research simulation.
Finally, based on the platform of VC++6.0, Eon Studio 5.0, JavaScrpit and Windows XP, the prototype of visualized and interactive training in the virtual environment system was accomplished. This system can be used for medical treatment process simulation, medical treatment planning, virtual training in the medical treatment process in experimental training.
引文
[1]王芬芳，张保华，贺漫古．高校实验教学改革的目标与任务[J]．教育与现代化，2000，(3)：52-551．
[2]Parikh M.,Rasmussen M.,Brubaker L.Three dimensional virtual reality model of the normal female pelvic floor[J]. Annals of Biomedical Engineering,2004, 32(2): 292-6.
[3]范江波，周明全，耿国华．虚拟内窥镜技术的研究与实现[J]．微机发展，2000，(6)：60-63．
[4]Becker, A.A.,Wang, P.,Jones.Virtual reality simulation of surgery with haptie feedback based on the boundary element method[J].Computers & Structures,2007(4):331-9.
[5]Panchaphongsaphak, B.,Burgkart,R.,Riener.Three-dimensional touch interface for medical education[J].IEEE Transactions on Information Technology in Biomedicine,2007(5):251-63.
[6]肖田元等著．虚拟制造[M]．北京：清华大学出版社，2003．
[7]GAO Lingling, ZHANG Meife. Effect of delivery education on psychology and labor of primipar [J]. Chinese Public Health, 2005, 21(2): 209-210.
[8]冯金辉，张晓鹏，田捷．虚拟内窥镜的研究发展现状[J]．CT理论与应用，1999，8(3)：20-24．
[9]Dufour, J.C.,Cuggia, M.,Soula.An integrated approach to distance learning with digital video in the French-speaking Virtual Medical University[M].International Journal of Medical Informatics,2007(5)369-376.
[10]科技之光．内窥镜[EB]．2006-2a http://www.losn.com.cn/kxyfm/medeine/16.htm．
[11]中国癌症信息库．医用内窥镜介绍[EB]．http://www.bufotanine.com/examine/1037667617.html.
[12]夏强，Gerhard Hobarth，Mustafa Yanik等．仿真外科训练系统在微创外科的应用[J]．中华消化内镜杂志，2002，12(6)：243-246．
[13]王勇军，吴鹏，郭光友等．支持力反馈的鼻腔镜虚拟手术仿真系统[J]．系统仿真学报，2001，13(3)：404-407．
[14]Zhao Lian-peng.Liaoning, China.Inspect research of method according to medical treatment prescription intelligence of association rules[j].Computer Engineering and Applications,2006,11 (2):223-5.
[15]Scerbo, M.W.,Bliss, J.P.,Schmidt.The efficacy of a medical virtual reality simulator for training phlebotomy[J].Human Factors,Spring 2006(3):72-84.
[16]邹湘军，孙健，何汉武等．虚拟现实技术的演变发展与展望[J]．系统仿真学报，2004，16(9)：1905-1909．
[17]Kong Beihua, Shen Keng, Ma Ding, et al. Obstetrics and gynecology[J].Higher Education Press, 2005:68-83
[18]孔北华主编．妇产科学[M]．北京：高等教育出版社，2005．
[19]杨克俭，刘舒燕，陈定方．虚拟现实中的建模方法[J]．武汉理工大学学报，2001．23(6)：47-50．
[20]王勇军，王意洁，徐明等．行为建模语言的研究与实现[J]．计算机工程，1999．25(2)．8-10．
[21]杨轶璐，胡英，刘纪红等．虚拟现实技术及其在现代医学中的应用[J]．信息与控制，2003，32(3)：251-255．
[22]唐雷．虚拟手术初解[EB]．2001-7 http://www.pcvr.com.cn/vrweb/disquisition/042.htm．
[23]爱云，原魁．基于真实切割的虚拟手术中力觉模型建模方法研究[J]．中国体视学与图像分析，2004，9(2)：803-806．
[24]Provot X. Deformation Constraints in a Mass-Spring Model to Describe RigidCloth Behavior [R]. Proceedings of Graphics Interface95.147-154.
[25]阎丽霞，王健宁，石教英．虚拟手术中的软组织变形仿真研究[J]．系统仿真学报，2001，13(3)：294-297．
[26]Cynthia D.B.Steven S.Interactive Cutting of 3D Surface Meshes[J].Computer And Graphics,2001,25:635-642.
[27]Hong-Bin Pan, Gui-Ping Lu, Han-Wu He, Jian Sun, Study on Rapid Construction of Virtual Prototype Based on EON Studio[A].Proceedings of the 3rd International Conference on Responsive Manufacturing, Guangzhou, China,2005.
[28]李新照．口腔虚拟手术仿真研究[D]．青岛：青岛大学，2006．
[29]司国海．基于虚拟现实技术井下作业培训系统的研究与实现[D]．哈尔滨：哈尔滨工业大学，2003．
[30]李基沛．基于虚拟现实技术在微创手术培训机中的应用[D]．天津：天津大学，2005．
[31]Smith DM. Aston S, Cutting CB, et al. Designing a virtual reality model for aesthetic surgery[J]. Plast Reconstr Surg,2005.11 (6): 893-897.
[32]胡永祥．医学图象三维重建及可视化技术研究[D]．广州：华南师范大学，2005．
[33]蒙世斌．交互式虚拟人脑解剖系统[D]．西安：西北工业大学，2006．
[34]何必航．虚拟消化道内窥镜训练系统[D]．杭州：浙江大学，2006．
[35]巨安丽．虚拟医院的理论_方法及实现研究[D]．西安：西北工业大学，2005．
[36]瞿炜娜．基于虚拟现实技术的虚拟实验室的研究与实现[D]．大连：大庆石油学院，2003．
[37]孙明睿．三维数字可视化技术的研究[D]．天津：天津大学，2004．
[38]小泉英明，渡边英寿．医用画像机器技术[J]．现状医科器械学，1996 66(12)：690-697．
[39]Chou B, Handa VL. Simulators and virtual reality in surgical education[J].Obstet Gynecol Clin NorthAm, 2006. 33: 283-296.
[40]Efimov IR. Virtual electrodes in virtual reality of defibrillation[J].Cardiovasc Electrophysiol, 2002. 13: 680-681.
[41]Schiemann T, Freudenberg J, Pflesser B,et al. Exploring the Visible Human using the VOXEL-MAN framework[J].Comput Med Imaging Graph, 2000 24: 127-132.
[42]John R Wilson. Virtual environments and ergonomic, needs and opportunities[J]. Ergonomics, 1997.40 (10): 1057-1077.
[43]N Valerie&S Cathleens. Space flight[M].Smithsonian Guide Macmillian U. S. A,1996: 25-35.
[44]Khalifa YM, Bogorad D, Gibson V, Peifer J, Nussbaum J.Virtual reality in ophthalmology training[J]. Surv Ophthalmol, 2006 51: 259-273.
[45]吴悦明．面向web的数控机床虚拟操作与加工仿真研究[D]，广州：广东工业大学，2005．
[46]钟世镇，李华，罗述谦等．中国数字化虚拟人研究[A]．香山科学会议，2001，174：4-12．
[47]陈俊，李健．从《分娩机制》的制作看三维动画在医学教育中的应用[J]．中国医学教育技术，2005，19(4)：294-296．
[48]Hon D. Medical reality and virtual reality[J].Virtual Reality World, 1994,2(2): 58-62.
[49]Denavit J,Hartenbery R S.A kinematic notation for lower pairmechanisms based on matrices [J]. Journal of Applied Mechanics,1955,23: 215-221.
[50]王子呈，唐泽圣，王田苗等．基于VR的计算机辅助立体定向神经外科手术系统[J]．计算机学报，2000，23(6)：931-937．
[51]Richard M. Satava, Medical Virtual Reality[A].The Current Status of the Future,in Proc.4th Conf. Medicine Meets Virtual Reality, SanDiego,CA, 1996,pp. 100-106.
[52]Joel Brown, Real-Time Soft Tissue and Suture Simulation[D].PhD Dissertation, Department of Computer Science of Stanford University, May,2003.
[53]阎丽霞，虚拟手术关键技术研究[D]．杭州：浙江大学计算机科学系，2001．
[54]Jia J T.Merge and Emulation of Seabed Terrain and Ocean Wave[D].Dalian:Dalian Academy of Naval Vessels,2004.
[55]黄海明，刘金刚，高申玉．一种适合实时运动及变形的虚拟人建模方案[J]计算机应用，2004，(S2)．
[56]贾俊涛．海底地形和海浪的融合与仿真[D]．大连：海军大连舰艇学院，2004．
[57]元建胜等，海浪的动态视觉仿真．海洋科学进展[M]．2005，(4)：498-503．
[58]刘箴．虚拟人的行为规划模型研究[J]．系统仿真学报，2004，(10)．
[59]卢晓军，李焱，贺汉根．关节化虚拟人手臂动作的建模及其仿真实现[J]系统仿真学报，2005，(02)．
[60]卢晓军，李焱，贺汉根．一种用于动态环境的虚拟人行走规划方法[J]．计算机工程与科学，2004，(10)．
[61]钟世镇．虚拟人体将为微创外科增添新的技术[J]．中国微创外科杂志，2003，3(6)：461-462．
[62]张青．虚拟手术中人体软组织变形仿真[D]．青岛：青岛大学，2003．
[2]Parikh M.,Rasmussen M.,Brubaker L.Three dimensional virtual reality model of the normal female pelvic floor[J]. Annals of Biomedical Engineering,2004, 32(2): 292-6.
[3]范江波，周明全，耿国华．虚拟内窥镜技术的研究与实现[J]．微机发展，2000，(6)：60-63．
[4]Becker, A.A.,Wang, P.,Jones.Virtual reality simulation of surgery with haptie feedback based on the boundary element method[J].Computers & Structures,2007(4):331-9.
[5]Panchaphongsaphak, B.,Burgkart,R.,Riener.Three-dimensional touch interface for medical education[J].IEEE Transactions on Information Technology in Biomedicine,2007(5):251-63.
[6]肖田元等著．虚拟制造[M]．北京：清华大学出版社，2003．
[7]GAO Lingling, ZHANG Meife. Effect of delivery education on psychology and labor of primipar [J]. Chinese Public Health, 2005, 21(2): 209-210.
[8]冯金辉，张晓鹏，田捷．虚拟内窥镜的研究发展现状[J]．CT理论与应用，1999，8(3)：20-24．
[9]Dufour, J.C.,Cuggia, M.,Soula.An integrated approach to distance learning with digital video in the French-speaking Virtual Medical University[M].International Journal of Medical Informatics,2007(5)369-376.
[10]科技之光．内窥镜[EB]．2006-2a http://www.losn.com.cn/kxyfm/medeine/16.htm．
[11]中国癌症信息库．医用内窥镜介绍[EB]．http://www.bufotanine.com/examine/1037667617.html.
[12]夏强，Gerhard Hobarth，Mustafa Yanik等．仿真外科训练系统在微创外科的应用[J]．中华消化内镜杂志，2002，12(6)：243-246．
[13]王勇军，吴鹏，郭光友等．支持力反馈的鼻腔镜虚拟手术仿真系统[J]．系统仿真学报，2001，13(3)：404-407．
[14]Zhao Lian-peng.Liaoning, China.Inspect research of method according to medical treatment prescription intelligence of association rules[j].Computer Engineering and Applications,2006,11 (2):223-5.
[15]Scerbo, M.W.,Bliss, J.P.,Schmidt.The efficacy of a medical virtual reality simulator for training phlebotomy[J].Human Factors,Spring 2006(3):72-84.
[16]邹湘军，孙健，何汉武等．虚拟现实技术的演变发展与展望[J]．系统仿真学报，2004，16(9)：1905-1909．
[17]Kong Beihua, Shen Keng, Ma Ding, et al. Obstetrics and gynecology[J].Higher Education Press, 2005:68-83
[18]孔北华主编．妇产科学[M]．北京：高等教育出版社，2005．
[19]杨克俭，刘舒燕，陈定方．虚拟现实中的建模方法[J]．武汉理工大学学报，2001．23(6)：47-50．
[20]王勇军，王意洁，徐明等．行为建模语言的研究与实现[J]．计算机工程，1999．25(2)．8-10．
[21]杨轶璐，胡英，刘纪红等．虚拟现实技术及其在现代医学中的应用[J]．信息与控制，2003，32(3)：251-255．
[22]唐雷．虚拟手术初解[EB]．2001-7 http://www.pcvr.com.cn/vrweb/disquisition/042.htm．
[23]爱云，原魁．基于真实切割的虚拟手术中力觉模型建模方法研究[J]．中国体视学与图像分析，2004，9(2)：803-806．
[24]Provot X. Deformation Constraints in a Mass-Spring Model to Describe RigidCloth Behavior [R]. Proceedings of Graphics Interface95.147-154.
[25]阎丽霞，王健宁，石教英．虚拟手术中的软组织变形仿真研究[J]．系统仿真学报，2001，13(3)：294-297．
[26]Cynthia D.B.Steven S.Interactive Cutting of 3D Surface Meshes[J].Computer And Graphics,2001,25:635-642.
[27]Hong-Bin Pan, Gui-Ping Lu, Han-Wu He, Jian Sun, Study on Rapid Construction of Virtual Prototype Based on EON Studio[A].Proceedings of the 3rd International Conference on Responsive Manufacturing, Guangzhou, China,2005.
[28]李新照．口腔虚拟手术仿真研究[D]．青岛：青岛大学，2006．
[29]司国海．基于虚拟现实技术井下作业培训系统的研究与实现[D]．哈尔滨：哈尔滨工业大学，2003．
[30]李基沛．基于虚拟现实技术在微创手术培训机中的应用[D]．天津：天津大学，2005．
[31]Smith DM. Aston S, Cutting CB, et al. Designing a virtual reality model for aesthetic surgery[J]. Plast Reconstr Surg,2005.11 (6): 893-897.
[32]胡永祥．医学图象三维重建及可视化技术研究[D]．广州：华南师范大学，2005．
[33]蒙世斌．交互式虚拟人脑解剖系统[D]．西安：西北工业大学，2006．
[34]何必航．虚拟消化道内窥镜训练系统[D]．杭州：浙江大学，2006．
[35]巨安丽．虚拟医院的理论_方法及实现研究[D]．西安：西北工业大学，2005．
[36]瞿炜娜．基于虚拟现实技术的虚拟实验室的研究与实现[D]．大连：大庆石油学院，2003．
[37]孙明睿．三维数字可视化技术的研究[D]．天津：天津大学，2004．
[38]小泉英明，渡边英寿．医用画像机器技术[J]．现状医科器械学，1996 66(12)：690-697．
[39]Chou B, Handa VL. Simulators and virtual reality in surgical education[J].Obstet Gynecol Clin NorthAm, 2006. 33: 283-296.
[40]Efimov IR. Virtual electrodes in virtual reality of defibrillation[J].Cardiovasc Electrophysiol, 2002. 13: 680-681.
[41]Schiemann T, Freudenberg J, Pflesser B,et al. Exploring the Visible Human using the VOXEL-MAN framework[J].Comput Med Imaging Graph, 2000 24: 127-132.
[42]John R Wilson. Virtual environments and ergonomic, needs and opportunities[J]. Ergonomics, 1997.40 (10): 1057-1077.
[43]N Valerie&S Cathleens. Space flight[M].Smithsonian Guide Macmillian U. S. A,1996: 25-35.
[44]Khalifa YM, Bogorad D, Gibson V, Peifer J, Nussbaum J.Virtual reality in ophthalmology training[J]. Surv Ophthalmol, 2006 51: 259-273.
[45]吴悦明．面向web的数控机床虚拟操作与加工仿真研究[D]，广州：广东工业大学，2005．
[46]钟世镇，李华，罗述谦等．中国数字化虚拟人研究[A]．香山科学会议，2001，174：4-12．
[47]陈俊，李健．从《分娩机制》的制作看三维动画在医学教育中的应用[J]．中国医学教育技术，2005，19(4)：294-296．
[48]Hon D. Medical reality and virtual reality[J].Virtual Reality World, 1994,2(2): 58-62.
[49]Denavit J,Hartenbery R S.A kinematic notation for lower pairmechanisms based on matrices [J]. Journal of Applied Mechanics,1955,23: 215-221.
[50]王子呈，唐泽圣，王田苗等．基于VR的计算机辅助立体定向神经外科手术系统[J]．计算机学报，2000，23(6)：931-937．
[51]Richard M. Satava, Medical Virtual Reality[A].The Current Status of the Future,in Proc.4th Conf. Medicine Meets Virtual Reality, SanDiego,CA, 1996,pp. 100-106.
[52]Joel Brown, Real-Time Soft Tissue and Suture Simulation[D].PhD Dissertation, Department of Computer Science of Stanford University, May,2003.
[53]阎丽霞，虚拟手术关键技术研究[D]．杭州：浙江大学计算机科学系，2001．
[54]Jia J T.Merge and Emulation of Seabed Terrain and Ocean Wave[D].Dalian:Dalian Academy of Naval Vessels,2004.
[55]黄海明，刘金刚，高申玉．一种适合实时运动及变形的虚拟人建模方案[J]计算机应用，2004，(S2)．
[56]贾俊涛．海底地形和海浪的融合与仿真[D]．大连：海军大连舰艇学院，2004．
[57]元建胜等，海浪的动态视觉仿真．海洋科学进展[M]．2005，(4)：498-503．
[58]刘箴．虚拟人的行为规划模型研究[J]．系统仿真学报，2004，(10)．
[59]卢晓军，李焱，贺汉根．关节化虚拟人手臂动作的建模及其仿真实现[J]系统仿真学报，2005，(02)．
[60]卢晓军，李焱，贺汉根．一种用于动态环境的虚拟人行走规划方法[J]．计算机工程与科学，2004，(10)．
[61]钟世镇．虚拟人体将为微创外科增添新的技术[J]．中国微创外科杂志，2003，3(6)：461-462．
[62]张青．虚拟手术中人体软组织变形仿真[D]．青岛：青岛大学，2003．