基于增强现实理论的神经外科头颅体表定位系统
|
摘要
神经导航系统设备昂贵、操作复杂且普及率低,仅存于部分大型医疗机构。为了满足其他中小型医疗机构对于神经外科手术导航系统的需求,本文阐述了一种基于增强现实(AR)理论开发的头颅体表定位系统。该系统借鉴AR技术将虚拟世界影像与现实世界影像相融合的思想,将患者头部计算机断层扫描成像(CT)或磁共振成像(MRI)与现实中患者头颅进行投影融合,实现头颅体表定位。文章重点讨论医学图像可视化中医学数字成像和通信(DICOM)国际标准、三维重建、AR图像图层融合等关键点。本研究测试表明,该系统适用于多款手机,能实现二维图像展示、三维重建渲染以及临床头颅体表定位应用,对于辅助神经外科手术头颅体表定位具有一定意义。
Neurosurgery navigation system, which is expensive and complicated to operate, has a low penetration rate, and is only found in some large medical institutions. In order to meet the needs of other small and medium-sized medical institutions for neurosurgical navigation systems, the scalp localization system of neurosurgery based on augmented reality(AR) theory was developed. AR technology is used to fuse virtual world images with real images. The system integrates computed tomography(CT) or magnetic resonance imaging(MRI) with the patient's head in real life to achieve the scalp positioning. This article focuses on the key points of Digital Imaging and Communications in Medicine(DICOM) standard, three-dimensional(3D) reconstruction, and AR image layer fusion in medical image visualization.This research shows that the system is suitable for a variety of mobile phones, can achieve two-dimensional(2D) image display, 3D rendering and clinical scalp positioning application, which has a certain significance for the auxiliary neurosurgical head surface positioning.
Neurosurgery navigation system, which is expensive and complicated to operate, has a low penetration rate, and is only found in some large medical institutions. In order to meet the needs of other small and medium-sized medical institutions for neurosurgical navigation systems, the scalp localization system of neurosurgery based on augmented reality(AR) theory was developed. AR technology is used to fuse virtual world images with real images. The system integrates computed tomography(CT) or magnetic resonance imaging(MRI) with the patient's head in real life to achieve the scalp positioning. This article focuses on the key points of Digital Imaging and Communications in Medicine(DICOM) standard, three-dimensional(3D) reconstruction, and AR image layer fusion in medical image visualization.This research shows that the system is suitable for a variety of mobile phones, can achieve two-dimensional(2D) image display, 3D rendering and clinical scalp positioning application, which has a certain significance for the auxiliary neurosurgical head surface positioning.
引文
1周良辅.神经导航外科学.上海:上海科技教育出版社,2008.
2 Lalonde J F,Narasimhan S G,Efros A A.What do the sun and the sky tell us about the camera?Int J Comput Vis,2010,88(1):24-51.
3贺长宇,刘越,王涌天.用于增强现实手术导航系统的光学-惯性混合跟踪方法.计算机辅助设计与图形学学报,2016,28(3):513-519.
4 Eftekhar B.A smartphone app to assist scalp localization of superficial supratentorial lesions--Technical Note. World Neurosurg,2016,85:359-363.
5 Song Fei,Hou Yuanzheng,Sun Guochen,et al. In vivo visualization of the facial nerve in patients with acoustic neuroma using diffusion tensor imaging-based fiber tracking.J Neurosurg,2016,125(4):787-794.
6郭宇,马翔宇,张学海,等.手机Sina程序进行幕上病变辅助定位的初步探讨.山东大学学报:医学版,2017,55(8):99-103.
7 Dogan I,Eroglu U,Ozgural O,et al.Visualization of superficial cerebral lesions using a smartphone application.Turk Neurosurg,2018,28(3):349-355.
8杨博菲.基于Android平台的DICOM医学图像编辑系统设计.天津:天津大学,2012.
9田捷,薛健,戴亚康.医学影像算法设计与平台构建.北京:清华大学出版社,2007.
10卢朝峰.CT图像三维重建的研究与实现.上海:复旦大学,2013.
11向俊,叶青,袁勋.基于网页的可视化网络医学影像平台设计.生物医学工程学杂志,2017,34(2):233-238.
12 Dietrich C A,Scheidegger C E,Comba J L D,et al. Marching Cubes without skinny triangles.Comput Sci Eng,2009,11(2):82-87.
13闫甲鹏,何汉武,陈和恩,等.基于移动终端的增强现实虚实融合技术.中国科技论文,2015,10(16):1890-1893.
14 Sheng Hansong,You Chaoguo,Yang Liang,et al. Trephination mini-craniectomy for traumatic posterior fossa epidural hematomas in selected pediatric patients.Chin J Traumatol,2017,20(4):212-215.
2 Lalonde J F,Narasimhan S G,Efros A A.What do the sun and the sky tell us about the camera?Int J Comput Vis,2010,88(1):24-51.
3贺长宇,刘越,王涌天.用于增强现实手术导航系统的光学-惯性混合跟踪方法.计算机辅助设计与图形学学报,2016,28(3):513-519.
4 Eftekhar B.A smartphone app to assist scalp localization of superficial supratentorial lesions--Technical Note. World Neurosurg,2016,85:359-363.
5 Song Fei,Hou Yuanzheng,Sun Guochen,et al. In vivo visualization of the facial nerve in patients with acoustic neuroma using diffusion tensor imaging-based fiber tracking.J Neurosurg,2016,125(4):787-794.
6郭宇,马翔宇,张学海,等.手机Sina程序进行幕上病变辅助定位的初步探讨.山东大学学报:医学版,2017,55(8):99-103.
7 Dogan I,Eroglu U,Ozgural O,et al.Visualization of superficial cerebral lesions using a smartphone application.Turk Neurosurg,2018,28(3):349-355.
8杨博菲.基于Android平台的DICOM医学图像编辑系统设计.天津:天津大学,2012.
9田捷,薛健,戴亚康.医学影像算法设计与平台构建.北京:清华大学出版社,2007.
10卢朝峰.CT图像三维重建的研究与实现.上海:复旦大学,2013.
11向俊,叶青,袁勋.基于网页的可视化网络医学影像平台设计.生物医学工程学杂志,2017,34(2):233-238.
12 Dietrich C A,Scheidegger C E,Comba J L D,et al. Marching Cubes without skinny triangles.Comput Sci Eng,2009,11(2):82-87.
13闫甲鹏,何汉武,陈和恩,等.基于移动终端的增强现实虚实融合技术.中国科技论文,2015,10(16):1890-1893.
14 Sheng Hansong,You Chaoguo,Yang Liang,et al. Trephination mini-craniectomy for traumatic posterior fossa epidural hematomas in selected pediatric patients.Chin J Traumatol,2017,20(4):212-215.