基于网格人脸模型的局部器官真实感建模方法研究与实现
|
摘要
真实感三维人脸重建技术是计算机图形学领域研究的热点。本文针对基于网格模型的人脸真实感重建方法,分析了面部三维网格简化方法及局部器官特征的定位、人眼模型及运动控制和头发生成等关键技术,实现了基于网格模型的三维人脸真实感建模系统,具有重要的理论意义和实际应用价值。主要研究工作如下：
(1)采用基于折叠的网格简化算法简化复原的头部模型,达到了减少网格顶点和三角形面片的目的。应用基于模板的器官匹配法,实现了眼睛区域的快速定位。
(2)提出了一种改进的基于球体运动的真实感眼睛模拟方法,分别将人眼眼球和眼皮用球体和抛物线近似,其运动通过眼球和眼皮上的特征点控制,实现了三维人眼的建模和运动的控制。
(3)提出了一种基于广义圆柱体的头发股生成算法,将头皮划分为若干个小正方形,分别以每个正方形的中心为头发股生长点构造广义圆柱体,使用该圆柱体逐个地对头发股进行模拟,从而生成逼真的头发模型。
(4)提出了一种改进的基于NURBS曲面的整体头发生成算法,该算法采用NURBS参数曲面模拟整体头发,通过曲面上的特征点控制发型,使用alpha映射完成渲染,实现了具有真实感的三维头发快速生成。
(5)结合真实感处理的实际需要,以Visual C++6.0和OpenGL为工具,设计并实现了三维人脸眼睛头发真实感建模系统,并验证实现了本文所涉及的相关真实感处理算法。
Realistic 3D face reconstruction is a hotspot in the field of computer graphics. In this paper, it included 3D mesh simplification and local organ characteristics position on the craniofacial face, eye model and the motion of eye and hair generation in the realistic face modeling system based on grid model. These has been important theoretical and practical value.
The main process:
(1) In order to reduce the number of mesh vertices and triangle surfaces, we may handle with head models in mesh simplification based on fold. It will fastly position the eye area in organ matching based on template.
(2) A method of realistic eye simulation based on ball movement. It will respectively replace human eyes and eyelids with ball and parabola. Its movement was controlled by feature points on their models. To complete 3D eye modeling and movement controlling.
(3) A algorithm of hair strand generation based on generalized cylinder is proposed. The scale is divided into several small squares, It will chose the growth points which was considered as hair root in the center of each small square. The generalized cylinder will complete the simulation of hair strand one by one to generate realistic hair model.
(4) A modified algorithm of overall hair generation based on NURBS is proposed. It will simulate overall hair in NURBS parametric surface and control hair style by feature points on the surface. At last, the final rendering was completed by using the alpha map. After these steps, it will quickly generate realistic 3D hair.
(5) Combined with the practical needs of realistic face reality, we develop 3D realistic face, eyes and hair modeling system by Visual C++6.0 and open source 3D graphics library for the virtual operation. This research is supported by National Natural Science Foundation of China(60736008).
(1)采用基于折叠的网格简化算法简化复原的头部模型,达到了减少网格顶点和三角形面片的目的。应用基于模板的器官匹配法,实现了眼睛区域的快速定位。
(2)提出了一种改进的基于球体运动的真实感眼睛模拟方法,分别将人眼眼球和眼皮用球体和抛物线近似,其运动通过眼球和眼皮上的特征点控制,实现了三维人眼的建模和运动的控制。
(3)提出了一种基于广义圆柱体的头发股生成算法,将头皮划分为若干个小正方形,分别以每个正方形的中心为头发股生长点构造广义圆柱体,使用该圆柱体逐个地对头发股进行模拟,从而生成逼真的头发模型。
(4)提出了一种改进的基于NURBS曲面的整体头发生成算法,该算法采用NURBS参数曲面模拟整体头发,通过曲面上的特征点控制发型,使用alpha映射完成渲染,实现了具有真实感的三维头发快速生成。
(5)结合真实感处理的实际需要,以Visual C++6.0和OpenGL为工具,设计并实现了三维人脸眼睛头发真实感建模系统,并验证实现了本文所涉及的相关真实感处理算法。
Realistic 3D face reconstruction is a hotspot in the field of computer graphics. In this paper, it included 3D mesh simplification and local organ characteristics position on the craniofacial face, eye model and the motion of eye and hair generation in the realistic face modeling system based on grid model. These has been important theoretical and practical value.
The main process:
(1) In order to reduce the number of mesh vertices and triangle surfaces, we may handle with head models in mesh simplification based on fold. It will fastly position the eye area in organ matching based on template.
(2) A method of realistic eye simulation based on ball movement. It will respectively replace human eyes and eyelids with ball and parabola. Its movement was controlled by feature points on their models. To complete 3D eye modeling and movement controlling.
(3) A algorithm of hair strand generation based on generalized cylinder is proposed. The scale is divided into several small squares, It will chose the growth points which was considered as hair root in the center of each small square. The generalized cylinder will complete the simulation of hair strand one by one to generate realistic hair model.
(4) A modified algorithm of overall hair generation based on NURBS is proposed. It will simulate overall hair in NURBS parametric surface and control hair style by feature points on the surface. At last, the final rendering was completed by using the alpha map. After these steps, it will quickly generate realistic 3D hair.
(5) Combined with the practical needs of realistic face reality, we develop 3D realistic face, eyes and hair modeling system by Visual C++6.0 and open source 3D graphics library for the virtual operation. This research is supported by National Natural Science Foundation of China(60736008).
引文
[1]霍青松.颅骨面貌真实感处理关键技术研究[D].西安：西北大学,2009.
[2]徐琳,袁保宗,高文.真实感人脸建模研究的进展与展望[J].软件学报, Vol.14,No.4.
[3]Parke F. Computer generated animation of faces. Technical Repoart. AD-762022,1972. 1-68.
[4]Ip Horsace HS, Chan CS. Script-Based facial gesture and speech animation using a NURBS based face model[J]. Computer and Graphics,1996,20(6):881-891.
[5]Elson M. Displacement facial animation techniques[J]. In:State of the Art in Facial Animation, ACM Siggraph'90 Course Notes. Vol26.1990.21-42.
[6]F.I. Parke. A Parametric Model of Human Faces[D]. PhD thesis, University of Utah, Salt Lake City,1974.
[7]胡永利真实感三维人脸建模及应用研究[D].北京：北京工业大学,2004.
[8]Ekman P, Friesen WV. Manual for the Facial Action Coding System[M]. Palo, CA: Consulting Psychologist Press, Inc.,1978.
[9]Waters K. A muscle model for animating three-dimensional facial expression. Computer Graphics[J],1987,22(4):17-24.
[10]Thalmann NM, Primeau NE, Thalmann D. Abstract muscle actiongs procedures for human face animation. Visual Computer[J],1988,3(5):290-297.
[11]Pighin F, Hecher J, Lischinski D,Sizeliski etc. Synthesizing realistic facial expressions from photographs[A]. In:SIGGRAPH 1998 Conference Proceedings:Computer Graphics Annual Conference Series.1998.75-84.
[12]晏洁,高文.基于一般人脸模型修改的特定人脸合成技术。计算机辅助设计与图形学学报[J],1999,11(5)：389-394.
[13]尹宝才,高文,晏洁等.基于模型的头部运动估计和面部图像合成,计算机研究与发展[J],1999,369(1)：676-71.
[14]Reeves WT. Particle system-A technique for modeling a class of fuzzy Object[J]. ACM Transaction on Graphics,1983,2(2):91-108.
[15]Kajiya JT, Kay TL. Rendering fur with three dimensional textures[J]. Computer Graphics,1989,23(3):271-280.
[16]Y.Watanabe,Y.Suenaga. A Trigonal Prism-based Method for Hair Image Generation.IEEE Computer Graphics[A],1992,1(12):47-53.
[17]K.i.Anjyo, Y.Usami. A Simple Method for Extracting the Natural Beautyof Hair[J]. In Computer Graphics(SIGGRAPH),1992,7(26):111-120.
[18]Sunnil Hadap, Nadia Magnenat-Thalmann,"Interactive Hair Styler based on Fluid Flow" [A], EuroGraphics 2000.
[19]Dan Witzner Hansen, In the Eye of the Beholder:A survey of Models for Eyes an Gaze [J], IEEE Computer Graphics and Application,2009,1(23):1-21.
[20]J. P. Ivins and J. Porrill. A deformable model of the human iris for measuring small 3-dimensional eye movements[A]. Machine Vision and Applications,11(1):42-51,1998.
[21]A. Pentland, B. Moghaddam, and T. Starner. View-based and modular eigenspaces for face recognition[A]. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'94), Seattle, WA, June 1994.
[22]Y. Matsumoto and A. Zelinsky. An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement[A]. In International Conference on Automatic Face and Gesture Recognition, pages 499-504,2000.
[23]陈永强,王启付,胡汉平.真实感人体头部建模方法研究[J].华中科技大学学,2003.9，Vol 31 No.9
[24]白小丹.真实感三维头发模拟[D].西安：西安电子科技大学,2006.
[25]李现民.三角网格简化及等值面抽取技术[D].北京：中国科学院计算技术研究所,2001.
[26]Kalvin, A.D., Taylor, R.H. Superfaces:Polygonal mesh simplification with bounded error[J]. IEEE Computer Graphics and Applications,1996,16(3):64-77.
[27]P.Cignoni, C.Rocchini, R.Scopigno. Metro Measuring Error on Simplified Surfaces[J]. Computer Graphics Forum,1998,17(2):167-174.
[28]LINDSTROM P. Real-time, continuous level of rendering of height fields [C]. Proceeding of ACM SIGGRAPH96. New Orleans, LA, USA:ACM,1996.
[29]ISLER V, LAURWH, GREEN M. Real-time multi-resolution modeling for complex virtual environments[C] Proc. Of VRST'96. Hongkong:ACM,1996.
[30]崔汉国,陈军,王大宇.基于三角形折叠的LOD算法研究与实现[J],武汉：海军工程大学2008.10,Vol.20. NO.5.
[31]杨颖.三维人脸建模及特征提取技术研究[D].西安：西北大学,2008.
[32]Dan Witzner Hansen, Qiang Ji.In the Eye of the Beholder:A Survey of Models for Eyes and Gaze[J].23rd January 2009.
[33]Zhigang Deng, J,P.Lewis, Ulrich Neumann.Automated Eye Motion Using Texture Synthesis[J].IEEE Computer Graphics and Application,2005,3/4:24-30.
[34]李风鸣,眼科全书[C],北京：人民卫生出版社,1996.
[35]上海第一医学院眼耳鼻喉科医院眼科教研组,眼科学[C],第一版,北京：人民卫生出版社,1976.
[36]M. Kass, A. Witkin, and D. Terzopoulos. Snakes:Active contour models[J]. Int. Journal of Computer Vision,1988:321-331.
[37]P.Lee, J.Badler, N.Badler. Eyes alive[J].ACM Transactions on Graphics,2002,21(3): 637-644.
[38]蔡尚书,程义书,王以孝等.人眼模型及其运动控制[J],中国科学院研究生院学报,Vol.21 No.2,2004.4.
[39]陈盈科,郑伯川.真实感眼部表情的一种实现方法[J].Vol.36 No.102008154-156.
[40]B.Lindelof, B.Forslind, MA.Hedblad. U.Kaveus. Human hair form, morphology revealed by light and scanning electron microscopy and computer aided three-dimensional reconstruction[C]. Arch.Dermatol.1988,124(9):1359-1363.
[41]Sunil Hadap, Marie-Paule Cani, Ming Lin et al. Realistic Hair Simulation Animation and Rendering[C]. SIGGRAPH 2008 Course Notes, May 19,2008.
[42]B.Lindelof, B.Forslind, MA.Hedblad et al. Human hair form morphology revealed by light and scanning electron microscopy and computer aided three-dimensional reconstruction. Arch. Dermatol.124(9):1359-1363,1988.
[43]N.Magnenat-Thalmann and S.Hadap. "State of the art in hair simulation,"in International Workshop on Human Modeling and Animation[J]. Korea Computer Graphics Society, June 2000,pp.3-9.
[44]Zviak,. The Science of Hair Care[C], Marcel Dekker 1986.
[45]Bloomenthal. J.Calculation of Reference Frames Along A Space Curve[C].In A. Glassmer. Editor, Graphics Gems, Academic Press,1990,567-571.
[46]Paul Noble, Wen Tang, Alex Parkison, Ciaran Wills, Modelling and Animating Cartoon Hair[J].2004.
[47]Chuan Koon, Zhiyong Huang, A Simple Physics Model to Animate Human Hair Modeled in 2D Strips in Real Time[J].2001.
[48]Cohen J, Lin MC, Manocha D, Ponamgi M. I-COLLIDE:An interactive and exact collision detection system for large-scale environments [J]. In Proceeding of ACM Interactive 3D Graphics Conference, Monterey, CA, USA,1995:189-196.
[49]Zachmann G, Optimizing the collision detection pipeline [J], In Proceedings of the First International Game Technology Conference(GTEC), HongKong,18-21 January 2001.
[50]J T Kajiya and TL Kay. Rendering fur with three dimensional textures[J]. In J.Lane, editor, Computer Graphics(SIGGRAPH 1989 Processings), July 1989,23:271-280.
[2]徐琳,袁保宗,高文.真实感人脸建模研究的进展与展望[J].软件学报, Vol.14,No.4.
[3]Parke F. Computer generated animation of faces. Technical Repoart. AD-762022,1972. 1-68.
[4]Ip Horsace HS, Chan CS. Script-Based facial gesture and speech animation using a NURBS based face model[J]. Computer and Graphics,1996,20(6):881-891.
[5]Elson M. Displacement facial animation techniques[J]. In:State of the Art in Facial Animation, ACM Siggraph'90 Course Notes. Vol26.1990.21-42.
[6]F.I. Parke. A Parametric Model of Human Faces[D]. PhD thesis, University of Utah, Salt Lake City,1974.
[7]胡永利真实感三维人脸建模及应用研究[D].北京：北京工业大学,2004.
[8]Ekman P, Friesen WV. Manual for the Facial Action Coding System[M]. Palo, CA: Consulting Psychologist Press, Inc.,1978.
[9]Waters K. A muscle model for animating three-dimensional facial expression. Computer Graphics[J],1987,22(4):17-24.
[10]Thalmann NM, Primeau NE, Thalmann D. Abstract muscle actiongs procedures for human face animation. Visual Computer[J],1988,3(5):290-297.
[11]Pighin F, Hecher J, Lischinski D,Sizeliski etc. Synthesizing realistic facial expressions from photographs[A]. In:SIGGRAPH 1998 Conference Proceedings:Computer Graphics Annual Conference Series.1998.75-84.
[12]晏洁,高文.基于一般人脸模型修改的特定人脸合成技术。计算机辅助设计与图形学学报[J],1999,11(5)：389-394.
[13]尹宝才,高文,晏洁等.基于模型的头部运动估计和面部图像合成,计算机研究与发展[J],1999,369(1)：676-71.
[14]Reeves WT. Particle system-A technique for modeling a class of fuzzy Object[J]. ACM Transaction on Graphics,1983,2(2):91-108.
[15]Kajiya JT, Kay TL. Rendering fur with three dimensional textures[J]. Computer Graphics,1989,23(3):271-280.
[16]Y.Watanabe,Y.Suenaga. A Trigonal Prism-based Method for Hair Image Generation.IEEE Computer Graphics[A],1992,1(12):47-53.
[17]K.i.Anjyo, Y.Usami. A Simple Method for Extracting the Natural Beautyof Hair[J]. In Computer Graphics(SIGGRAPH),1992,7(26):111-120.
[18]Sunnil Hadap, Nadia Magnenat-Thalmann,"Interactive Hair Styler based on Fluid Flow" [A], EuroGraphics 2000.
[19]Dan Witzner Hansen, In the Eye of the Beholder:A survey of Models for Eyes an Gaze [J], IEEE Computer Graphics and Application,2009,1(23):1-21.
[20]J. P. Ivins and J. Porrill. A deformable model of the human iris for measuring small 3-dimensional eye movements[A]. Machine Vision and Applications,11(1):42-51,1998.
[21]A. Pentland, B. Moghaddam, and T. Starner. View-based and modular eigenspaces for face recognition[A]. In Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'94), Seattle, WA, June 1994.
[22]Y. Matsumoto and A. Zelinsky. An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement[A]. In International Conference on Automatic Face and Gesture Recognition, pages 499-504,2000.
[23]陈永强,王启付,胡汉平.真实感人体头部建模方法研究[J].华中科技大学学,2003.9，Vol 31 No.9
[24]白小丹.真实感三维头发模拟[D].西安：西安电子科技大学,2006.
[25]李现民.三角网格简化及等值面抽取技术[D].北京：中国科学院计算技术研究所,2001.
[26]Kalvin, A.D., Taylor, R.H. Superfaces:Polygonal mesh simplification with bounded error[J]. IEEE Computer Graphics and Applications,1996,16(3):64-77.
[27]P.Cignoni, C.Rocchini, R.Scopigno. Metro Measuring Error on Simplified Surfaces[J]. Computer Graphics Forum,1998,17(2):167-174.
[28]LINDSTROM P. Real-time, continuous level of rendering of height fields [C]. Proceeding of ACM SIGGRAPH96. New Orleans, LA, USA:ACM,1996.
[29]ISLER V, LAURWH, GREEN M. Real-time multi-resolution modeling for complex virtual environments[C] Proc. Of VRST'96. Hongkong:ACM,1996.
[30]崔汉国,陈军,王大宇.基于三角形折叠的LOD算法研究与实现[J],武汉：海军工程大学2008.10,Vol.20. NO.5.
[31]杨颖.三维人脸建模及特征提取技术研究[D].西安：西北大学,2008.
[32]Dan Witzner Hansen, Qiang Ji.In the Eye of the Beholder:A Survey of Models for Eyes and Gaze[J].23rd January 2009.
[33]Zhigang Deng, J,P.Lewis, Ulrich Neumann.Automated Eye Motion Using Texture Synthesis[J].IEEE Computer Graphics and Application,2005,3/4:24-30.
[34]李风鸣,眼科全书[C],北京：人民卫生出版社,1996.
[35]上海第一医学院眼耳鼻喉科医院眼科教研组,眼科学[C],第一版,北京：人民卫生出版社,1976.
[36]M. Kass, A. Witkin, and D. Terzopoulos. Snakes:Active contour models[J]. Int. Journal of Computer Vision,1988:321-331.
[37]P.Lee, J.Badler, N.Badler. Eyes alive[J].ACM Transactions on Graphics,2002,21(3): 637-644.
[38]蔡尚书,程义书,王以孝等.人眼模型及其运动控制[J],中国科学院研究生院学报,Vol.21 No.2,2004.4.
[39]陈盈科,郑伯川.真实感眼部表情的一种实现方法[J].Vol.36 No.102008154-156.
[40]B.Lindelof, B.Forslind, MA.Hedblad. U.Kaveus. Human hair form, morphology revealed by light and scanning electron microscopy and computer aided three-dimensional reconstruction[C]. Arch.Dermatol.1988,124(9):1359-1363.
[41]Sunil Hadap, Marie-Paule Cani, Ming Lin et al. Realistic Hair Simulation Animation and Rendering[C]. SIGGRAPH 2008 Course Notes, May 19,2008.
[42]B.Lindelof, B.Forslind, MA.Hedblad et al. Human hair form morphology revealed by light and scanning electron microscopy and computer aided three-dimensional reconstruction. Arch. Dermatol.124(9):1359-1363,1988.
[43]N.Magnenat-Thalmann and S.Hadap. "State of the art in hair simulation,"in International Workshop on Human Modeling and Animation[J]. Korea Computer Graphics Society, June 2000,pp.3-9.
[44]Zviak,. The Science of Hair Care[C], Marcel Dekker 1986.
[45]Bloomenthal. J.Calculation of Reference Frames Along A Space Curve[C].In A. Glassmer. Editor, Graphics Gems, Academic Press,1990,567-571.
[46]Paul Noble, Wen Tang, Alex Parkison, Ciaran Wills, Modelling and Animating Cartoon Hair[J].2004.
[47]Chuan Koon, Zhiyong Huang, A Simple Physics Model to Animate Human Hair Modeled in 2D Strips in Real Time[J].2001.
[48]Cohen J, Lin MC, Manocha D, Ponamgi M. I-COLLIDE:An interactive and exact collision detection system for large-scale environments [J]. In Proceeding of ACM Interactive 3D Graphics Conference, Monterey, CA, USA,1995:189-196.
[49]Zachmann G, Optimizing the collision detection pipeline [J], In Proceedings of the First International Game Technology Conference(GTEC), HongKong,18-21 January 2001.
[50]J T Kajiya and TL Kay. Rendering fur with three dimensional textures[J]. In J.Lane, editor, Computer Graphics(SIGGRAPH 1989 Processings), July 1989,23:271-280.