人脸模型美化
|
摘要
由于人是诸多活动的主体,三维人脸模型的应用领域非常广泛,包括虚拟现实、游戏、人机交互以及影视广告等。在某些注重实时性的应用场合,如游戏中,三维头部模型一般较为粗糙,计算代价较少。而在另一些场合,如影视广告及部分数字娱乐应用中,则需要更为精细的三维模型,且外观要求较高。
以往美化处理大多数以人脸图像为对象,其使用的是一种统计方法。首先搜集大众认可的极具魅力的人脸图片,建立起一个人脸图像数据库,再对输入图像分析,借助预先建立的数据库来进行美化处理。本文提出一种人脸三维模型美化方法,该方法主要针对模型的几何进行美化。几何美化是指人脸模型变换,文中借鉴整容领域的完美脸型标准,对给定模型进行分析,如五官比例及其形状等,根据分析结果对给定模型变形过程进行指导,以达到形状美化的结果;模型变换使用的是基于微分坐标的网格编辑方法,该方法达到求解实时的同时,又能做到很好的细节保留。文章主要贡献在于将整容美容的标准引入到图形学中,结合网格编辑技术及纹理技术进行模型的美化处理。实验结果表明,该方法在保留给定模型大体模样的基础上,取得了良好的美化效果。
3D face models are widely used in many fields, such as virtual reality, computer game, man-machine interaction, film and television, and advertisement, etc. For the applications such as computer games which require real time rendering, the face models are usually coarse in order to reduce the computational cost. For the applications like films, advertisements, realistic and accurate face models are necessary.
Previous face beautification work focuses on face images. They use the statistical method to construct a database of various attractive face images, and perform the beautification with the help of the database. In this thesis, we present a beautification method for 3D face models. Our work focuses on the geometry instead of the image. Geometry beautification means the deformation of the 3D face model. We adopt the standard of a perfect face in the plastic surgery to instruct the deformation process. We use the differential coordinates-based method mesh editing tool to perform the deformation, because of its detail preserving property. Our experiments show that our approach can achieve good beautification effects while resembling to the original face model.
以往美化处理大多数以人脸图像为对象,其使用的是一种统计方法。首先搜集大众认可的极具魅力的人脸图片,建立起一个人脸图像数据库,再对输入图像分析,借助预先建立的数据库来进行美化处理。本文提出一种人脸三维模型美化方法,该方法主要针对模型的几何进行美化。几何美化是指人脸模型变换,文中借鉴整容领域的完美脸型标准,对给定模型进行分析,如五官比例及其形状等,根据分析结果对给定模型变形过程进行指导,以达到形状美化的结果;模型变换使用的是基于微分坐标的网格编辑方法,该方法达到求解实时的同时,又能做到很好的细节保留。文章主要贡献在于将整容美容的标准引入到图形学中,结合网格编辑技术及纹理技术进行模型的美化处理。实验结果表明,该方法在保留给定模型大体模样的基础上,取得了良好的美化效果。
3D face models are widely used in many fields, such as virtual reality, computer game, man-machine interaction, film and television, and advertisement, etc. For the applications such as computer games which require real time rendering, the face models are usually coarse in order to reduce the computational cost. For the applications like films, advertisements, realistic and accurate face models are necessary.
Previous face beautification work focuses on face images. They use the statistical method to construct a database of various attractive face images, and perform the beautification with the help of the database. In this thesis, we present a beautification method for 3D face models. Our work focuses on the geometry instead of the image. Geometry beautification means the deformation of the 3D face model. We adopt the standard of a perfect face in the plastic surgery to instruct the deformation process. We use the differential coordinates-based method mesh editing tool to perform the deformation, because of its detail preserving property. Our experiments show that our approach can achieve good beautification effects while resembling to the original face model.
引文
[1]Xu Lin,Yuan Baozong,Gao Wen.Development and Prospect on Realistic Facial Modeling.Journal of Software,2003,14(4):804-810.
[2]Jun-yong Noh,Ulrich Neumann:A survey of facial modeling and animation techniques.Integrated Media Systems Center,University of Southern California.http://www.usc.edu/dept/CGIT/un.html.
[3]徐成华,王蕴红,谭铁牛.三维人脸建模与应用.中国图形图像学报,2004,9(8):893-903.
[4]MA Tekalp,J.Ostermann.Face and 2D mesh animation in MPEG-4.Signal Processing Image Communication,2000(15):387-342.
[5]Tommer Leyvand,Daniel Cohen-Or,Gideon Dror,Dani Lischinski.Digital Face Beautification.ACM SIGGRAPH,Technical Sketches,2006.
[6]Tommer Leyvand,Daniel Cohen-Or,Gideon Dror,Dani Lischinski.Data-Driven Enhancement of Facial Attractiveness.ACM SIGGRAPH,2008,27(3).
[7]StepOk.Digital Beauty V2.0.http://www.stepok.net/eng/TurboPhoto/digib.htm.
[8]Turbo Photo.http://www.stepok.com/chs/index.htm.
[9]邹北骥,吕格峰,周浩宇,孙家广.人脸整形与美容虚拟手术系统的设计与实现.系统仿真学报(Journal of System Stimulation),2003,15(6):898-901.
[10]W.Sederberg Thomas,R.Parry Scott.Free-form deformation of solid geometric models.Proceedings of the 13th annual conference on Computer graphics and interactive techniques,1986:151-160.
[11]Sabine Coquillart.Extended free-form deformation:A sculpturing tool for 3D geometric modeling.In Proceedings of ACM SIGGRAPH,ACM Press,1990:187-196.
[12]Robert W.Sumner,Johannes Schmid,Mark Pauly.Embedded Deformation for Shape Manipulation.ACM Transactions of Graphics/ACM SIGGRAPH,2007,26(3):801-807.
[13] Karan Singh, Eugene Fiume. Wires: A geometric deformation technique. In Proceedings of SIGGRAPH, 1998:405-414.
[14] Karan Singh, Evangelos Kokkevis. Skinning characters using surface oriented free-form deformation. ACM Transactions of Graphics, 2000, 25(3): 35-42.
[15] Leif Kobbelt, Swen Campagna, Jens Vorsatz, Hans-Peter Seidel. Interactive multi-resolution modeling on arbitrary meshes. In Proceedings of SIGGRAPH, 1998: 105-114.
[16] Denis Zorin, Peter Schroder, Wim Sweldens. Interactive multi-resolution mesh editing. In Proceedings of ACM SIGGRAPH, 1997: 259-268.
[17] Aaron W. F. Lee, Wim Sweldens, Peter Schroeder, Lawrence Cowsar, David Dobkin. Maps: Multi-resolution adaptive parameterization of surfaces. Computer Graphics (SIGGRAPH Proceedings), 1998: 95-104.
[18] Martin Marinov Leif Kobbelt. Direct anisotropic quad-dominant remeshing. In Proceedings of the 12th Pacific Conference on Computer Graphics and Applications, 2004: 207-216.
[19] Leif Kobbelt, Jens Vorsatz, Ulf Labsik, Hans-Peter Seidel. A shrink wrapping approach to remeshing polygonal surfaces. Computer Graphics Forum, 1999(18): 119-130.
[20] Jian Liang Lin, Jung Hong Chuang, Cheng Chung Lin, Chih Chun Chen. Consistent parameterization by quinary subdivision for remeshing and mesh metamorphosis. In GRAPHITE' 03: Proceedings of the 1th International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia, ACM Press, 2003: 151-158.
[21] Pierre Alliez, Giuliana Ucelli, Craig Gotsman, Marco Attene. Recent Advances in Remeshing of Surfaces. Shape Analysis and Structuring, 2005: 53-82.
[22] John Schreiner, Carlos E. Scheidegger, Shachar Fleishman, Claudio T. Silva. Direct (Re)Meshing for Efficient Surface Processing, EUROGRAPHICS, 2006, 25(3): 527-536.
[23] Olga Sorkine. Laplacian Mesh Processing. EUROGRAPHICS, 2005: 53-70.
[24] Jin Huang, Xiaohan Shi, Xinguo Liu, Kun Zhou, Li-Yi Wei, Shang-Hua Teng, Hujun Bao,Baining Guo,Heung-Yeung Shum.Subspace gradient domain mesh deformation.ACM Transactions of Graphics,2006,25(3):1126-1134.
[25]Rhaleb Zayer,Christian Rossl,Zachi Kami,Hans-peter Seidel.Harmonic Guidance for Surface Deformation,EUROGRAPHICS,Computer Graphics Forum,2004,24(3):601-609.
[26]Lin Shi,Yizhou Yu,Nathan Bell,Wei-Wen Feng.A Fast Multigrid Algorithm for Mesh Deformation.Special Issue of SIGGRAPH/ACM Transactions of Graphics,2006:1108-1117.
[27]Gerhard H.Bendels,Reinhard Klein.Mesh forging:editing of 3D-meshes using implicitly defined occludes.In Proceedings of the Eurographics/ACM SIGGRAPH Symposium on Geometry Processing,2003:207-217.
[28]Mark Meyer,Mathieu Desbrun,Peter Schroder,Alan H.Barr.Discrete differential geometry operators for triangulated 2-manifolds.In Visualization and Mathematics 3,Hege HC.,Pothier K.,(Eds.).Springer-Verlag,Heidelberg,2003:35-38.
[29]Michael S.Floater.Mean Value Coordinates.Computer Aided Geometric Design.2003(20):19-27.
[30]Olga Sorkine,Daniel Cohen-Or,Yaron Lipman,Marc Alexa,Christian Rossl,Hans-Peter Seidel.Laplacian Surface Editing.Eurographics/ACM SIGGRAPH Symposium on Geometry Processing,2004:175-184.
[31]Sivan Toledo.TAUCS:A Library of Sparse Linear Solvers,version 2.2.Tel-Aviv University 2003.http://www.tau.ac.il/stoledo/taucs/Sept.
[32]Olga Sorkine,Daniel Cohen-Or,Sivan Toledo.High-pass quantization for mesh encoding.In Proceedings of the Eurographics/ACM SIGGRAPH Symposium on Geometry Processing,2003:42-51.
[33]彭群生,鲍虎军,金小刚.计算机真实感图形的算法基础.科学出版社,1999.
[34]Edwin Earl Catmull.A Subdivision Algorithm for Computer Display of Curved Surfaces.Ph.D Thesis,Dept.of Computer Science,Univ.of Utah,Salt Lake City,Utah,1974:83.
[35]Donald Hearn,M.Pauline Baker.Computer Graphics with OpenGL,Third Edition.北京:电子工业出版社,Mar.2004.
[36]陈柯,杜利民,赵向阳,汪志鸿.基于三角剖分的人脸纹理映射.MICROCOMPUTER APPLICATIONS 2007,28(1):1-4.
[37]Won-Sook Lee,Nadia Manenat-Thalmann.Head modeling from pictures and morphing in 3D with image metamorphosis based on triangulation.In Proceedings Modelling and Motion Capture Techniques for Virtual Environments Geneva,Switzerland,1998:254-267.
[38]Silvina L.Ferradal,Juan C.Gomez.A Graphical User Interface For Automatic Facial Texture Mapping Based On Orthogonal Photos.Proceedings of the 11th International Multimedia Modelling Conference,2005,12(14):271-276.
[39]聂云飞,彭兰英.脸的美学特征,专业*信息BEAUTY
[40]Dario Riccardo Valenzanoa,Andrea Mennuccia,Giandonato Tartarellia,Alessandro Cellerino.Shape analysis of female facial attractiveness.Vision Research,2006,46(8,9):1282-1291.
[41]DI Perrett,KA May,S.Yoshikawa.Facial shape and judgments of female attractiveness.Nature,1994,368(6468):239-242.
[42]Bashour Mounir.An Objective System for Measuring Facial Attractiveness.Plastic & Reconstructive Surgery,2006,118(3):757-774.
[43]Seung Chul Rhee.BAPA(Balanced Angular and Proportional Analysis).http://beautyportal.co.kr/index.php?mm_code=45 &sm_code=122.
[44]Chiarella Sforza,Alberto Laino,Raoul D'Alessio,Gaia Grandi,Gianluca Martino Tartaglia,Virgilio Ferruccio Ferrario.Soft-Tissue Facial Characteristics of Attractive and Normal Adolescent Boys and Girls.The Angle Orthodontist,2007,78(5):799-807.
[45]Jean-Yves Baudouina,Guy Tiberghien.Symmetry,averageness,and feature size in the facial attractiveness of women.Acta Psychologica,2004,117(3):313-332.
[46]Arnulf B.A.Graf,Felix A.Wichmann,Heinrich H.Bülthoff,Bernhard H.Scholkopf.Classification of Faces in Man and Machine.Neural Computation 2006,18(1): 143-165.
[47] Yaron Lipman, Olga Sorkine, Daniel Cohen-Or, David Levin, Christian Rossi, Hans-Peter Seidel. Differential Coordinates for Interactive Mesh Editing, Shape Modeling International, 2004: 181-190.
[48] Yaron Lipman, Olga Sorkine, David Levin, Daniel Cohen-Or. Linear rotation-invariant coordinates for meshes. ACM Transactions of Graphics, 2005, 24(3): 479-487.
[2]Jun-yong Noh,Ulrich Neumann:A survey of facial modeling and animation techniques.Integrated Media Systems Center,University of Southern California.http://www.usc.edu/dept/CGIT/un.html.
[3]徐成华,王蕴红,谭铁牛.三维人脸建模与应用.中国图形图像学报,2004,9(8):893-903.
[4]MA Tekalp,J.Ostermann.Face and 2D mesh animation in MPEG-4.Signal Processing Image Communication,2000(15):387-342.
[5]Tommer Leyvand,Daniel Cohen-Or,Gideon Dror,Dani Lischinski.Digital Face Beautification.ACM SIGGRAPH,Technical Sketches,2006.
[6]Tommer Leyvand,Daniel Cohen-Or,Gideon Dror,Dani Lischinski.Data-Driven Enhancement of Facial Attractiveness.ACM SIGGRAPH,2008,27(3).
[7]StepOk.Digital Beauty V2.0.http://www.stepok.net/eng/TurboPhoto/digib.htm.
[8]Turbo Photo.http://www.stepok.com/chs/index.htm.
[9]邹北骥,吕格峰,周浩宇,孙家广.人脸整形与美容虚拟手术系统的设计与实现.系统仿真学报(Journal of System Stimulation),2003,15(6):898-901.
[10]W.Sederberg Thomas,R.Parry Scott.Free-form deformation of solid geometric models.Proceedings of the 13th annual conference on Computer graphics and interactive techniques,1986:151-160.
[11]Sabine Coquillart.Extended free-form deformation:A sculpturing tool for 3D geometric modeling.In Proceedings of ACM SIGGRAPH,ACM Press,1990:187-196.
[12]Robert W.Sumner,Johannes Schmid,Mark Pauly.Embedded Deformation for Shape Manipulation.ACM Transactions of Graphics/ACM SIGGRAPH,2007,26(3):801-807.
[13] Karan Singh, Eugene Fiume. Wires: A geometric deformation technique. In Proceedings of SIGGRAPH, 1998:405-414.
[14] Karan Singh, Evangelos Kokkevis. Skinning characters using surface oriented free-form deformation. ACM Transactions of Graphics, 2000, 25(3): 35-42.
[15] Leif Kobbelt, Swen Campagna, Jens Vorsatz, Hans-Peter Seidel. Interactive multi-resolution modeling on arbitrary meshes. In Proceedings of SIGGRAPH, 1998: 105-114.
[16] Denis Zorin, Peter Schroder, Wim Sweldens. Interactive multi-resolution mesh editing. In Proceedings of ACM SIGGRAPH, 1997: 259-268.
[17] Aaron W. F. Lee, Wim Sweldens, Peter Schroeder, Lawrence Cowsar, David Dobkin. Maps: Multi-resolution adaptive parameterization of surfaces. Computer Graphics (SIGGRAPH Proceedings), 1998: 95-104.
[18] Martin Marinov Leif Kobbelt. Direct anisotropic quad-dominant remeshing. In Proceedings of the 12th Pacific Conference on Computer Graphics and Applications, 2004: 207-216.
[19] Leif Kobbelt, Jens Vorsatz, Ulf Labsik, Hans-Peter Seidel. A shrink wrapping approach to remeshing polygonal surfaces. Computer Graphics Forum, 1999(18): 119-130.
[20] Jian Liang Lin, Jung Hong Chuang, Cheng Chung Lin, Chih Chun Chen. Consistent parameterization by quinary subdivision for remeshing and mesh metamorphosis. In GRAPHITE' 03: Proceedings of the 1th International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia, ACM Press, 2003: 151-158.
[21] Pierre Alliez, Giuliana Ucelli, Craig Gotsman, Marco Attene. Recent Advances in Remeshing of Surfaces. Shape Analysis and Structuring, 2005: 53-82.
[22] John Schreiner, Carlos E. Scheidegger, Shachar Fleishman, Claudio T. Silva. Direct (Re)Meshing for Efficient Surface Processing, EUROGRAPHICS, 2006, 25(3): 527-536.
[23] Olga Sorkine. Laplacian Mesh Processing. EUROGRAPHICS, 2005: 53-70.
[24] Jin Huang, Xiaohan Shi, Xinguo Liu, Kun Zhou, Li-Yi Wei, Shang-Hua Teng, Hujun Bao,Baining Guo,Heung-Yeung Shum.Subspace gradient domain mesh deformation.ACM Transactions of Graphics,2006,25(3):1126-1134.
[25]Rhaleb Zayer,Christian Rossl,Zachi Kami,Hans-peter Seidel.Harmonic Guidance for Surface Deformation,EUROGRAPHICS,Computer Graphics Forum,2004,24(3):601-609.
[26]Lin Shi,Yizhou Yu,Nathan Bell,Wei-Wen Feng.A Fast Multigrid Algorithm for Mesh Deformation.Special Issue of SIGGRAPH/ACM Transactions of Graphics,2006:1108-1117.
[27]Gerhard H.Bendels,Reinhard Klein.Mesh forging:editing of 3D-meshes using implicitly defined occludes.In Proceedings of the Eurographics/ACM SIGGRAPH Symposium on Geometry Processing,2003:207-217.
[28]Mark Meyer,Mathieu Desbrun,Peter Schroder,Alan H.Barr.Discrete differential geometry operators for triangulated 2-manifolds.In Visualization and Mathematics 3,Hege HC.,Pothier K.,(Eds.).Springer-Verlag,Heidelberg,2003:35-38.
[29]Michael S.Floater.Mean Value Coordinates.Computer Aided Geometric Design.2003(20):19-27.
[30]Olga Sorkine,Daniel Cohen-Or,Yaron Lipman,Marc Alexa,Christian Rossl,Hans-Peter Seidel.Laplacian Surface Editing.Eurographics/ACM SIGGRAPH Symposium on Geometry Processing,2004:175-184.
[31]Sivan Toledo.TAUCS:A Library of Sparse Linear Solvers,version 2.2.Tel-Aviv University 2003.http://www.tau.ac.il/stoledo/taucs/Sept.
[32]Olga Sorkine,Daniel Cohen-Or,Sivan Toledo.High-pass quantization for mesh encoding.In Proceedings of the Eurographics/ACM SIGGRAPH Symposium on Geometry Processing,2003:42-51.
[33]彭群生,鲍虎军,金小刚.计算机真实感图形的算法基础.科学出版社,1999.
[34]Edwin Earl Catmull.A Subdivision Algorithm for Computer Display of Curved Surfaces.Ph.D Thesis,Dept.of Computer Science,Univ.of Utah,Salt Lake City,Utah,1974:83.
[35]Donald Hearn,M.Pauline Baker.Computer Graphics with OpenGL,Third Edition.北京:电子工业出版社,Mar.2004.
[36]陈柯,杜利民,赵向阳,汪志鸿.基于三角剖分的人脸纹理映射.MICROCOMPUTER APPLICATIONS 2007,28(1):1-4.
[37]Won-Sook Lee,Nadia Manenat-Thalmann.Head modeling from pictures and morphing in 3D with image metamorphosis based on triangulation.In Proceedings Modelling and Motion Capture Techniques for Virtual Environments Geneva,Switzerland,1998:254-267.
[38]Silvina L.Ferradal,Juan C.Gomez.A Graphical User Interface For Automatic Facial Texture Mapping Based On Orthogonal Photos.Proceedings of the 11th International Multimedia Modelling Conference,2005,12(14):271-276.
[39]聂云飞,彭兰英.脸的美学特征,专业*信息BEAUTY
[40]Dario Riccardo Valenzanoa,Andrea Mennuccia,Giandonato Tartarellia,Alessandro Cellerino.Shape analysis of female facial attractiveness.Vision Research,2006,46(8,9):1282-1291.
[41]DI Perrett,KA May,S.Yoshikawa.Facial shape and judgments of female attractiveness.Nature,1994,368(6468):239-242.
[42]Bashour Mounir.An Objective System for Measuring Facial Attractiveness.Plastic & Reconstructive Surgery,2006,118(3):757-774.
[43]Seung Chul Rhee.BAPA(Balanced Angular and Proportional Analysis).http://beautyportal.co.kr/index.php?mm_code=45 &sm_code=122.
[44]Chiarella Sforza,Alberto Laino,Raoul D'Alessio,Gaia Grandi,Gianluca Martino Tartaglia,Virgilio Ferruccio Ferrario.Soft-Tissue Facial Characteristics of Attractive and Normal Adolescent Boys and Girls.The Angle Orthodontist,2007,78(5):799-807.
[45]Jean-Yves Baudouina,Guy Tiberghien.Symmetry,averageness,and feature size in the facial attractiveness of women.Acta Psychologica,2004,117(3):313-332.
[46]Arnulf B.A.Graf,Felix A.Wichmann,Heinrich H.Bülthoff,Bernhard H.Scholkopf.Classification of Faces in Man and Machine.Neural Computation 2006,18(1): 143-165.
[47] Yaron Lipman, Olga Sorkine, Daniel Cohen-Or, David Levin, Christian Rossi, Hans-Peter Seidel. Differential Coordinates for Interactive Mesh Editing, Shape Modeling International, 2004: 181-190.
[48] Yaron Lipman, Olga Sorkine, David Levin, Daniel Cohen-Or. Linear rotation-invariant coordinates for meshes. ACM Transactions of Graphics, 2005, 24(3): 479-487.