摘要
随着计算机图形学和计算机智能化的不断发展,三维人脸模型重构在安全认证、影视动漫、游戏娱乐、医学等许多行业发挥着极其重要的作用,因此,重构出具有真实感的三维人脸模型是三维人脸检测技术的研究热点,也是三维检测与逆向工程的重点研究内容之一。
本文主要是针对三维人脸重构与反求技术进行研究,主要包括三维人脸点云数据获取、三维人脸点云数据重构处理和三维人脸CAD模型逆向加工三部分。
1、三维人脸点云数据获取。介绍了基于结构光投影光栅相位法相调制原理,分析了传统的一维去包裹算法并推广到二维去包裹算法,比较了投影光栅相位法解相的相移法PSP和傅立叶变换法FTP两种算法的优缺点,最终选择基于二维傅立叶变换法的人体面部数字化扫描系统来获取精确的三维人脸点云数据。
2、三维人脸点云数据重构处理。介绍了旋动理论,阐述了旋转矩阵R和平移矩阵T详细求解过程,分析了基于贴标志点的粗拼接算法和基于最小二乘法和奇异值分解法相结合的高精度自动拼接算法;提出了利用凸台形标定块实现两片人脸点云数据自动拼接。三维人脸点云数据经粗、精拼接处理后,生成具有真实感的三维人脸纹理图,然后重构出逼真的三维人脸NURBS曲面,最后形成三维人脸CAD模型。
3、三维人脸CAD模型逆向加工。针对人脸复杂曲面,采用逆向反求技术来加工三维人脸实体模型,具体拟定了两种逆向加工方案。方案一是基于CATIA三维设计软件的数控铣床三维人脸模型加工,主要是进行了三维人脸仿真加工;方案二是基于MEM-350快速成形系统三维人脸模型加工,主要是基于ABS材料的三维人脸实物模型加工。
本文的研究工作成果对建立一个具有鲁棒性的三维人脸识别系统研究以及相关学科的发展发挥着积极的推动作用。
With the development of Computer Graphics and Computer intelligence, the reconstruction of 3D-face model plays an extremely important role in many industries, such as the security certification, the film and television, the anime, the games and entertainment, the medical science and so on. Therefore, to reconstruct a realistic 3D-face model is not only the hotspot of 3D-face detection technology,but also is one of the research emphasizes of 3D detecting and reverse engineering..
Depending on the research to 3D-face reconstruction and reverse engineering, the paper contains three parts, which are the acquisition of 3D-face point cloud data, the processing of the point cloud data and the reverse processing of 3D-face CAD model.
1. The acquisition of 3D-face point cloud data. Firstly, modulation principle of projection fringe phase method based on structured light was introduced, with the analysis to the two-dimensional unwrapping algorithm extended from the traditional one-dimensional one. Then two algorithms to solute phase which are Phase Shift method (PSP) and Fourier Transform method (FTP) were compared with each other. Finally, the facial digital scanning system based on 2D Fourier Transform method was adopted to obtain the accurate point cloud data.
2. The reconstruct processing of 3D-face point cloud data. The gyration theory was introduced, and the detailed solution process to rotation matrix R and translation matrix T were explained by the paper. Then with the analysis to the rough stitching algorithm based on posted signalized point and the high-precision automatic stitching algorithm based on the combination of the least square method and the unit quaternions, in which Boss-block calibration landmarks achieving the automatic matching of two faces point cloud was proposed. After that, faces point cloud data mosaic.3D point cloud data of face coarse and fine stitching after treatment, the realistic 3D-face texture image was generated, and the realistic 3D-face NURBS surfaces was reconstructed, finally a 3D-face CAD model was formed.
3. The reverse processing of 3D-face CAD model. According to the complex face surfaces, the reverse engineering technology was adopted to process 3D-face solid model, and two reverse processing programs were proposed in the paper. One is using numerically controlled fraise machine based on CATLA software to process the model, which is mainly advanced on the simulation processing; and the other is using the rapid prototyping system based on MEM-350 to process it, which is mainly to restore the physical 3D-face model based on ABS materials.
The research results of the paper produce a positive role for building a 3D-face recognition system with more robustness and developing the other related subjects.
引文
[1]张春雨.基于子空间的人脸识别算法研究[D].吉林:吉林大学,2006
[2]刘早.人脸三维重建技术的研究[D].吉林:吉林大学,2005
[3]T. Sakai,M. Nagao and 1. Kanade. Computer Analysis and Classification of Photographs of Human Faces[J]. Proc.First USA-Japan Computer Conference,1972,Vol.10(1):2-7
[4]陈鲁.用于人脸识别的三维人脸模型重建[D].上海:上海交通大学,2006
[5]廉莲.单张照片的三维人脸重建方法研究[D].南京:南京理工大学,2007
[6]V. Blanz and T.Vetter. Face Recognition Based on Fitting a 3D Morphable Model[J]. IEEE transactions on PAMI,2003,Vol.25(9):1063-1074
[7]Y.C.Lee, D.Terzopoulos, K.Waters, et al. Realistic face modeling for animation[J]. Proceedings of SIGGRAPH,1995,Vol.27(8):55-62
[8]杨洪艳.人脸识别算法的改进[D].天津:天津工业大学,2008
[9]沈荣荣.基于径向基函数的三维特定人脸重构的研究[D].江苏:江苏大学,2007
[10]刘早.人脸三维重建技术的研究[D].吉林:吉林大学,2005
[11]F.I.Parke. Computer Generated Animation of Faces[J]. Proc.ACM National Conf,1972,Vol.29 (10):4512~4571
[12]Xu Chenghua, Wang Yunzhong, Tan Tieniu. Overview of Research on 3D Face Modeling[J]. Journal of Image and Graphics,2004, Vol.9(8):65-68
[13]刘伟军,孙玉文等编著.逆向工程原理方法及应用[J].北京:机械工业出版社,2009
[]4]于晓聪.基于照片的三维人脸重构技术研究[[J]].吉林:东北师范大学,2005
[15]章毓晋主编.图象工程[J].北京:清华大学出版社,2000
[16]甘俊英,朱斌,胡异丁.基于径向基函数与B样条曲线的三维人脸重建方法[J].计算机工程与设计,2008,29(17):4511~4514
[17]JinKwei-Jay,WangYu-Chung. The design and implementation of real-time schedulers in red-Linux[J]. Proceedings of the IEEE,2003,Vol.27(5):1114~1130
[18]Keith Waters. A muscle model for animation three-Dimensional facial expression[J]. Computer Graphics,1987,Vol.21(4):17~24
[19]DeCarlo D, Metaxas D, Stone M, et al. An anthropometric face model using variational techniques[J]. In:SIGGRAPH Proceedings,Orlando, USA,1998,Vol.20(7):67~74
[20]Pascal Fua. Face Models from uncalibrated video sequences[J]. In:Proceedings of the captech 98, Berlin Heidelberg:Springer-Verlag,1998,Vol.108(25):214~228
[21]Pighin F,Heeker J,Lischinski D, et al. Synthesizing realistic facial expression from photographs[J]. In; SIGGRAPH Procceeding, Orlando, FL, USA,1998:75~84
[22]Liu Z, Zhan Z, JaCob C, et al. Rapid modeling of animated faces from Video[J]. Technical Report M5R-TR Micorsot Research Microsoft Corporation, WA,2000, Vol.18(9):1156~ 1159
[23]Ahllberg J. An updated parameterized face[J]. Technical Report LiTH-ISY-R-2326 Linkoping University Sweden,2001, Vol.45(6):1120-1125
[24]Jeong W, Kahler K, Haber J. Automatic generation of subdivision surface head models from point cloud data[J]. In:Proceedings Graphics Interface,2002:181-188
[25]Rein-Lien Hsu, M. Addel-Motaleb and A. K. Jain. Face Detection in Color Images[J]. IEEE T-ansactions on Patern Analysis and Machine Intelligence,2002, Vol.24(5):696~706
[26]Xu C,Quan L.Wang Y. Adaptive multi-resolution fitting and its application to realistic head modeling[J]. In:Proceedings Geometric Modeling and Processing, Beijing, China,2004: 345-348
[27]晏洁,高文.基于一般人脸模型修改的特定人脸合成技术[J].计算机辅助设计与图形学学报,1999,11(5):389-394
[28]尹宝才,高文,晏洁等.基于模型的头部运动估计和面部图像合成[J].计算机研究与发展,1999,36(1):67-71
[29]郑飞,陈梅.由人面照片重建人面三维模型的探讨[J].自动化学报,1999,25(1):138~141
[30]陈益强,高文,王兆其等.基于机器学习的语音驱动人脸动画方法[J].软件学报,2003,14(2):215-221
[31]Shiguang Shan, Wen Gao, Be Yan, et al. Individual 3Dface synthesis based on orthogonal photos and speech-driven facial animation[J]. In Proceedings 2000 International Conference on Image Processing,2000, Vol.1(3):238~241
[32]梅丽,鲍虎军,郑文庭等.基于实拍图像的人脸真实感重建[J].计算机学报,2000,23(9):996-1002
[33]张青山,陈国良.具有真实感的三维人脸动画[J].软件学报,2003,14(3):643-650
[34]由志福.曲面形体三维相位法检测技术及CAD/CAM集成的研究[D].清华:清华大学,1998
[35]P. F. Wu, F. H. Yu, etc. Analysis technique for the measurement of a three-dimensional object shape[J]. Applied. Optics,1993, Vol.32(5):737~742
[36]M. Chang, C. P. Hu, P. Lam, J. C. Wyant. High precision deformation measurement by digital phase shifting holographic interferometry[J]. Applied Optics,1985, Vol.24(22):3780-3783
[37]范华,张弛等.相移测量技术中相移器研究[J].应用光学,1998,19(6):34~37
[38]Carre P. Installation et utilisation du comparateur photoelectrique etinterferentiel du Bureau International des Poids et Mesures[J]. Metrologia,1966, Vol.2(1):13~23
[39]Hariharan P, Oreb B F, Eiju T. Digital phase-shifting interferometry[J]. a simple errorcompensating phase calculation,1987, Vol.26(13):2054~2056
[40]钱克矛,伍小平.相移技术中五步等步长Stoilov算法的性能分析[J].光学技术,2001,27(1):13~16
[41]Stoilov G, Dragostinov T. Phase-stepping Interferometry. Five-frame Algorithm with an Arbitrary Step[J].1997, Vol.28(1):61~69
[42]Schwider J, Burow R R, Elsman K E. Digital wave front measuring interferometry:some systematic erro sources[J]. Aool.Opt,1983, Vol. (22):3421~3432
[43]Takeda M, Ina H, Koboyashi S. Fourier-transform method of fringe-pattern analysis for computer based topography and interferometry[J]. J.Opt.Soc.AM,1982, Vol.72(1):156~ 160
[44]Takeda M, Mutoh K. Fourier transform profilometry for the automatic measurement of 3-D object shapes[J]. Appl.Opt,1983, Vol.22(24):3977-3982
[45]王海霞,苏显渝.基于莫尔条纹的三维物体的旋转不变识别[J].激光杂志,2005,16(3):349-353
[46]Kujawinska etal. High accuracy fourier transform fringe pattern analysis[J]. Optics and Lasters in Engineering,1991, Vol.14:325-339
[47]A.Spik,D.W.Robinson. Investigation of the cellular automata method for phase unwrapping and its implementation on an array processor[J]. Modern Opt,1990,Vol.4(1):25~37
[48]J.M.Huntle,H.Saldner. Temporal phase-unwrapping algorithm for automated interferogram analysis[J].Appl.Opt,1993,Vol.12(17):3047~3052
[49]K.Itoh. Analysis of the phase unwrapping algorithm[J]. Appl.Opt,1982,Vol.21(14):2740~ 2743
[50]韩耘,马利等.回转体形状检测的数据拼接法研究[J].中国科学技术大学学报,2003,33(3):282-287
[51]程维明,陈明仪等.圆柱坐标下的多孔径拼接测量三维面形[J].光学学报,1999,19(6):81]-815
[52]陈明仪,吴德柱,程维明.用条纹图形拼接法测量三维大物体面形[J].光学学报,1998,18(1):74-79
[53]吴敏,周来水等.测量点云数据的多视拼合技术研究[J].南京航空航天大学学报,2003,35(5):552-556
[54]郭红卫.多孔径拼接技术实现360°面形测量[D].上海:上海大学,2001
[55]葛晶.大视场下FTP三维物体表面轮廓测量方法的研究[D].天津:天津科技大学,2006
[56]BeslP J,Mckay N D. A method for registration of 3-d shapes[J]. IEEE Transactions on PatternAnalysis andMachine Intelligence,1992,Vol.14(2):239-256
[57]Zhengyou Zhang. A Flexible New Technique for Camera Calibration[J]. IEEE Transactions on PatternAnalysis andMachine Intelligence,2000,Vol.22(11):1330~1334
[58]Maolin Qiu,Songde Ma. The nonparametric approach for camera calibration[J]. In:Proc. ICCV'95,1995,Vol.16(12):224~229
[59]高满屯,曲仕茹,李西琴.计算机视觉研究中的投影理论和方法[J].西安:西北工业大学出版社,1998
[60]陈厚道.面向快速成形的反求工程关键技术的研究[D].武汉:华中科技大学,2003
[61]夏天长.系统辨识最小二乘法[J].北京:清华大学出版社,1983
[62]苏步青,刘鼎元.计算几何[J].上海:上海科学出版社,1980
[63]沈海平,达飞鹏,雷家勇.基于最小二乘法的点云数据拼接研究[J].中国图象图形学报,2005,10(9):1112-1116
[64]田丰.利用空间坐标变换的三维测量系统[J].光学学报,1998,18(2):199-203
[65]董再励,王建刚,徐心平.一种基于立体视觉的多视点建模方法[J].中国图像图形学报,1997, 2(7):461-463
[66]王霄.逆向工程技术及其应用[M].北京:化学工业出版社,2004
[67]吴永强.精通UG NX 5+Imageware逆向工程设计[M].北京:电子工业出版社,2008