基于文字驱动的人脸动画及其人脸模型的快速重建
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
人脸的造型和动画作为计算机图形学中一个独特分支已将近30年了,随着影视特技、电子游戏、可视电话、虚拟会议等应用的发展,这一研究领域越来越受到人们的关注。本文致力于研究基于文本驱动的个性化人脸的动画。其作用是,对输入的文本进行分析,并自动生成一张个性化人脸,讲述这些文字的动画序列。这里的个性化,是指人脸可以定制到不同的用户上。
     在本文的第一章我们将阐述人脸造型和动画技术的重要性及困难所在等相关问题。在第二章,我们概括了人脸动画的几个基本思想,并回顾已有的计算机人脸造型和动画技术,分别对它们的强项、弱势,及性能给出描述。并按内容的相似性进行分类。在第三章,我们介绍了MPEG-4里支持的脸部动画系统。
     本文所采用的人脸模型个性化算法是基于正交两幅图像的自动人脸三维重建,这种方法的优点是成本低,速度快。它的算法细节是本文第四章的主要讨论内容。这种重建的基本过程是,在两幅图像上,分别自动检测出特征点的二维坐标,综合得到这些特征点的三维坐标。根据这些点的坐标,进行模型变形,获得通用模型中的非特征点的位置,从而获得了人脸三维模型的重建。在这里,特征点的检测的自动化和精确性是一个关键,这也是本文的一个研究重点。纹理映射,可以增强模型的真实感,他的实现算法也在第四章里介绍。
     在获得定制好的人脸模型基础上,本文初步研究了基于文本驱动的人脸动画。通过分析普通话拼音的特点,我们定义了普通话里的基本口形集,并提出一个基于肌肉的嘴唇参数化模型,以实现人脸的动画尤其是嘴唇的动画。
Facial modeling and animation is now attracting more and more special attention than ever before during the last 30 years as an identifiable branch of computer graphics. With the development of movie stunt,electronic games,virtual meeting,the research in this field has stood in the forefront. This paper concentrates on developing face animation system with personalized model. Its purpose is to offer analyst according the input text,and automatically produce a personalized face model,with the explanation for the animation serial of these texts. The word personalized,we referred to above,is given in such a context that face models could be developed for distinguished users.
    The importance and the key issue of human face modeling and animation technology will be covered in chapter one. The chapter two will give some fundamental ideas about human face animation technology,with some review for these technologies. Also,we will introduce the MPEG-4 supported facial animated system.
    In this paper,our personalized facial model algorithm is the automatic facial 3D reconstruction based on two orthogonal photos. Excellence of this method lies in low cost as well as fast speed. The detail of this algorithm is the main content of chapter 4. The basic idea is to obtain the 3D position of those feature points through detecting their 2D position. Feature points detection s automation and accuracy is a key issue,which is an important research topic in this paper.
    Based on deriving personalized facial modeling,the paper makes research on text driven facial animation. Through analyzing the characteristic of PuTongHua,we define a basic set of visemes,and put forward a muscle based lip model,to realize facial animation,the lip s animation in particular.
引文
[Akimoto93] T. Akimoto, Y. Suenaga, R. Wallace, Automatic creation of 3D facial models. IEEE computer Graphics and Application, 1993, vol. 13(5) , pp. 16-22.
    [Beier92] Beier T, Neely S. Feature-based image metamorphosis. Computer Graphics, 1992, 26(2) :35-42.
    [Breton2001] Gaspard Breton etc, FaceEngine A 3D Face animation Engine for Real Time Applictions. ACM, 2001, Page(s): 15-21.
    [Chen99] Chen Lin; Cheng-Sheng Hung; Tzong-Jer Yang; Ming Ouhyoung. A speech driven talking head system based on a single face image Computer Graphics and Applications, 1999. Proceedings. Seventh Pacific Conference on Published: 1999 , Page(s): 43-49, 317.
    [Chun97] Chun-Ho, Lai-Man PO. Text-driven Automatic Frame Generations using MPEG-4 Synthetic/Natural Hybrid Coding for 2-D Head-and-Shoulder Scene. IEEE 1997.
    [Cohen93] M. Cohen and Dominic W. Massaro. Modeling Coaticulation in Synthectic Visual Speech. Models and techniques in Computer Animation, pp. 139-156, Apringer-Verlag, 1993.
    [Cosatto2000] Eric Cosatto and Hans Peter Graf. Photo-Realistic Talking-Heads from Image Samples. IEEE TRNSACTIONS ON MULTIMEDIA VOL.2, NO.3, SEPTERMBER 2000.
    [Cosatto98] Cosatto, E.; Graf, H.P. Sample-based synthesis of photo-realistic talking heads.Computer Animation 98. Proceedings. Published: 1998 , Page(s): 103-110.
    [Escher97] Escher, M.; Thalmann, N.M. Automatic 3D cloning and real-time animation of a human face Computer Animation '97, 1997, Page(s): 58-66.
    [Escher98] Marc Escher, etc, Facial Deformation for MPEG-4. 1087-4844, IEEE.1998, Page(s): 56-62.
    [Eshcer98] Escher, M.; Pandzic, L; Thalmann, N.M. Facial deformations for MPEG-4. Computer Animation 98. Proceedings Published: 1998 , Page(s): 56-62.
    [Ezzat96] Ezzat, T.; Poggio, T. Facial analysis and synthesis using image-based models. Automatic Face and Gesture Recognition, 1996. , Proceedings of the Second International Conference on Published: 1996 , Page(s): 116-121.
    [Ezzat98] Ezzat, T.; Poggio, T. MikeTalk: a talking facial display based on morphing visemes. Computer Animation 98. Proceedings. Published: 1998 , Page(s): 96-102.
    [Fabio99] Fabio Lavagetto, Roberto Pockaj. The Facial Animation Engine: Toward a Heigh-Level Interface for the Design of MPEG-4 Compliant Animated Faces. IEEE TRANSACTIONS ON
    
    CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL 9, NO. 2, MARCH 1999.
    [Gabriel99] Gabriel Antunes Abrantes. MPEG-4 Facial Animation Technology: Survey, Implementation, and Results. 1999 IEEE.
    [Goto2001] T. Goto, etc, Automatic Face Cloning and Animation. IEEE SIGNAL PROCESSING MAGAZINE, 2001, 17-25.
    [Graf2000] Graf, H.P.; Cosatto, E.; Ezzat, T. Face analysis for the synthesis of photo-realistic talking heads. Automatic Face and Gesture Recognition, 2000. Proceedings. Fourth IEEE International Conference on Published: 2000 , Page(s): 189-194.
    [Guiard96] Guiard-Marigny, T.; Tsingos, N.; Adjoudani, A.; Benoit, C.; Gascuel, M.-P. 3D models of the lips for realistic speech animation Computer Animation '96. Proceedings Published: 1996 , Page(s): 80-89.
    [Hong2001] PENGYU HONG, ZHEN WEN, THOMAS S. HUANG IFACE: A 3D SYNTHETIC TALKING FACE, International Journal of Image and Graphics, Vol. 1, No. 1 2001.
    [Huang92] C.-L Huang and C.-W. Chen, Human facial feature extraction for face interpretation and recognition, Pattern Recogint., vol. 25, no. 12, pp. 1435-1444, 1992.
    [KASS88] Kass M, Witkin A, Terzopoulos D. Snakesractive contour models, International Journal of Computer Vision, 1988, 1(4) :321_331
    [KURIHARA91] Tsuneya Kurihara and Kiyoshi Arai, A Transformation Method for Modeling and Animation of the Human Face from Photographs, Computer Animation, Springer-Verlag Tokyo, pp. 45-58, 1991.
    [Laurent97] Laurent Moccozet, Nadia Magnenat Thalmann. Dirichlet Free-Form Deformations and their Application to Hand Simulation, 1997, IEEE.
    [Lande98] Lande, C.; Francini, G An MPEG-4 facial animation system driven by synthetic speech. Multimedia Modeling, 1998. MMM '98. Proceedings. 1998 Published: 1998 , Page(s): 203-212.
    [LEE2000] WonSook, Lee, Jin Gu, and Nadia Magnenat_Thalmann. Generating animatable 3D vritual humans from Photographs. EUROGRAPHICS 2000 / M. Gross and F.R.A. Hopgood (Guest Editors) Vol.19, No. 3, 2000: 1-10
    [Lee95] Yuencheng Lee, etc, Realistic Modeling for Facial Animation, ACM 1995, 55-62.
    [LEE97] Lee W. S., Kaira P., Magenat Thalmann N, Modei Based Face Reconstruction for Animation, Proc. Multimedia Modeling (MMM) '97, Singapore, pp. 323-338, 1997.
    [Lee98] Seungyong Lee; Wolberg, G; Sung Yong Shin. Polymorph: morphing among multiple images. IEEE Computer Graphics and Applications Published: Jan.-Feb. 1998. Volume: 18 1, Page(s):58-71.
    
    
    [LEE98] Won-Sook Lee, Nadia Magnenat Thalmann. Head modeling from pietures and morphing in 3D with image metamorphosis based on triangulation. In: CAPTECH'98, LNAI 1537, Springer_Verlag Berlin Heidelberg, 1998, 254-267.
    [Lee99] Won-Sook Lee; Escher, M.; Sannier, G.; Magnenat-Thalmann, N. MPEG-4 compatible faces from orthogonal photos Computer Animation, 1999. Proceedings Published: 1999 , Page(s): 186-194.
    [Lee99] Won-Sook Lee; Magnenat-Thalmann, N. Generating a population of animated faces from pietures. Modelling People, 1999. Proceedings. IEEE International Workshop on Published: 1999 , Page(s): 62-69.
    [MASSE90] K. Masse, A. Pentland, Automatic Lip reading by Computer, Trans. Inst. Elec., Info. And Comm. Eng. 1990. Vol. J73-D-Ⅱ, No.6. pp.796-803
    [Moubaraki96] Moubaraki, L.; Ohya, J. Realistic 3D mouth animation using a minimal number of parameters Robot and Human Communication, 1996. , 5th IEEE International Workshop on . 1996 , Page(s):201-206
    [Ostermann98] J.Ostermann, Animation of synthetic faces in MPEG-4, in Proc. Computer Animation, June 1998, pp. 49-55.
    [PARKE82] F. I. Parke, Parameterized models for facial animation. IEEE Computer Graphics and Applications, 1982, vol. 2(9) pp. 61-68
    [Parke82] Frederic I. Parke, Parameterized Models for Facial Animation. 1982 IEEE.
    [Pighin98] F. Pighin, J. Hecker, etc, Synthesizing realistic facial expressions from photographs, in Proc. Siggraph'98, July 1998, pp.75-84.
    [POWELL87] M. J. D. Powell, Radial basis functions for multivariate interpolation: a review. In J.C. Mason and M.G. Cox, editors, Algorithms for Approximation, Clarendon Press, Oxford, 1987
    [SERA96] H. Sera, S. Morishma, D. Terzopoulos, Physics-based Muscle Modei for Moth Shape Control, IEEE International Workshop on Robot and Human Communication, 1996, pp. 207-212
    [Shan2000] Shiguang Shan; Wen Gao; Jie Yan; Hongming Zhang; Xilin Chen, "Individual 3D face synthesis based on orthogonal photos and speech-driven facial animation",. Proceedings 2000 International Conference on Image Processing, 2000, Page(s): 238-241 vol.3.
    [Shigeo2001] Shigeo Morishima. Face Analysis and Synthesis. IEEE Signal Processing Magazine, May 2001, 26-34.
    [Sobottka96 ] Sobottka, K.; Pitas, I. Face localization and facial feature extraction based on shape and color information, Image Processing, 1996. Proceedings., International Conference on , Volume: 3 , 1996 ,Page(s): 483-486 vol.3.
    [Taro2002] Taro Goto, Won-Sook Lee, Nadia Magnenat-Thalmann. Facial feature extraction for
    
    quick 3D face modeling. Signal Processing: Image Communication 17(2002) , 243-259.
    [Waters87] Keigh Waters, A Muscle Modei for Animating Tree-Dimensional Facial Expression. Computer Graphics, Volume 21, Number 4, July 1987. 17-24.
    [Waters94] Keith Waters and Tom Levergood, An Automatic Lip-Synchronization Algorithm for Synthetic Faces. ACM, 1994, 149-156.
    [WATERS95] K. Waters, J. Frisbie, A Coordinated Muscle Model for Speech Animation, Graphics Interface, 1995, pp. 163-170.
    [WILLIAMS92] Williams, et al. "A Fast Algorithm for Active Contours and Curvature Estimation", CVGIP: Image Understanding. Vol. 55, No. 1, January 1992. pp. 14-26.
    [Woei98] Woei-Luen Perng; Yungkang Wu; Ming Ouhyoung. Image Talk: a real time synthetic talking head using one single image with Chinese text-to-speech capability. Computer Graphics and Applications, 1998. Pacific Graphics '98. Sixth Pacific Conference on Published: 1998 , Page(s): 140-148.
    [YIN95] L. Yin, A fast feature detection algorithm for human face contour based on local maximum curvature tracking, Technique Report, ICG, Department of Computing Science, City U of HK, 1995.
    [Yow] Kin Choong Yow; Cipolla, R. Detection of human faces under scale, orientation and viewpoint variations. Automatic Face and Gesture Recognition, 1996. , Proceedings of the Second International Conference on Published: 1996 , Page(s): 295-300.
    [ZHANG95] Zhengyou Zhang, et al. A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry, Artificial Intelligence, 1995, Vol.78,No.1-2:87-119.
    [虞露2001] 虞露,MPEG-4中脸部动画参数和序列重绘的肌肉模型,中国图像图形学报, Vol.6(A),NO.1 Jan.2001.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700