基于视频图像的人脸特征点定位技术研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
人脸特征点定位技术是人脸分析技术的关键,它被广泛应用于人脸识别、三维人脸建模、人脸动画等领域。但是由于光照、姿态、面部表情的变化以及眼镜、胡须等遮挡物的干扰,增加了人们对特征点精确定位的难度。本文主要针对的是左右转动的人脸视频序列研究鲁棒的人脸特征点定位算法,主要的研究工作及创新点如下:
     1)在分析人脸面部主要器官分布规律的基础上,参照MPEG-4标准中人脸定义参数FDP的人脸特征点分布,选取了本文使用的人脸特征点,同时根据人脸特征点对后续应用的重要性以及特征点定位的难易程度将选取的特征点进行了分类。
     2)通过对ASM模型的初始位置以及人脸特征点的局部搜索策略进行改进,提出了采用叠加的ASM模型以及二维轮廓线进行局部特征点搜索的算法。用于人脸视频序列第一帧接近正面人脸特征点的定位,该帧定位的准确性直接影响到后续视频人脸特征点的跟踪。
     3)提出按人脸姿态的不同,采用不同的策略跟踪视频人脸特征点。对于小姿态的人脸采用仿射矫正的光流跟踪方法,而对于中/大姿态的人脸则通过分区域,计算跟踪准确的人脸特征点的偏移量矫正光流跟踪方法。对于难跟踪的人脸外轮廓点,本文提出采用把人脸图像转换到HSV色彩空间,利用Sobel变换提取人脸轮廓的方法定位人脸外轮廓上的特征点。
     4)作为对视频序列人脸特征点定位的一个应用,本文根据视频序列中定位出来的人脸两内眼角点和鼻尖点估计出人脸姿态。最后,本文以VisualC++6.0以及OpenCV1.0为开发平台,实现了视频人脸序列特征点的定位并估计人脸姿态。
Facial feature points location is the key to face analysis techniques, it is widely used in face recognition, 3D face modeling and facial animation etc. However, it is very hard to locate facial feature points precisely due to the changes of light, gesture and facial expression and the occlusions of glasses and beard. In this dissertation, robust facial feature points location algorithm is studied to turning left and right human video sequence. The main points of research and innovation are as follows:
     1) The facial feature points are selected according to MPEG-4 facial definition parameters ( FDP) in the analysis of the major organs of human face. And the selected facial feature points are classified by the importance of follow-up applications and the ease of locating feature points.
     2) The stack ASM and two-dimensional contour lines of searching local feature points are introduced by improving the initial position of ASM and the searching strategies of local facial feature points. This method is used to locate the first frame facial feature points of video sequences which directly affects the positioning accuracy of the follow-up video facial feature points tracking.
     3) Different strategies to track the video facial feature points to the different facial gestures are proposed. Affine-corrected optical flow tracking method is used for small gestures of human face. Offset correction of the optical flow tracking method through the sub-region, calculating accurate points tracking for medium / large gestures of face. The human face images are converted to the HSV color space, using Sobel transform to extract the face contour is used to locate facial feature points on the outer contour.
     4) The face gestures are estimated according to the inside corner of the eye points and the tip of nose as an application of facial feature point location by video sequences. Finally, the facial feature points location of the video sequence and estimation of face gestures have been implemented by Visual C++6.0 and OpenCV1.0.
引文
[1]吴证.人脸特征点定位研究及应用(硕士学位论文).上海交通大学硕士论文,2007.
    [2]吕宝华.人脸特征定位方法研究(硕士学位论文),西北工业大学硕士论文,2007.
    [3]林维训,潘纲,吴朝晖,潘云鹤.脸部特征定位方法综述.中国图象图形学报,2003,8(8):849-859.
    [4] Guangzheng Yang,Thomas S Huang.Human face detection in a complex background. Pattern Recognition,1994,27(1):53-63.
    [5] Takeo Kanade.Picture Processing System by Computer Complex and Recognition of Human Faces.Doctoral dissertation.Kyoto University, 1973.
    [6] Liming Zhang,Lenders.P.Knowledge-based eye detection for human face recognition, In: Proceedings of Knowledge-based Intelligent Engineering Systems and Alied Technologies, 2000(1):117-120.
    [7] Reisfeld D.,Yeshurun Y..Robust detection of facial features by generalized symmetry. In: Proceedings of Pattern Recognition, 1992: 117 -120.
    [8] Kass M,Witkin A,Terzopoulos D. Snakes:Active contour models. International Journal of Computer Vision,1988: 321-331.
    [9] Yuille A,Cohen D,Hallinan P.Feature extraction from faces using deformable templates. In:Proceedings of Computer Vision and Pattern Recognition, 1989:104-109.
    [10] Coots T,Taylor C,Cooper D,Graham J.Active shape models-their training and application. Computer Vision and Image understanding, 1995,61(1): 38-59.
    [11] M.J.T.Reinders,R.W.C.Koch,J.J.Gerbrands.Locating Facial Features in Image Sequences using Neural Networks.IEEE,1996: 230-235.
    [12] Matthew Turk,Alex Pentland.Eigenfaces for Recognition. Journal of Cognitive Neuroscience,1991,3(1):71-86.
    [13] Pan Gang,Lin Weixun,Wu Zhanghui,Yang Yingchun.Eye detection system based on SVM filter.In: Proceedings of Electronic Imaging and Multimedia Technology III,2002: 326-331.
    [14] Kin Choong Yow,Cipolla R.A probabilistic framework for perceptual grouping of features for human face detection. In:Proceedings of Automatic Face and Gesture Recognition,1996:16-21.
    [15] Rogerio S.Feris,Jim Gemmell,Kentaro Toyama. Hierarchical Wavelet Networks for Facial Feature Localization.In: Proceedings of Automatic Face and Gesture Recognition,2002: 118-123.
    [16] Lee W,Kalra P,Thalmann N,Model Based Face Reconstruction for Animation.In: Proceedings of Multimedia Modeling,1997: 323-338.
    [17] Koschan A, Kang S, Paik J.Video Object Tracking Based on Extended Active Shape Models with Color Information.In: Proceedings of the first European Conference on Colour Graphics, Imaging and Vision, 2002:126-131.
    [18] Coots T, Edwards G,Taylor C.Active Appearance Models.In: Proceedings of the 5th European Conference on Computer Vision, 1998:484-498.
    [19] Xinwen Hou,Stan Z.Li,Hongjiang Zhang,Qiansheng Cheng. Direct appearance models.In: Proceedings of Computer Vision and Pattern Recognition,2001: 828-833.
    [20] Shuicheng Yan ,Ce Liu ,Stan Z.Li,Hongjiang Zhang, Heungyeung Shum , Qiansheng Cheng. Face alignment using texture-constrained active shape models.Image and Vision Computing,2003,21(1): 69-75.
    [21] Yi Zhou,Lie Gu,Hongjiang Zhang.Bayesian tangent shape model: estimating shape and pose parameters via Bayesian inference. In: Proceedings of Computer Vision and Pattern Recognition,2003: 109-116.
    [22] Feng Jiao, Stan Li, Heung-Yeung Shum,Dale Schuurmans. Face alignment using statistical models and wavelet feature.In: Proceedings of Computer Vision and Pattern Recognition, 2003: 321-327.
    [23] Fei Zuo, De W, Peter H.Fast facial feature extraction using a deformable shape model with Haar-wavelet based local texture attributes.In: Proceedings of International Conference on Image Processing,2004: 1425-1428.
    [24] Milborrow S, Nicolls F. Locating Facial Features with an Extended Active Shape Model, In:Proceedings of the 10th European Conference on Computer Vision,2008.
    [25] Ran He,Zhen Lei,Xiaotong Yuan,Stan Z.Li.Regularized Active Shape Model for Shape Alignment.In:IEEE International Conference on Automatic Face and GestureRecognition.2008, 17-19.
    [26] Stephen J.MaKenna,Shaogang Gong,Rolf P.Wurtz.etc. Tracking facial feature points with Gabor wavelets and Shape models.In: Proceedings of the First International Conference on Audio and Video-Based Biometric Person Authentication, 1997,1206:35-42.
    [27] Bruce D.Lucas,Takeo Kanade.An Iterative Image Registration Technique with an Application to Stereo Vision. In:Proceedings of Artificial Intelligence, 1981:674-679.
    [28] Carlo Tomasi, Takeo Kanade.Detection and Tracking of Point Features. Technical Report CMU-CS-91-132,1991.
    [29] Fabrice Bourel,Claude C.Chibelushi,Adrian A.Low.Robust Facial Feature Tacking. In: Proceeding of the 11th British Machine Vision Conference,Bristol, UK,2000,1:232-241.
    [30]赵明华.人脸检测和识别技术的研究(博士学位论文),四川大学博士学位论文,2006.
    [31] G.Yang,T.S.Huang.Human Face Detection in Complex Background. Pattern Recognition, 1994,27(1):53-63.
    [32] C.H.Lee,J.S.Kim,K.H.Park.Automatic human face location in a complex background using motion and color information, Pattern Recognition,1996, 29(11) :1877-1899.
    [33] M.Turk,A.Pentland.Eigenfaces for Recognition.Journal of Cognitive Neuroscience, 1991, 3(1):71-86
    [34] H.A.Rowley.Neural network-based face detection.Ph.D. Carnegie Mellon University, 1999.
    [35] H.A.Rowley,S.Baluja,T.Kanada.Rotation Invariant Neural Network-Based Face Detection. In:Proceedings of IEEE Conference on Computer Vision and Pattern Recognition,1998: 38-44.
    [36] E.Osuna,R.Freund,F.Girosi.Training Support Vector Machines:an Application to Face Detection.In:Proceedings of IEEE Conference on Computer Vision and Pattern Recognition,1997:130-136.
    [37]马勇,丁小青.基于层次型支持向量机的人脸检测.清华大学学报(自然科学版),2003,43(1):35-38.
    [38] A.N.Pajagopalan,K.S.Kumar,J.Karlekar etc.Finding Faces in Photographs.In: Proceedings of IEEE Conference on Computer Vision, 1998:640-645.
    [39]齐金山.人脸姿态分析与仿真(硕士学位论文).南京理工大学硕士学位论文,2008.
    [40] Viola P,Jones M,J.Robust real-time face detection. International Journal of Computer Vision, 2004,57(2): 137-154.
    [41]魏诗国.素描.高等教育出版社,1999.
    [42]李华明.基于中国人面貌形态学特征的人脸姿态估计方法研究(硕士学位论文),西北大学硕士论文,2005.
    [43] MPEG Video,”FDIS 14496-2 Visual”,ISO/IEC JTC1/SC29/WG11/ N2502, Oct.1998.
    [44]刘晓宁,周明全,耿国华.多模态人脸识别中的人脸特征定位.计算机应用与软件.2007,24(4):13-15.
    [45]姜贺.基于几何特征的人脸识别算法的研究(硕士学位论文),大连理工大学硕士论文,2008.
    [46]曾照华.基于正侧面人脸照片的三维人脸重建(硕士学位论文),中北大学硕士论文,2007.
    [47]马艳妮.脸部特征点提取技术研究及其在三维人脸建模中的应用(硕士学位论文),西北大学硕士论文,2009.
    [48]陈耀伟.人脸检测与基于视频的人脸三维模型重建(硕士学位论文),北京邮电大学硕士论文,2006.
    [49] J.C.Gower.Generalized procrustes analysis. Psychometrika,1975, 40(1):33-51.
    [50] T.F.Cootes,C.J.Taylor.Statistical Models of Appearance for Computer Vision. Imaging Science and Biomedical Engineering, University of Manchester, Manchester M13 9PT, U.K.March 8,2004.
    [51] K.Messer,J.Matas,J.Kittler et al.XM2VTSDB:The Extended M2VTS Database.In: Proceedings 2nd International Conference on Audio and Video-based Biometric Person Authentication,Washington DC,USA, 1999:72-77. www.ee.surrey.ac.uk/Research/VSSP/xm2vtsdb.
    [52] Wen Gao,Bo Cao,Shiguang Shan,Xinlin Chen,Delong Zhou,Xiaohua Zhang, Debin Zhao. The CAS-PEAL Large-Scale Chinese Face Database and Baseline Evaluations. IEEE Trans. On System Man,and Cybernetics(Part A) vol.38,no.1, pp149-161.2008.1.
    [53] Berthold K.P.Horn,Brian G.Schunck.Determining Optical Flow. Massachusetts Institute ofTechnology Artificial Intelligence Laboratory.1980.
    [54] Jean-Yves Bouguet.Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the algorithm. Intel Corporation Microprocessor Research Labs.2000. http://robots.stanford.edu/cs223b04/algo_tracking.pdf
    [55]宋刚,艾海舟,徐光祐 .纹理约束下的人脸特征点跟踪.软件学报. 2004,15(11):1607-1615.
    [56]苏从勇,庄越挺,黄丽,吴飞.基于贝叶斯网络增强预测模型的人脸多特征跟踪.中国图象图形学报,2005,10(2),175-180.
    [57]段鸿,程义民,王以孝,蔡尚书.基于Kanade-Lucas-Tomasi算法的人脸特征点跟踪方法.计算机辅助设计与图形学学报,2004,16(3),279-283.
    [58]马丽.目标跟踪中的遮挡问题研究(硕士学位论文).山东大学硕士学位论文,2006.
    [59] Ito K.,Sakane S.Robust view-based visual tracking with detection of occlusions.In:IEEE International Conference on Robotics and Automation, 2001,2(2): 1207-1213.
    [60] Obetrti F.,Calcagno S.,Zara M.,etc.Robust tracking of humans and vehicles in cluttered scenes with occlusions. In:IEEE International Conference on Image Processing,2002: 629-632.
    [61] Hu Min,Hu Wei-ming,Tan Tie-niu.Tracking people through occlusion. In: Proceedings of 17th International Conference on Pattern Recognition, 2004: 724-727.
    [62] Katja Nummiaro,Esther Koller-Meier,Luc Van Gool.An adaptive color-based particle filter.Image and Vision Computing,2003, 21(1):99-110.
    [63] Zhao Jian-wei,Wang Peng,Liu Cong-qing.An object tracking algorithm based on occlusion mesh model.In: International Conference on Machine Learning and Cybemetics, 2002:288-292.
    [64]章毓晋.图像分割.北京:科学出版社.2001,116-118.
    [65] James Foley,Van Dam.Computer Graphics:Principles and Practice. Boston:Pearon Education,1995:91-103.
    [66]叶航军,白雪生,徐光.基于支持向量机的人脸姿态判定.清华大学学报,2003,43(1):67-70.
    [67] Chen Q,Wu H,Fukumoto T.3D head pose estimation without feature tracking. In:Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recogniton,1998: 88-93.
    [68] Rowley H.A.,Baluja S.,Kanade T.Rotation invariant neural network-based face detection. In:Proceedings of the 17th IEEE Conference on Computer Vision and Pattern Recognition.1998:38-44.
    [69] Yao P,Evans G,Calway A.Using affine correspondence to estimate 3D facial pose[A]. In:Proceedings of the IEEE International Conference on Image Processing[C].2001.3: 919-922.
    [70] Xiao J,Kanade T,Cohn J.F.Robust full-motion recovery of head by dynamic template and re-registration techniques.In: Proceeding of the IEEE International Conference on Automatic Face and Gesture Recognition.2002: 593-600.
    [71] Lopez R,Huang T.S.3D head compution from 2D images:Template versus features.In: Proceedings of the IEEE International Conference on Image Processing.1995,2: 599-602.
    [72] A.Nikolaidis,I.Pitas, Facial feature extraction and determination of pose. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.48.1852&rep=rep1&type=pdf
    [73] Shinn-Ying Ho,Hui-Ling Huang,An analytic solution for the pose determination of human faces from a monocular image, Pattern Recognition Letters, 19:1045-1054,1998.
    [74] T.Horprasert,Y.Yacoob,L.S.Davis,Computing 3D Head Orientation from a Monocular Image Sequence,In:Proceedings of SPIE-The International Society for Optical Engineering 25th AIPR workshop: Emerging Applications of Computer Vision,2962: 244-252,1996.
    [75]毋立芳,张斯聪,赵晓晴,魏宁.一种人脸姿势估计新方法.信号处理.2006,22(l):61-64.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700