鲁棒的人脸识别方法研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
计算机人脸识别是一个复杂和困难的问题,其原因是:(1)人脸是由复杂的三维曲面构成的可变形体,难以用数学描述;(2)所有人的人脸结构高度相似,而人脸的图像又受年龄和成像条件的影响,这使得同一人在不同条件下的差别可能比不同的人在相同条件下的差别还要大。因此,人脸识别技术实用化所需解决的重要问题是研究能在上述变化条件下可靠工作的人脸识别技术,即鲁棒的人脸识别技术。实现鲁棒的人脸识别涉及人脸检测、特征检测、人脸描述、建模、识别等技术,而其中最关键的是特征检测。基于上述理解,本论文以鲁棒的人脸识别为目标,以人脸特征检测为重点进行了相关的研究,并取得了如下创新性成果:
    1、提出多线索自适应人脸特征检测方法,将多种人脸线索通过导引、校验、纠错等方式相融合,实现了在姿态、背景和光照变化的情况下人脸特征的可靠检测。与现有典型的特征检测方法相比,正确率和适应性有显著提高(对于姿态变化的情况,正确率提高10%左右),从而使人脸特征检测技术达到实用阶段。
    2、提出图像分析和运动分析相结合的交叉验证方法,实现了活动图像人脸特征检测中的自动纠错和特征估计机制,从而使视频中人脸特征自动检测的正确率达到98%以上,为基于内容检索和视频编码的应用开辟了道路。
    3、提出基于自适应阈值分割的人脸特征检测方法和基于主分量分析的特征真实性概念,将人脸特征检测方法建立在无先验假设的基础上,克服了现有方法中过分依赖先验阈值、摄像条件或经验参数的缺陷,极大扩展了人脸特征检测的应用范围。
    4、将特征检测和颜色分析相融合,提出自适应可变模型的人脸检测方法,解决了复杂背景和光照可变条件下的多人脸检测问题。
    5、提出基于特征的多姿态自动建模方法,结合多模板匹配策略,有效解决了大容量可变姿态的人脸识别问题。
It is difficult to implement the face recognition mechanism using computers for several reasons. First, human face is a deformable object composed of complex 3D curve surfaces, which is hard to be represented in form of mathematics. Secondly, faces of different persons have the similar structure. On the other side, the face images are greatly dependent on ages and photography conditions. This results that the difference between two face images of two different persons taken under the same photography condition is probably less than that between two images of the same person under different conditions. Therefore, in order to implement a practical face recognition system, the recognition method needs to be independent of the above variations. This kind of method is named as Robust Face Recognition technology in this study. A Robust Face Recognition system takes use of many technologies among which feature detection is the most important.
    According to the above understanding, this study targets on Robust Face Recognition based on feature detection, and makes the following creative contributions:
    1. An adaptive multi-cue based facial feature detection approach is presented. By combining various facial cues through inducing, verifying and error-correcting, this approach enables to detect facial features robustly under varying poses, background and lightning conditions. It increases the correction ratio significantly (up to 10% for pose variation) compared with typical existing methods and makes it possible to detect facial features for practical use.
    2. A cross-verification mechanism is worked out for detecting facial features on moving pictures by merging the technologies of both image analysis and motion analysis. It provides a solution to the problem of error-correction and feature estimation and makes it possible to detect facial features on video segment at a correction ration of 98%, thus paves the way for the application of content-based retrieval and video encoding.
    3. The concept of Feature Fidelity is defined based on Principal Component Analysis (PCA) and an adaptive threshold based feature detector is then proposed, which takes no advantage of ad hoc knowledge including threshold, photography condition, experimental coefficients, etc., thus greatly expands the applications of facial feature detection technology.
    4. An adaptive face detection method is proposed, which combines feature detection and color analysis and makes it possible to detect multiple faces on the complex background under varied lightning conditions.
    5. A study on face recognition for varied poses and large face database is made on the basis of automatic multi-view modeling and multi-template matching.
引文
[1] Ai Haizhou, Liang Luhong, Xu Guangyou, A General Framework for Face Detection, In Proceedings, Edited by: Tieniu Tan, Yuanchun Shi and Wen Gao, ICMI'2000, Third International Conference on Multimodal Interfaces, Lecture Notes in Computer Science, Vol.1948, pp.119-126, Springer-Verlag Berlin Heidelberg New York, 2000.
    [2] S. Akamatsu, et al., "A robust face identification scheme - KL expansion of an invariant feature space," SPIE Vol. 1607, Intelligent Robots and Computer Vision X: Algorithms and Techniques, 1991, pp.71-84.
    [3] S. Akamatsu, et al., "Automatic extraction of target images for face identification using the sub-space classification method," IEICE Trans. Inf. & Syst., Vol. E76-D, No. 10, Oct. 1993, pp.1190-1198.
    [4] P. Ballard and G.C. Stockman, "Controlling a computer via facial aspect," IEEE Trans. Syst. Man and Cyber., Vol. 25, No. 4, Apr. 1995, pp. 669-677.
    [5] R. Baron, "Mechanisms of human facial recognition," Int. J. Man-Machine Studies, Vol.15, 1981, pp.137-178.
    [6] D.Beymer, "Pose-invariant face recognition using real and virtual views," A.I. Technical Report No. 1574, A.I. Lab., Massachusette Institute of Technology, Mar. 1996.
    [7] W. W. Bledsoe, Man machine facial recognition, Technical Report FRI 22, Panoramic Research Inc. , Aug. 1966.
    [8] R. Brunelli and T. Poggio, "HyperBF networks for gender classification," in Proc. DARPA Image Understanding Workshop, 1992, pp.311-314.
    [9] R. Brunelli and T. Poggio, "Face recognition: Features versus templates," IEEE Trans. Patt. Anal. and Mach. Intell., Vol. 15, No. 10, Oct. 1993, pp1042-1052.
    [10] R. Chellappa, C. L. Wilson and S. Sirohey, "Human and machine recognition of faces: A survey," Proc. of the IEEE, Vol. 83, No. 5, May 1995, pp. 705-740.
    [11] G. Chow and X. Li, "Towards a system for automatic facial feature detection," Pattern Recognition, Vol. 26, No. 12, 1993, pp.1739-1755.
    L.C De Silva, K. Aizawa and M. Hatori, "Detection and tracking of facial features,"
    
    [12] Proc. SPIE Vol. 2501, Visual Communications and Image Processing, 1995, pp. 1161-1172.
    [13] L.C De Silva, K. Aizawa and M. Hatori, "Detection and tracking of facial features by using edge pixel counting and deformable circular template matching," IEICE Transactions on Information and Systems, Vol. E78-D, No. 9, Sept. 1995, pp. 1195-1207.
    [14] A. Eleftheriadis and A. Jacauin, "Automatical face location detection for model-assisted rate control in H.261-compatible coding of video," Signal Processing - Image Communication, Vol. 7, No. 4-6, Nov. 1995, pp. 435-455.
    [15] Sir Francis Galton, Personal identificaiton and description - I, Nature, Vol. 21, No. 6, Jun. 1888, pp. 173-721.
    [16] A. Gee and R. Cipolla, "Determining the gaze of faces in images," Image and Vision Computing, Vol. 12, No. 10, Dec. 1994, pp.639-647.
    [17] A. J. Goldstein, L. D. Harmon and A. B. Lesk, "Identification of human faces", Proc. IEEE, Vol. 59, No. 5, 1971, pp.748-760.
    [18] B, A, Golomb and T. J. Sejnowski, "SEXNET: A neural network identifies sex from human faces," in Advances in Neural Information Processing Systems 3, D.S.Touretzky and R.Lipmann, Eds. San Mateo, CA: Morgan Kaufmann, 1991, pp.572-577.
    [19] V. Govindaraju, et al., "A computational model for face location," Third International Conf. on Computer Vision, Osaka, Japan, Dec. 1990, pp. 718-721.
    [20] G. Y. Xu, Z. Y. Peng, L. H. Liang, etc., "A Proposal for Face and Facial Feature Detection," Submitted to ISO/IEC JTC1/SC29/WG11, 2001, 1.
    [21] P. W. Hallinan, "Recognition human eyes," in SPIE Proc.: Geometric Methods in Computer Vision, Vol.1570, 1991, 0pp.214-226.
    [22] L. D. Harmon, S. C. Kuo, P. F. Tamig and U. Raudkivi, "Identification of human face profiles by computer," Pattern Recognition, Vol.10, 1978, pp.301-312.
    [23] Z. Hong, "Algebraic feature extraction of image for recognition," Pattern Recognition, Vol. 24, 1991, pp. 211-219.
    J.H. Hu, R.S. Wang and Y. Wang, "Compression of personal identification pictures using vector quantization with facial feature correction," Optical Engineering, Vol. 35,
    
    [24] No. 1, Jan. 1996, pp. 198-203.
    [25] C. L. Huang and C. W. Chen, "Human facial feature extraction for face interpretation and recognition," Pattern Recognition, Vol. 25, No. 12, 1992, pp. 1435-1444.
    [26] X. Jia and M. S. Nixon, "Automatic feature extraction for face recognition," Proc. of ICSP'93, pp.1034-1037.
    [27] M. S. Kamel, et al., "Face recognition using perspective invariant features," Pattern Recognition Letters, Vol.15, No.9, 1994, 877-883.
    [28] T. Kanade, Computer Recognition of Human Faces, Basel and Stuttgart: Birkhauser, 1977.
    [29] G. J. Kaufman Jr and K. J. Breeding, "The automatic recognition of human faces from profile silhouettes," Pattern Recognition, Vol. 13, 1981, pp.97-110.
    [30] Y. Kaya and K. Kobayashi, "A basic study on human face recognition," in Frontiers of Pattern Recognition, S.Watanabe, Ed. New York: Academic, 1972, pp.265-289.
    [31] M. D. Kelly, "Visual identification of people by computer," Tech. Rep. AI-130, Stanford AI Proj., Stanford, CA, 1970.
    [32] M. Kirby and L. Sirovich, "Application of the Karhunen-Loeve procedure for the characterization of human faces," IEEE Trans. Patt. Anal. and Mach. Intell., Vol. 12, 1990, pp.103-108.
    [33] T. Kohonen, Self-Organization and Associative Memory, Berlin: Springer, 1988.
    [34] B.S. Manjunath, R. Chellappa and C. von der Malsburg, "A feature based approach to face recognition," Proc. IEEE Computer Soc. Conf. on Computer Vision and Pattern Recognition, 1992, pp.373-378.
    [35] B.S. Manjunath and R. Chellappa, "A computational model for boundary detection," Proc. IEEE Computer Soc. Conf. on Computer Vision and Pattern Recognition, 1991, pp.358-363.
    [36] O. Nakamura, et al., "Identification of human faces based on isodensity maps," Pattern Recognition, Vol. 24, No. 3, 1991, pp.263-272.
    [37] M. Nixon, "Eye spacing measurements for facial recognition," SPIE Proc. 575, Applications of Digital Image Processing VIII, 1985, pp. 279-285.
    K. Ohmura, A. Tomonu and Y. Kobagashi, "Method of detecting face direction using image processing for human interface," SPIE Vol. 1001, Visual Communication and
    
    [38] Image Processing, 1988, pp.625-632.
    [39] Z. Y. Peng, S. Y. You and G. Y. Xu, "Locating facial features using thresheld images," in the Third Int. Proc. of Signal Processing, Vol.2, 1996, pp.1162-1166.
    [40] Z. Y. Peng, G. Y. Xu and H. J. Zhang, "Detecting Facial Features on Images with Multiple Faces," Proc. of ICMI'2000, Springer Press, pp.191-195, 2000.
    [41] Z. Y. Peng, W. Hong, L. H. Liang, G. Y. Xu and H. J. Zhang, " Detecting Facial Features On Image Sequences Using Cross-verification Mechanism," Submitted to The Second IEEE Pacific-Rim Conference on Multimedia (PCM'2001).
    [42] Z. Y. Peng, W. Hong, L. H. Liang and G. Y. Xu, " Face and Facial Feature Detection On Video Segments," Submitted to Journal of Computer Science and Technology, 2001.
    [43] A. Pentland, B. Moghaddam, T. Starner, and M. Turk, "View-based and modular eigenspaces for face recognition," in Proc. IEEE Computer Soc. Conf. On Computer Vision and Patt. Recog., 1994, pp.84-91.
    [44] A. Rahardja, et al., "A neural network approach to component versus holistic recognition of facial expressions in images," SPIE Vol. 1607, Intelligent Robots and Computer Vision X: Algorithms and Techniques, 1991, pp.62-70.
    [45] D. Reisfeld and Y. Yeshuran, "Robust detection of facial features by generalized symmetry," Proc. 11th Int. Conf. on Patt. Recog., 1992, pp. 117-120.
    [46] D. Reisfeld, H. Wolfson and Y. Yeshurun, "Detection of interest points using symmetry," Third International Conf. on Computer Vision, Osaka, Japan, Dec. 1990, pp. 62-65.
    [47] A. Samal and P. A. Iyengar, "Automatic recognition and analysis of human faces and facial expressions: A survey," Pattern Recognition, Vol. 25, No. 1, 1992, pp. 65-77.
    [48] T. J. Stonham, "Practical face recognition and verification with WISARD," in Aspects of Face Processing, H.D.Ellis, M.A.Jeeves, F.Newcombe, and A.Young, Eds. Dordrecht: Nijhoff, 1984, pp.426-441.
    [49] Shi-hong, et al, "Facial Feature Detection Using Geometrical Face Model," Pattern Recognition, vol. 31, No. 3, 1997, pp. 273-282.
    [50] D. Terzopoulos, et al, "Elastically deformable models," Computer Graphics, vol. 21, No. 4, Jul., 1987, pp. 205-214.
    
    
    [51] M.A. Turk and A.D. Pentland, "Face recognition using eigenfaces," Proc. of Computer Vision and Pattern Recognition, 1991, pp.586-591.
    [52] L. Wiskott, et al., "Face recognition and gender determination," Proc. of the Intern. Workshop on Automatic Face- and Gesture-Recognition, Zurich, 1995, pp.92-97.
    [53] X. Xie, R. Sudhakar and H. Zhuang, "On improving eye feature extraction using deformable templates," Pattern Recognition, Vol. 27, No. 6, 1994, pp. 791-799.
    [54] A. L. Yuille, D. S. Cohen and P. W. Halinan, "Feature extraction from faces using deformable templates," Proc. IEEE Computer Soc. Conf. on Computer Vision and Pattern Recognition, 1989, pp.104-109.
    [55] Y. Y. Zhang, S. Y. You, and G. Y. Xu, "A view-based automatic face recognition system," Proc. 1st Int. Conf. on Multimodal Interface, 1996.
    [56] Y. Y. Zhang, Z. Y. Peng, S. Y. You and G. Y. Xu, "A multi-View face recognition system," Journal of Computer Science and Technology, Vol. 12, No. 5, Sept. 1997, 400-407.
    [57] 黄小彪. 基于立体视觉的人脸检测: [学士学位论文]. 北京: 清华大学科学与技术系,1998
    [58] 彭振云,游素亚,徐光祐,“允许姿态变换的快速人脸特征检测”,中国图像图形学报,Vol.2, No.4, 1997. 4, pp225-229.
    [59] 彭振云,徐光祐,“人脸特征检测和基于透视不变性的分类”,第三届全国计算机智能接口与智能应用学术会议论文集,电子工业出版社,1997, pp.285-289.
    [60] 彭振云,陶霖密,徐光祐,“基于颜色和特征的自适应人脸检测,”第四届全国计算机智能接口与智能应用学术会议论文集,电子工业出版社,北京,1999。
    [61] 彭振云,陶霖密,徐光祐,张宏江, "基于颜色分割和KL变换的人脸特征检测," 清华学报(自然科学版), 41(4/5): 218 - 221, 2001.。
    [62] 陶霖密,彭振云,徐光祐,“人脸的肤色特征及复杂环境下的人脸检测,”第四届全国计算机智能接口与智能应用学术会议论文集,电子工业出版社,北京,1999, pp.205-211。
    [63] 张永越. 可变姿态的人脸识别研究: [硕士学位论文]. 北京: 清华大学科学与技术系,1998
    [64] 谢峰,彭振云,徐光祐,“高可靠性的身份验证系统”,第四届中国计算机智能接口与智能应用学术会议,1999. pp. 250-255.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700