用户名: 密码: 验证码:
基于流形学习的人脸识别技术
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
人脸识别作为生物特征识别的主流方向之一,因其在安全验证系统、信用卡验证、医学、档案管理、视频会议、人机交互、公安系统罪犯识别等方面的巨大应用前景而越来越成为当前模式识别和人工智能领域的一个研究热点。人脸识别是利用计算机对人脸图像进行处理、分析,并从中提取能表征人脸图像的鉴别信息,用于进行身份识别的一门技术。人脸识别与其它生物特征识别技术相比,具有直接、友好、方便的特点,易于被用户所接受。
     但是,由于人脸结构的复杂性、人脸表情的多样性以及人脸成像过程的多变性等原因,人脸机器自动识别至今仍然被公认是一个具有挑战性的研究领域。一般认为,人脸从某种意义上来说是一种流形结构,人脸数据集是由某些内在变量控制形成的非线性流形,只要能从流形中寻找出光照、表情和姿态等控制变量,就能大幅度降低观测空间的维数。流形学习是近年来机器学习及模式识别等领域的一个研究热点,其主要目标是去发现高维观察数据空间的低维光滑流形。流形学习分为线性和非线性两种。线性流形学习目前已较成熟,主要方法有主成分分析(Principal Component Analysis, PCA)和线性鉴别分析(Linear Discriminant Analysis, LDA)等,这些算法具有较强的数学基础且易于实现。但是线性方法无法表现数据的内在结构。非线性流形学习主要有局部线性嵌入算法(Locally Linear Embedding, LLE)和监督局部线性嵌入算法(Supervised Locally Linear Embedding, SLLE)等,能够较有效地发现非线性高维数据的本质维数,利于进行维数约简和数据分析。
     本文研究流表学习算法在人脸识别中的应用,对线性流形降维算法中的两种算法PCA、LDA和非线性流形降维算法中的两种算法LLE、SLLE分别进行仿真研究,并在此基础上实现了线性流形若干算法和非线性流形若干算法的融合研究。以下为本文主要的工作内容:
     1)本文首先对原始PCA算法改进,使其具有灰度归一化操作能力,克服了光照对目标的影响。
     2)研究并比较主成分分析(PCA)和线性鉴别分析(LDA)在人脸识别中的性能,并在分析LDA算法基础上提出了一种改进LDA算法。该方法主要解决传统LDA算法在投影空间出现边缘类样本重叠的问题。
     3)基于PCA和LDA两种算法各自的优点,提出了一种融合算法。该方法融合了改进PCA算法与改进LDA算法。首先,用改进PCA算法对原样本降维,获得最优特征表示子空间;然后,在保证该子空间类内散度矩阵非奇异的基础上,作改进的线性判别分析。
     4)介绍了非线性流形学习中的两种主流算法,主要分析局部线性嵌入算法(LLE),并针对LLE对样本无法分类的不足,引入了有监督的局部线性嵌入算法(SLLE)。对这两种算法仿真比较,得出SLLE方法有较好的分类能力。通过研究比较这两种算法,加深了对非线性流形学习算法的认识。
     5)将线性降维算法(PCA)和非线性流形降维算法(LLE)进行比较,分析了两者的优缺点。针对线性算法PCA不能很好地保持人脸样本内在的拓扑结构、而非线性流形学习算法LLE能较好保持人脸样本内在拓扑结构的优点,提出了一种改进PCA和LLE相融合的算法。基于ORL人脸数据库的实验结果表明了所提出的算法应用于人脸识别的有效性。
Face recognition is a main orientation of biometrics, which is widely used in secure authentication system, credit card verification, medical, archive management, video conferencing, human-computer interaction, public security system and becomes a hotspot in the fields of current pattern recognition and artificial intelligence. Face recognition is an identification technique. The face images are processed and analyzed by computer and then the discriminant features are extracted. Compared with other biometric recognition techniques, face recognition is more direct, friendly, more convenient and easily accepted by customers.
     However, due to the complexity of human face structure, the diversity of face expression and the change in the process of face image formation, computer face recognition technology is universally considered a challenging study topic. In a sense, it is commonly accepted that human face is a manifold structure. Face dataset is a nonlinear manifold formed by some inner variables, such as illumination condition, face pose and facial expression. If some controlled variables can be seek, space dimensionality could be reduced greatly. In recent years, manifold learning becomes a hot study topic in the fields of artificial intelligence and model recognition, and its aim is to seek low-dimensional smooth manifold in high-dimensional observation data space. The manifold learning can be divided into two classes:linear and nonlinear. At present, the linear manifold learning is mature, mainly contains Principal Component Analysis (PCA) and Linear Discriminant Analysis (LDA), etc. They have substantial mathematical foundation and can be implemented easily. However, it can not show the inner structure of the data in linear methods. Nonlinear methods, represented by Locally Linear Embedding (I.LE). and Supervised Locally Linear Embedding (SLLE), etc, can discover the intrinsic dimensions of nonlinear high dimensional data effectively, which can help researchers to reduce dimensionality and analyze data better.
     The application of manifold learning in face recognition is studied in this paper. Two linear manifold learning algorithms PCA and LDA, and two nonlinear manifold learning algorithms LLE and SLLE are researched and simulated.
     I) An improved PCA. in which the formula of PCA is modified, is presented first in this paper. This algorithm has the ability of gray normalization and can overcome the influence of light on the sample.
     2) The performance of PCA and LDA in face recognition are researched respectively and compared. Then the traditional LDA is improved, mainly to solve the problem of the overlap of neighbor classes in the projection space.
     3) According to the advantages of PCA and LDA, an improved algorithm, which combined the improved PCA and the improved LDA, is presented. The improved PCA is used to reduce the dimension first to get the optimal characteristic subspace of the original sample data set. In this process, the intra-class scatter matrix of the characteristic subspace should be ensured to be non-singular. On this basis, the improved LDA is carried out.
     4) Two nonlinear manifold learning algorithms are introduced. LLE is mainly analyzed. Aimed at its disadvantage of unable to classify samples, SLLE is introduced. Through the simulation and comparison of LLE and SLLE, we can get that SLLE has stronger ability to classify the different samples.
     5) The merits and demerits of PCA and LLE are analyzed respectively. Linear dimensionality reduction method PCA can not be good at keeping the intrinsic distribution of face sample data. while nonlinear algorithm LLE has the advantage of keeping the intrinsic distribution of face sample data. In this paper, an improved PCA is combined with LLE and used in face recognition, which has the ability of gray normalization and can overcome the influence of light on the sample. Experimental results on ORL (Olivetti Research Laboratory) database demonstrate the validity of the algorithm.
引文
[1]宋红,石峰.基于人脸检测与跟踪的智能监控系统[J].北京理工大学学报,2004,24(11):209-211.
    [2]田箐等.基于视觉感知的人脸图像感兴趣区域检测[J].计算机工程与应用,2002,38(22):115-128.
    [3]姚若光.人脸识别系统的技术创新和应用前景[J].中国安防,2007(1):95-98.
    [4]皱丹丹.人脸识别技术的研究与实际应用[D].北京邮电大学,2003,03.
    [5]Allen A L. Personal Descriptions [M]. London:Buterworth,1950.
    [6]Parke F L. Computer Generated Animation of Faces [C]. In Proceedings ACM annual Conference,1972(1):451-457.
    [7]Goldstion R J, Hams on L D, Lesk A B. Man-machine interaction in human face identification [J]. Bell Syst. Tech. Journal,1972(51):399-427.
    [8]Kaya Y, KobayashiK. A Basic Study on human Recognition. In Frontiers of Pattern Recognition [M]. New York:Academic,1971:265-289.
    [9]Kanad T. Picture Processing System by Computer and Recognition of human face [D]. Kyoto, Kyoto University,1973(42):89-93.
    [10]Turk M, Pentland A. Eigenfaces for Recognition [J]. Cognition Neuroscience,1991, 3(1):71-86.
    [11]彭辉,张长水.基于K-L变换的人脸自动识别方法[J].清华大学学报,1997,37(3):67-70.
    [12]Juell P, Marsh R. A Hierarchical network for human face detection [J]. Pattern Recognition,1996,29(5):781-787.
    [13]Intrator N, Reisfeld D, Yeshunm Y. Face recognition using a hybrid supervised/unsupervised neural network [J]. Pattern Recognition Letters,1996,17(1): 67-76.
    [14]Manjunath B S, Chellappa R. A feature based approach to face recognition [C]. In IEEE Proceedings of Computer Vision and Pattern Recognition,1992,373-378.
    [15]高西奇,周洪祥,何振亚.基于小波变换的主元分析人脸图像识别[J].东南大学学报,1996,26(2):137-141.
    [16]Adini Y, Mosed Y, Ullman S. Face recognition:The problem of compensating for changes in illumination direction [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,1997,19(7):312-317.
    [17]Lam K M and Yan H. An analytic-holistic approach for face recognition based on a single frontal view [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1998,20(7):673-687.
    [18]Zhihong Zeng, Maja Pantic. Asurvey of affect Recognition Methods:Audio, Visual, and Spontaneous Expressions. IEEE Transaction on Pattern Analysis and Machine Intelligence,2009,31(1):39-58.
    [19]Bo Wu, Haizhou Ai, Chang Huang, Shihong Lao. Fast rotation invariant multi-view face detection based on real Adaboost.6th IEEE International Conference on Automatic Face and Gesture Recognition,2004:79-84.
    [20]Kwork-Wai Wong, Kin-Man Lam and Wan-Chi Siu. An efficient algorithm for human face detection and facial feature extraction under different conditions. Pattern Recognition,2001,34(10):1993-2004.
    [21]B. heisele, P. ho, T. poggio. Face Recognition with Support Vector Machines:Global versus Component-based Approach[J].8th IEEE International Conference on Computer Vision,2001,2:688-694.
    [22]张俊.基于面部几何特征点提取的人脸识别方法.红外与激光工程,1999,28(4):40-43.
    [23]Onsen Toygar, and Adnan Acan. Multiple classifier implementation of a divide-and-conquer approach using appearance-based statistical methods for face recognition. Pattern Recognition,2004,25(12):1421-1430.
    [24]Hothman, T.Aboulnasr. A Separable Low Complexity 2D HMM with Application to Face Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003,25(10):1229-1238.
    [25]Lawrence S, Giles C L, Tsoi A C, et al. Face Recognition:A Convolutional Neural Network Approach[J]. IEEE Transactions on Neural Networks,1997,8(1):98-113.
    [26]R.Brunelli, T.Poggio. Face Recognition:Feature Versus Templates[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,1993,15(10):1042-1052.
    [27]Huang C L, Chen C W. Human Facial Feature Extraction for Face Recognition and Interpretation[J]. Pattern Recognition,1992,25(12):1435-1444.
    [28]A.Samal, P.A.Jyenga. Automatic Recognition and Analysis of Human Face and Facial Expression:A Survey [J]. Pattern Recognition,1992,25(10):65-67.
    [29]Otsuka T, Ohya J. Recognition of facial expressions using HMM with Continuous output probabilities [J]. Proc. International workshop on Robot and Human Communication,1996:323-328.
    [30]A.V.Nefian, M.H.Hayes. Hidden Markov Models for face Recognition [J]. In proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing,1998,5:2721-2724.
    [31]A.P. Dempster, N.M.Laird, D.B.Rubin. Maximum Likelihood form Incomplete Data via the EM Algorithm [J]. Journal of the Royal Statistical Society, Series B:Methodological, 1997,39(1):1-38.
    [32]T.F.Cootes, C.J.Taylor, D.H.Cooper. Active Shape Models:Their Training and Application [J]. Computer Vision and Image Understanding,1995,61(1):38-59.
    [33]T.F.Cootes, G.J.Edwards, C.J.Tayor. Active Apperence Models [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2001,23(6):681-685.
    [34]Andrew.A, Calder.J, BurtonM. A Principal Component Analysis of Facial Expressions [J]. Vision Research,2001,41:1179-1208.
    [35]Juwei Lu, Plataniotis, K.N, Venetsanopoulos, A.N. Face Recognition Using LDA-Based Algorithms. IEEE Transactions on Neural Networks,2003,141:195-200.
    [36]Bartlett Marian Stewart, Lades H Martin, Sejnowski Terrence J. Independent component representations for face recognition Proceedings of the SPIE Symposium on Electronic Imaging [A]. Science and Technology; conference on Human Vision and Electronic Imaging III [C]. California:San Jose,1998,201-207.
    [37]M.Turk and A. Pentland. Face recognition using eigenfaces[J]. Proc. of Int Conf. on Pattern Recognition,1991:586-591.
    [38]Jian Yang, David Zhang. Two-dimensional PCA:A new approach to appearance-based face representation and recognition [J]. IEEE Transactions on pattern Analysis and Machine Intelligence,2004,26(1):131-137.
    [39]J. Lu, K.N. Plataniotis, A.N. Venetsanopulaos. Face Recognition Using LDA-Based Algorithms [J]. IEEE Trans. On Neural Networks,2003,14(1):195-200.
    [40]D.LSwets, J Weng. Using Discriminant Eifgenfeature for Image Retieval [J]. IEEE Transation on Pattern Analysis and Machine Intelligence,1996,18(8):831-836.
    [41]P.N. Belhumeur, J. Hespanda, and D. Kriegeman. Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection [J]. IEEE Trans. Pattern Analysis and Machine Intelligence,1997,19(7):711-720.
    [42]C.J.Liu, H. Wechsler. Enhanced Fisher Linear Discriminant Models for face Recognition [J]. In Proceedings of International Conference Pattern Recognition,1998(2): 1368-1372.
    [43]R.Huang, Q.Liu, H.Lu, S.Ma. Solving the Small Size Problem of LDA [J]. In Proceeding of 16th International Conference on Pattern Recognition,2002,3:29-32.
    [44]H.Yu and J.Yang. A Direct LDA Algorithm for Heigh-Dimensional Data with Application to face Recognition [J]. Pattern Recognition,2001,34:2067-2070.
    [45]H.Cevikalp, M.Neamtu, M.Wikes, A.Barkana. Discriminative Common Vectors for face Recognition [J]. IEEE Transaction on Pattern Analysis and Machine Intelligence,2005, 27(1):4-13.
    [46]P.Comon. Independent Component Analysis:A New Concept [J]. Signal Processing, 1994,36(4):287-314.
    [47]A,Hyvarinenl. Fast and Robust Fixed-point Algorithm for Independent Component Analysis [J]. IEEE Transactions on Neural Networks,1999,10(3):626-634.
    [48]M.S.Bartelet, H.M.Lades. Independent Component Representation for face recognition [J]. In Proceedings of the SPIE,1998,2339(3):528-539.
    [49]O.Deniz, M.C.Santana. Face Recognition Using Independent Component Analysis and Support Vector Machines [J]. Pattern Recognition Letters,2003,24(13):2153-2157.
    [50]Lawrence S, Giles C L, Tsoi A C, et al. Face Recognition:A Convolutional Neural Network Approach[J]. IEEE Transactions on Neural Networks,1997,8(1):98-113.
    [51]Fleming M, Cottrell G. Categorization of faces using unsupervised feature extraction[J]. In Proceedings of the International Joint Conference on Neural Networks.1990,2: 65-70.
    [52]Intrator N, Reisfeld D, Yeshurun Y. Face Recognition by Supervised/Unsupervised Hybrid Network[J]. Pattern Recognition Letters,1996,17(1):67-76.
    [53]M Lades, JC Vorueggen, J Buhmann, J Lange. Face Recognition by Elastic Bunch Graph Matching[J]. IEEE Transaction on Computers,1993,42(3):300-311.
    [54]Wiskott L, Fellous J M,Kruger N. Face recognition by elastic bunch graph matching. IEEE Trans. PAMI,1997,19(7).
    [55]Kotropoulos C, Pitas I. Face authentication based on morphological grid matching. IEEE inter. Conf. on Image Processing,1997(1):105-108.
    [56]Chahab Nastar,Baback Moghaddam and Alex Pentland. Flexible Images:Matching and Recognition Using Learned Deformations, computer vision and image understanding,1997,65:179-191.
    [57]P. N. Belhumeur, Hespanha and D. J. Kriegman. Eigenfaces vs. Fisher-faces: Recognition using class specific linear projection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,1997,19(7):711-720.
    [58]Yu Hua, Yang Jie. A Direct LDA Algorithm for High-dimensional Data with Application to Face Recognition[J]. Pattern Recognition,2001,34(10):2067-2070.
    [59]G Yanping ZhangHe, Rongrong Dou. Regularized Linear Discriminant Analysis for Face Recognition Based on Ensemble Learning[J]. Computer Engineering,2010,36(17): 144-146.
    [60]Marcialis G L, Roli F. Fusion of LDA and PCA for Face verification[C]. Proc. of the Workshop on Biometric Authentication.2002,9(1):30-39.
    [61]Liu C. Enhanced Independent Component Analysis of Gabor Features for Face Recognition. IEEE Transactions on Neutral Networks.2003,14:919-928.
    [62]Lu Juwei, Plataniotis K N, Venetsanopoulos A N. Regularization Studies of Linear Discriminant Analysis in Small Sample Size Scenarios with Application to Face Recognition[J]. Pattern Recognition Letter,2005,26(2):181-191.
    [63]H. Moon, P.J. Computational and Performance aspects of PCA-based Face Recognition Algorithms[J]. Perception.2001,30(1):303-321.
    [64]Qingfu Xue, Xiaoli Li, Yafang Chen. Face Recognition of Fusion LLE and PCA[J]. Computer and Information Technology,2010,18(3):5-8.
    [65]Hailiang Feng. Research on Applying Manifold Learning Algorithms to Face Recognition[C]. A Thesis Submitted to Chongqing University,2008,10(38):1-163.
    [66]Y.X. Liang, W.G Gong. Face Recognition Using Heteroscedastic Weighted Kernel Discriminant Analysis [J]. SpringerLink,2005,3687:199-205.
    [67]G. Dai, D.Y. Yeung. Face Recognition using a Kernel Fractional-step Discriminant analysis algorithm [J]. Pattern Recognition,2007,40(1):229-243.
    [68]Zhao W, Chellappa R, Rosenfel A, et al. Face recognition[J]. ACM Computing,2003, 35(4):399-458.
    [69]Y. Zhang, D.Y. Yeung. Heteroscedastic Probabilistic Linear Discriminant Analysis with Semi-supervised Extension [J]. SpringgerLink,2009,5782:602-616.
    [70]Xiaoping Zhang, Xuezhong Zhou. An Improved LDA Topic Model [J]. Journal of Beijing JiaoTong University,2010,34(2):111-114.
    [71]Belkin M, Niyogi P. Laplacian eigenmaps for dimensionality reduction and data representation[J]. Neural computation,2003,15(6):1373-1396.
    [72]He X, Niyogi P. Locality preserving projections[C]. Advances in Neural Information Processing Systems. Vancouver, Canada,2003,16(5):153-160.
    [73]Seung H, Lee D. The manifold ways of perception [J]. Science,2000,290(5500): 2268-2269.
    [74]ROWELS S T, SAUL L K. Nonlinear dimensionality reduction by locally linear embedding[J]. Science,2000,290(5000):2323-2326.
    [75]P. J. L'Heureux, J. Carreau, Y. Bengio, et.al. Locally Linear Embedding for dimensionality reduction in QSAR[J]. Journal of Computer-Aided Molecular Design, 2000,18:475-482.
    [76]H. Moon, P.J. Philips. Computational and Performance aspects of PCA-based Face Recognition Algorithms [J]. Perception,2000,30:303-321.
    [77]Hailiang Feng, Jianwei Li, Xuchu Wang, Honghuang. Face recognition based on nonlinear manifold learning. Journal of Chongqing University,2008.31(3):303-306.
    [78]Tan Lu, Wu Yi. Intrinsic Dimension Estimation Based on LLE,2006.19(1):7-13.
    [79]SIM T, BAKER S, BSAT M. The CMU pose, illumination, and expression database[J]. IEEE Tran. Pattern Analysis and Machine Intelligence,2003,25:1615-1618.
    [80]Rui Ma, Yixu Song. Multi-manifold learning using locally linear embedding LLE nonlinear dimensionality reduction[J]. Journal of Tsinghua University,2008,48(4): 582-585.
    [81]B Fasel and J. Luettin, Automatic Facial Expression Analysis:A Survey [J], Pattern Recognition,2003,36(1):259-275.
    [82]D T Lin. Facial Expression Classification Using PCA and Hierarchical Radial Basis Function Network [J]. Journal of Information Science and Engineering,2006,22: 1033-1046.
    [83]J. Yang, D. Zhang, A. F. Frangi, and J. Y. Yang. Two-Dimensional PCA:A New Approach to Appearance-Based Face Representation and Recognition[J]. IEEE Trans. on PAMI.2004,26(1):131-137.
    [84]Jieping Ye. Generalized Low Rank Approximation of Matrices J]. Machine Learning, 2005.61:167-191.
    [85]Zhizheng Liang, and Pengfei Shi. An analytical algorithm for generalized low-rank approximations of matrices [J]. Pattern Recognition 2005.38(11):2213-2216.
    [86]A M Martinez. A C Kak. PCA versus LDA [J]. IEEE TPAMI,2001,23(2):228-233.
    [87]Tang Jinghai, Ying Zilu, Zhang Youwei. The Contrast Analysis of Facial Expression Recognition by Human and Computer [C]. ICSP, Guilin,2006,1649-1653.
    [88]Belkin M and Niyogo P. Laplacian eigenmaps for dimensionality reduction and data representation [J]. Neural Computation.2003.15(6):1373-1396.
    [89]He X. Niyogi P and Han J. Face recognition using laplacianfaces [J]. IEEE Trans. on Pattern Analysis and Machine Intelligence.2005,27(3):328-340.
    [90]He X F. Cai D. Yan S C. Neighbourhood Preserving Embedding [C]. IEEE International Conference on Computer Vision. Beijing,2005.10(1):1208-1213.
    [91]Yan Shucheng. Xu Dang. Zhang Ben-yu. Graph Embedding and Extensions:A General Framework for Dimensionality Reduction [J]. IEEE Trans on Pattern Analysis and Machine Intelligence,2007.29(1):40-51.
    [92]W Yu. X L Teng. C Q Liu. Face recognition using discriminant locality preserving projections. Image vision computing.2006.24(2):239-248.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700