摘要
人脸检测需要综合应用图像处理、模式识别、计算机科学等知识才能达到预期的效果,是一项极有挑战性的研究。
本文从实用性和易于实现的角度出发,研究了基于肤色分割和面部几何特征提取的人脸检测方法。
首先,研究了利用肤色信息从背景中分割出脸部候选区域的算法。在YCbCr彩色空间内,对光照偏离较大的彩色图像进行光线补偿;然后,分析了两种肤色分割方法:一种是根据肤色的Cb和Cr呈高斯分布的特性,利用高斯模型对肤色区域进行分割,另外一种是在非线性变换后的YCbCr彩色空间中基于椭圆肤色模型的方法进行肤色分割;对分割出来的区域进行形态学处理,从而确定人脸侯选区域。前一种肤色模型的色度是独立于亮度的,后者则考虑了亮度变化对色度的非线性影响,因此,后者能更精确地检测出肤色区域。
肤色分割得到的候选区域中,有的是人脸区域,有的是非人脸区域。因此,提出利用面部几何特征从候选区域中去除非人脸区域,确定人脸位置。利用人脸面部构造产生的灰度特性提取眼睛,利用嘴唇的色度特征分割出嘴巴,进而根据眼睛和嘴巴构成三角形模板的特性,精确定位人脸在图像中的位置。
本文采用Matlab研究该算法。实验结果表明,这种结合肤色和面部几何特征的算法,能够对人脸进行较快速和准确的定位,并且结果比较稳定可靠。
Human face detection is necessary for face recognition as its first step to locate faces in images. Face detection has been intensively researched and has developed as an independent field.
A face detection approach based on the skin color and facial geometric features is presented for its practicability and facility in this paper.
We detect skin regions based on color information is researched in the former half of the paper. The first step is preprocessing images, such as filtering the images with low-pass filter, lighting compensation with the different stretching methods in different gray levels. We studied two methods to find face candidates. One is building a Gaussian model of skin-color to segment the skin area, and the other is the method of nonlinear color transformation in YCbCr. The latter method is more effective for varying lighting conditions.
Some of segmented regions are faces, some of them are not. We use facial geometric features to decide which ones are real faces. Eye model based on gray-level information and mouth model based on chrominance are constructed respectively, then a triangle model based two eyes and a mouth is employed to verifying each candidate face.
The experiment results show that this algorithm is effective to detect faces for color images with clear faces.
引文
[1]Yang M H,Ahuja N,Kriegman D.A survey on face detection methods.1999,http://vision.aiuiuc.edu/mhyang/papers/survey.ps.gz
[2]梁路宏,艾海舟,徐光佑,张钹。人脸检测研究综述。计算机学报-2002年5期
[3]周杰,卢春雨,张长水,李衍达,人脸自动识别方法综述。电子学报,2000,28(4):102-106
[4]Chellappa R,Wilson C.L and Sirohey S.Human and machine recognition of faces:A survey.Proceedings of the IEEE,1995,83(5):705-740.
Zhou Jie,Lu Chunyu,Zhang Changshui.A survey of automatic face recognition.Chinese Journal of Electronics 2000,28(4):102-106.(in Chinese)
[5]Yang MH,Kriegman D,Ahuja N.Detecting faces in images:A survey.IEEE Trans Pattern Analysis and Machine Intelligence,2002,24(1):34-58.
[6]Hjelmas E.Face Detection:A Survey.Computer Vision and Image Understanding.83,236-274(2001).
[7]Liang LH,AI HZ,Xu Z,Zhang B.A Survey of Computer Science.Chinese Journal of Computer,2002,25(5):527-532(in Chinese with English abstract).
[8]李月敏,陈杰,高文,尹宝才。快速人脸检测技术综述。全国第16届计算机科学与技术应用(CACIS)学术会议论文集.2004年
[9]Brunelli R,Poggio T.Template matching:matched spatial filters and beyond[J].Pattern Recognition,1997,30(5):751768.
[10]Lee C H,Kim J S,Park K H.Automatic human face location in a complex background using motion and color information[J].Pattern Recognition,1996,29(11):1877-1899.
[11]Dal Y,Nakano Y.Face texture model based On SGLD and its application in face detection in a color scene[J].Pattern Recognition,1996,29(6):1007-1017.
[12]Moghaddam B,Pentland A.Probabilistic Visual Learning for Object Representation[J].IEEE Transon Pattern Analysis and Machine Intelligence,1997,19(7):696-710.
[13]Rowley H A,Baluja S,Kanade T.Rotation invariant neural network-based face detection,CMU-CS-97-201,1997.
[14]吕林,人脸检测方法综述。电脑知识与技术
[15]Saber E,Tekalp A M.Frontal—view face detection and facial feature extraction using color shape and symmetry based cost functions[J].Pattern Recognition Letters,1998,19(8): 669-680.
[16]邓刚,闫胜业,张洪明。人脸检测技术报告。
[17]G.Yang and T.S.Huang,Human Face Detection in Complex Background.Pattern Recognition,vol.27,no.1,pp.53-63,1994.
[18]Ming-Hsuan Yang;Kriegman,D.J.;Ahuja,N.Detecting faces in images:a survey.Pattern Analysis and Machine Intelligence,IEEE Transactions onVolume 24,Issue 1,Jan.2002 Page(s):34-58
[19]Rowley H A,Baluja S,Kanade T.Rotation Invariant Neural Network Based Face Detection[C].In:Proceeding of IEEE Computer Society Conference on CVPR'98.California.1998.
[20]Rowley H A,Baluja S,Kanade T.Neural network-based face detection.IEEE Trans.Pattern Analysis and Machine Intelligence,1998,20(1):23-38
[21]Rowley H A.Neural network-based face detection.Ph.D.thesis,CMU-CS-99-117,1999
[22]梁路宏,艾海舟,肖习攀,等.基于模板匹配与支持矢量机的人脸检测[J].计算机学报,2002,25(1):22-29.
[23]K.C.Yow and R.Cipolla,"Feature-Based Human Face Detection," Image and Vision Computing,vol.15,no.9,pp.713-735,1997.
[24]Y.Dai and Y.Nakano,"Face-Texture Model Based on SGLD and Its Application in Face Detection in a Color Scene," Pattern Recognition,vol.29,no.6,pp.1007-1017,1996.
[25]J.Yang and A.Waibel,A Real-Time Face Tracker,Proc.Third Workshop Applications of Computer Vision,pp.142-147,1996.
[26]S.McKenna,S.Gong,and Y.Raja,Modelling Facial Colour and Identity with Gaussian Mixtures,Pattern Recognition,vol.31,no.12,pp.1883-1892,1998.
[27]R.Kjeldsen and J.Kender,"Finding Skin in Color Images," Proc.Second Int'l Conf.Automatic Face and Gesture Recognition,pp.312-317,1996.
[28]I.Craw,D.Tock,and A.Bennett,"Finding Face Features," Proc.Second European Conf.Computer Vision,pp.92-96,1992.
[29]A.Lanitis,C.J.Taylor,and T.F.Cootes,"An Automatic Face Identification System Using Flexible Appearance Models," Image and Vision Computing,vol.13,no.5,pp.393-401,1995.
[30]M.Turk and A.Pentland,Eigenfaces for Recognition,J.Cognitive Neuroscience,vol.3,no.1,pp.71-86,1991.
[31]K.-K.Sung and T.Poggio,"Example-Based Leaming for View-Based Human Face Detection," IEEE Trans.Pattern Analysis and Machine Intelligence,vol.20,no.1,pp.39-51,Jan. 1998.
[32]H.Rowley,S.Baluja,and T.Kanade,"Neural Network-Based FaceDetection," IEEE Trans.Pattern Analysis and Machine Intelligence,vol.20,no.1,pp.23-38,Jan.1998.
[33]E.Osuna,R.Freund,and F.Girosi,"Training Support VectorMachines:An Application to Face Detection," Proc.IEEE Conf.Computer Vision and Pattern Recognition,pp.130-136,1997.
[34]H.Sehneiderman and T.Kanade,"Probabilistic Modeling of LocalAppearance and Spatial Relationships for Object Recognition," Proc.IEEE Conf.Computer Vision and Pattern Recognition,pp.45-51,1998.
[35]A.Rajagopalan,K.Kumar,J.Karlekar,R.Manivasakan,M.Patil,U.Desai,P.Poonacha,and S.Chaudhuri,"Finding Faces in Photographs," Proc.Sixth IEEE Int'l Conf.Computer Vision,pp.640-645,1998.
[36]M.S.Lew,"Information Theoretic View-Based and Modular Face Detection," Proc.Second Int'l Conf.Automatic Face and Gesture Recognition,pp.198-203,1996.
[37]A.J.Colmenarez and T.S.Huang,Face Detection with Information-Based Maximum Discrimination,Proc.IEEE Conf.Computer Vision and Pattern Recognition,pp.782-787,1997.
[38]冈萨雷斯。数字图像处理,第二版。电子工业出版社。224-232。
[39]Terrillon J C,Shirazi M N,Fukamachi H,et al.Comparative performance of different skin chrominance models and chrominance spaces for the automatic detection of human faces in color images.In:Proc.Conf.on Automatic Face and Gesture Recognition,Grenoble,France,2000,54-61.
[40]Jones M J,Rehg J M.Statistical color models with application to skin detection.In Proc.IEEE Conf.on Computer Vision and Pattern Recognition,Fort Collins,Colorado,1999,274-280
[41]刘明宝,姚鸿勋,高文.彩色图象的实时人脸跟踪方法.计算机学报,1998,21(6):527-532.
[42]Abdel-Mottaleb M,Elgammal A.Face detection in complex environments from color images.In:Proc.IEEE Conf.on Image Processing,Kobe,Japan,1999,Vol.3(11-13):622-626
[43]Karlekar J,Desai U B.Finding faces in color images using wavelet transform.In:Proc.IEEE Conf.on Image Analysis and Processing,Venice,Italy,1999,1085-1088
[44]邓加琼.复杂背景下的彩色人脸检测算法与实现[D]。成都:电子科技大学,2005.19-21.
[45]郝晓莉,陈后金,蔡伯根,李杰.基于脸部检测和Fuzzy ART的乘客检测算法.北京交通大学学报:自然科学版-2007年5期。
[46]S.L.Phung,D.Chai,A.Bouzerdounm.A novel skin color model in YCbCr color space and its application to human face detection.IEEE International Conference on Image Processing,2002
[47]孙雪梅 苏菲 蔡安妮 人脸识别中光照补偿参数及必要性的判定方法 计算机应用研 究-2007年7期
[48]R.L.Hsu,M.A.Mottaleb,and A.K.Jain,Face detection in color images.IEEE Trans.Pattern Analysis Machine Intelligence,2002,24(5);696-706.
[49]Frank S.WERBLIN Control of Retinal Sensitivity[J]The Journal of General Physiology,1974,63(1)62-87,
[50]Jones M J,Rehg J M.Statistical color models with application to skin detection[J].International Journal of Computer Vi~on,2002,46(1):81-96.
[51]Angelopoulou E.Understanding the color of human skin[A].In:Proceedings of the SPIE Conference on Human Vision and Electronic Imaging[c],San Jose,CA,USA,2001,4299:243-251.
[52]Jablonski N G,Chaplin G.The evolution of human skin coloration[J].Journal of Human Evolution,2000,39(1):57-106.
[53]徐战武 朱淼良 基于颜色的皮肤检测综述 中国图象图形学报 2007年3月第12卷第3期
[54]Yang J.,Lu W.,Waibel A..Skin color modeling and adaptation.In:Proceedings of the 3rd Asian Conference on Computer Vision,Hong Kong,China,1998,687-694
[55]StErring M.,Andersen H.,Granum E..Physics-based modeling of human skin under mixed illuminants.Journal of Robotics and Autonomous Systems,2001,35(3-4):131-142
[56]M.Soriano,E.Marszalec,and M.Pietikainen.Color correction of face images under different illuminants by RGB Eigenfaces.In Second International Conference on Audio- and Video-based Biometric Person Authentication,pages 148-153,Washington,D.C.,Mar.1999.
[57]M.Storring,H.J.Andersen,and E.Granum.Skin color detection under changing lighting conditions.In H.Araujo and J.Dias,editors 7th International Symposium on Intelligent Robotic Systems,pages 187-195,Coimbra,Portugal,July 1999.
[58]D.H.Brainard,B.A.Wandell,and E.4.Chichilnisky.Color constancy:from physics to appearance.Current Directions in Psychological Science,Vol.2,No.5,pp.165-170,1993.
[59]Hsu R.L.,Abdel2Mottaleb M.,J ain A..Face detection in color images.IEEE Transactions on Pattern Analysis and Ma2chine Intelligence,2002,24(5):696-706
[60]Pan Zhi2Geng,Zou Peng2Cheng,Liang Rong-Hua.Human face detection using eigen2face and skin color.Journal of System Simulation,2004,16(6):1346-1349(in Chinese)(潘志庚,邹鹏程,梁荣华.基于特征人脸和肤色统计的人脸检测.系统仿真学报,2004,16(6):1346-1349)
[61]Cai J.,Goshtasby A.Detecting human faces in color images.Image and Vision Computing,1999,18(1):63-75
[62]Yang J.,Lu W.,Waibel A..Skin color modeling and adaptation.In:Proceedings of the 3rd Asian Conference on Computer Vision,Hong Kong,China,1998,687-694
[63]Yang M.H.,Ahuja N..Gaussian mixture model for humanskin color and it s application in image and video databases.In:Proceedings of the SPIE Conference on Storage and Retrieval for Image and Video Databases(SPIE 99),1999,3656:458-466
[64]Zhu Q.,Cheng K.,Wu C.,Wu Y..Adaptive learning of an accurate skin2color model.In:Proceedings of t he 6t h IEEE International Conference on Automatic Face and Gesture Recognition(FGR'04),2004,37-42
[65]Jie Yang.Growing Gaussian M[ixture M q[odels for Pose Invariant Face Recognition Ralph Gross[C].In:Alex Waibel International Conference on Pattern Recognition—ICPR,2000:5088-5091[66]R-L Hsu,M Abdel-Mottaleb,A K Jain.Face detection in color images[J].IEEE Trans Pattern AnabMs and Machine Intelligence,2002;24(5):696-706
[67]G Yang,T Huang.Human face detection in a complex background[J].Pattern Recognition,1994;27(1):53-63
[68]Janfeng Ren,Lei Guo.Applying mixed Gaussian skin models to the automatic face detection.IEEE Workshop on Machine Learning for Signal Processing,pp.603,2004
T.K.Leung,M.C.Burl,and P.Perona,"Finding Faces in Cluttered Scenes Using Random Labeled Graph Matching," Proc.Fifth IEEE Int'l Conf.Computer Vision,pp.637-644,1995.
[69]T.Horprasert,Y.Yacoob,and L.S.Davis,Computing 3-D Head Orientation from a Monocular Images,Proe.Int'l Conf.Automatic Face and Gesture Recognition,pp.242-247,Oct.1996.
[70]A.Nikolaidis and I.Pitas,Facial Feature Extraction and Determination of Pose,Pattern Recognition,vol.33,pp.1783-1791,2000.
[71][lo]Yow K.C.and Cipolla R.,1997,"Feature-based human face detection" Image and Vision Computing,15(2),713-735
[72]BRUNELLI R,POGGIO T.Feature recognition:Features versus templates[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1993,15(10):1042-1052.
[73]HAFED Z.M,LEVINE M.D.Face recognition using the discrete cosine transform[J].International Journal of Computer Vision,2001,43(3):167-188.
[75]王良民,张建明,詹永照,宋顺林。人脸检测研究现状和发展。江苏大学学报(自然科学版)第24卷第3期2003年5月
[76]唐伟,陈兆乾,吴建鑫,周志华。静态图像中的人脸检测方法综述。计算机科学, 2002年02期。