基于特征点表情变化的3维人脸识别
|
摘要
目的为克服表情变化对3维人脸识别的影响,提出一种基于特征点提取局部区域特征的3维人脸识别方法。方法首先,在深度图上应用2维图像的ASM(active shape model)算法粗略定位出人脸特征点,再根据Shape index特征在人脸点云上精确定位出特征点。其次,提取以鼻中为中心的一系列等测地轮廓线来表征人脸形状;然后,提取具有姿态不变性的Procrustean向量特征(距离和角度)作为识别特征;最后,对各条等测地轮廓线特征的分类结果进行了比较,并对分类结果进行决策级融合。结果在FRGC V2.0人脸数据库分别进行特征点定位实验和识别实验,平均定位误差小于2.36 mm,Rank-1识别率为98.35%。结论基于特征点的3维人脸识别方法,通过特征点在人脸近似刚性区域提取特征,有效避免了受表情影响较大的嘴部区域。实验证明该方法具有较高的识别精度,同时对姿态、表情变化具有一定的鲁棒性。
Objective Compared with other biometric recognition methods,face recognition is friendlier,more natural,and less interferential to users.Hence,face recognition has numerous applications in various fields.However,the 3D shape of the human face is a nonrigid free-form surface,which causes face region distortion under expression variations,particularly in the mouth region.Therefore,3D face recognition is easily affected by facial expression variations.Laughing and acting surprised make the face produce a hole in the mouth region and consequently change the topology of the facial model.This study proposes a 3D face recognition method based on facial fiducial points to avoid the effect of different facial expressions.Method The active shape model algorithm,which is usually used for 2D images,is applied to roughly detect facial fiducial points in depth images.The shape index is used to accurately locate fiducial points in 3D point clouds.A series of iso-geodesic contours from the landmark(located in the middle of nose tip and nose root) is then extracted to represent the facial shape and avoid the mouth region.Procrustean features(distances and angles) defined by pose-invariant curves are selected as the final recognition features.The classification results of each geodesic contour are compared and combined at the decision level as the final results.Result FRGC V2.0 is a large public face dataset.Experiments on the detection and recognition of facial fiducial points are conducted using the FRGC V2.0 dataset.In the detection experiment,face models in fall 2003 are selected as the training set,and 150 scans acquired in spring 2004 are selected as the testing set.Seven fiducial points,including eye corners,nose tip,and mouth corners,are manually located in the testing set.The accuracy of the seven detected fiducial points is measured through the Euclidean distance between the manually detected fiducial points and the corresponding automatic points.Each of the seven points is accurately detected,and the mean value of the positional error is less than 2.36 mm.In the recognition experiment,424 scans from 60 subjects in the FRGC V2.0 database are randomly selected.Each iso-geodesic contour with procrustean features(distances and angles) is tested,and the classification results of the eight iso-geodesic contours are weighted in a decision-level fusion.The final Rank-1 recognition rate is 98.35%.Conclusion Expression variation is an important research direction for 3D face recognition.This study proposes a novel method for locating fiducial points in 3D point clouds.Combined with the depth images and 3D point clouds,seven fiducial points are completely,automatically,rapidly,and accurately detected.A series of facial contours based on these points is extracted to represent the facial surface.The effect of expression variations on recognition is decreased because the iso-geodesic contours are located in approximate rigid regions.Overall,the proposed method is valid and robust in the presence of pose and expression variations.
Objective Compared with other biometric recognition methods,face recognition is friendlier,more natural,and less interferential to users.Hence,face recognition has numerous applications in various fields.However,the 3D shape of the human face is a nonrigid free-form surface,which causes face region distortion under expression variations,particularly in the mouth region.Therefore,3D face recognition is easily affected by facial expression variations.Laughing and acting surprised make the face produce a hole in the mouth region and consequently change the topology of the facial model.This study proposes a 3D face recognition method based on facial fiducial points to avoid the effect of different facial expressions.Method The active shape model algorithm,which is usually used for 2D images,is applied to roughly detect facial fiducial points in depth images.The shape index is used to accurately locate fiducial points in 3D point clouds.A series of iso-geodesic contours from the landmark(located in the middle of nose tip and nose root) is then extracted to represent the facial shape and avoid the mouth region.Procrustean features(distances and angles) defined by pose-invariant curves are selected as the final recognition features.The classification results of each geodesic contour are compared and combined at the decision level as the final results.Result FRGC V2.0 is a large public face dataset.Experiments on the detection and recognition of facial fiducial points are conducted using the FRGC V2.0 dataset.In the detection experiment,face models in fall 2003 are selected as the training set,and 150 scans acquired in spring 2004 are selected as the testing set.Seven fiducial points,including eye corners,nose tip,and mouth corners,are manually located in the testing set.The accuracy of the seven detected fiducial points is measured through the Euclidean distance between the manually detected fiducial points and the corresponding automatic points.Each of the seven points is accurately detected,and the mean value of the positional error is less than 2.36 mm.In the recognition experiment,424 scans from 60 subjects in the FRGC V2.0 database are randomly selected.Each iso-geodesic contour with procrustean features(distances and angles) is tested,and the classification results of the eight iso-geodesic contours are weighted in a decision-level fusion.The final Rank-1 recognition rate is 98.35%.Conclusion Expression variation is an important research direction for 3D face recognition.This study proposes a novel method for locating fiducial points in 3D point clouds.Combined with the depth images and 3D point clouds,seven fiducial points are completely,automatically,rapidly,and accurately detected.A series of facial contours based on these points is extracted to represent the facial surface.The effect of expression variations on recognition is decreased because the iso-geodesic contours are located in approximate rigid regions.Overall,the proposed method is valid and robust in the presence of pose and expression variations.
引文
[1]Zhong C,Sun Z N,Tan T N,et al.Robust 3D face recognition in uncontrolled environments[C]//Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Washington DC:IEEE Computer Society,2008:1-8.[DOI:10.1109/CVPR.2-008.4587646]
[2]Bowyer K W,Chang K,Flynn P.A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition[J].Computer Vision and Image Understanding,2006,101(1):1-15.[DOI:10.1016/j.cviu.2005.0.05]
[3]Vretos N,Nikolaidis N,Pitas I.3D facial expression recognition using Zernike moments on depth images[C]//Proceedings of the18 th IEEE International Conference on Image Processing.Washington DC:IEEE Computer Society,2011:773-776.[DOI-10.1109/ICIP.2011.6116669]
[4]Mohammadzade H,Hatzinakos D.Iterative closest normal point for 3D face recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(2):381-397.[DOI:10.1109/TPAM1.2012.107]
[5]Beumier C,Acheroy M.Automatic 3d face authentication[J].Image and Vision Computing,2000,18(4):315-321.
[6]Berretti S,Werghi N,Pala P,et al.Matching 3D face scans using interest points and local histogram descriptors[J].Computers&Graphics,2013,37(5):509-525.[DOI:10.1016/j.cag.2013.04.001]
[7]Cupta S,Markey M K,Bovik A C.Anthropometric 3D face recognition[J].International Journal of Computer Vision,2010,90(5):331-349.[DOI:10.1007/s11263-010-0360-8]
[8]Perakis P,Passalis G,Theoharis T,et al.3D facial landmark detection under large yaw and expression variations[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(7):1552-1564.[DOI:10.1109/TPAMI.2012.247]
[9]Cootes T F,Taylor C J,Cooper D H,et al.Active shape models their training and application[J].Computer Vision and Image Understanding,1995,61(1):38-59.[DOI:10.1006/cviu.1995.1004]
[10]Cai L,Da F P.Three dimensions face recognition by using shape filtering and geometry image[J].Journal of Image and Graphics,2011,16(7):1303-1309.[蔡亮,达飞鹏.结合形状滤波和几何图像的3D人脸识别算法[J].中国图象图形学报,2011,16(7):1303-1309][DOI:10.11834/jig.20110724]
[11]Dorai C,Jain A K.COSMOS-A representation scheme for 3D free-form objects[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1997,19(10):1115-1130.
[12]Bronstein A M,Bronstein M M,Kimmel R.Three dimensional face recognition[J].International Journal of Computer Vision,2005,64(1):5-30.
[13]Jahanbin S,Jahanbin R,Bovik A C.Passive three dimensional face recognition using iso-geodesic contours and procrustes analysis[J].International Journal of Computer Vision,2013,105(1):87-109.[DOI:10.1007/s11263-013-0631-2]
[14]Sethian J A,Kimmel R.Computing geodesic paths on manifolds[J].Proceedings of the National Academy of Sciences,1998,95(15):8431-8435.[DOI:10.1073/pn-as.95.15.8431]
[15]Zou H Y,Da F P,Li X L.3D face recognition using compositional features from facial curves[J].Journal of Southeast university,2012,42(4):618-622.[邹红艳,达飞鹏,李晓莉.基于面部曲线特征融合的三维人脸识别[J].东南大学学报,2012,42(4):618-622.][DOI:10.3969/j.issn.1001-0505.2012.04.008]
[16]Gower J C.Generalized procrustes analysis[J].Psychomertrika,1975,40(1):33-51.
[17]Phillips P J,Flynn P J,Scruggs T,et al.Overview of the face recognition grand challenge[C]//Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Washington DC:IEEE Computer Society,2006:947-954.[DOI:10.1109/CVPR.2005.268]
[18]Szeptycki P,Ardabilian M,Chen L.A eoarse-to-fine analysisbased rotation invariant 3D face landmarking[C]//Proceedings of IEEE 3rd International Conference on Biometrics:Theory,Applications and Systems.Washington DC:IEEE Computer Society,2009:32-37.[DOI:10.1109/BTAS.2009.5339052]
[19]Berretti S,Bimbo D,Pala P.3D face recognition using iso-geodesic stripes[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2010,32(12):2162-2177.[DOI:10.1109/TPAMI.2010.43]
[20]Gupta S,Markey M K,Bovik A C,et al.Three dimensional face recognition based on geodesic and Euclidean distances[C]//Proceedings of the International Society for Optical Engineering.California:International Society for Optics and Photonics,2008,64990:1-11.[DOI:10.1117/12.704535]
[21]Li X L,Da F P.A rapid method for 3D face recognition based on rejection algorithm[J].Acta Automatica Sinica,2010,36(1):153-158.[DOI:10.3724/SP.J.1004.2010.00153][李晓莉,达飞鹏.基于排除算法的快速三维人脸识别方法[J].自动化学报,2010.36(1):153-158.]
[2]Bowyer K W,Chang K,Flynn P.A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition[J].Computer Vision and Image Understanding,2006,101(1):1-15.[DOI:10.1016/j.cviu.2005.0.05]
[3]Vretos N,Nikolaidis N,Pitas I.3D facial expression recognition using Zernike moments on depth images[C]//Proceedings of the18 th IEEE International Conference on Image Processing.Washington DC:IEEE Computer Society,2011:773-776.[DOI-10.1109/ICIP.2011.6116669]
[4]Mohammadzade H,Hatzinakos D.Iterative closest normal point for 3D face recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(2):381-397.[DOI:10.1109/TPAM1.2012.107]
[5]Beumier C,Acheroy M.Automatic 3d face authentication[J].Image and Vision Computing,2000,18(4):315-321.
[6]Berretti S,Werghi N,Pala P,et al.Matching 3D face scans using interest points and local histogram descriptors[J].Computers&Graphics,2013,37(5):509-525.[DOI:10.1016/j.cag.2013.04.001]
[7]Cupta S,Markey M K,Bovik A C.Anthropometric 3D face recognition[J].International Journal of Computer Vision,2010,90(5):331-349.[DOI:10.1007/s11263-010-0360-8]
[8]Perakis P,Passalis G,Theoharis T,et al.3D facial landmark detection under large yaw and expression variations[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(7):1552-1564.[DOI:10.1109/TPAMI.2012.247]
[9]Cootes T F,Taylor C J,Cooper D H,et al.Active shape models their training and application[J].Computer Vision and Image Understanding,1995,61(1):38-59.[DOI:10.1006/cviu.1995.1004]
[10]Cai L,Da F P.Three dimensions face recognition by using shape filtering and geometry image[J].Journal of Image and Graphics,2011,16(7):1303-1309.[蔡亮,达飞鹏.结合形状滤波和几何图像的3D人脸识别算法[J].中国图象图形学报,2011,16(7):1303-1309][DOI:10.11834/jig.20110724]
[11]Dorai C,Jain A K.COSMOS-A representation scheme for 3D free-form objects[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1997,19(10):1115-1130.
[12]Bronstein A M,Bronstein M M,Kimmel R.Three dimensional face recognition[J].International Journal of Computer Vision,2005,64(1):5-30.
[13]Jahanbin S,Jahanbin R,Bovik A C.Passive three dimensional face recognition using iso-geodesic contours and procrustes analysis[J].International Journal of Computer Vision,2013,105(1):87-109.[DOI:10.1007/s11263-013-0631-2]
[14]Sethian J A,Kimmel R.Computing geodesic paths on manifolds[J].Proceedings of the National Academy of Sciences,1998,95(15):8431-8435.[DOI:10.1073/pn-as.95.15.8431]
[15]Zou H Y,Da F P,Li X L.3D face recognition using compositional features from facial curves[J].Journal of Southeast university,2012,42(4):618-622.[邹红艳,达飞鹏,李晓莉.基于面部曲线特征融合的三维人脸识别[J].东南大学学报,2012,42(4):618-622.][DOI:10.3969/j.issn.1001-0505.2012.04.008]
[16]Gower J C.Generalized procrustes analysis[J].Psychomertrika,1975,40(1):33-51.
[17]Phillips P J,Flynn P J,Scruggs T,et al.Overview of the face recognition grand challenge[C]//Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Washington DC:IEEE Computer Society,2006:947-954.[DOI:10.1109/CVPR.2005.268]
[18]Szeptycki P,Ardabilian M,Chen L.A eoarse-to-fine analysisbased rotation invariant 3D face landmarking[C]//Proceedings of IEEE 3rd International Conference on Biometrics:Theory,Applications and Systems.Washington DC:IEEE Computer Society,2009:32-37.[DOI:10.1109/BTAS.2009.5339052]
[19]Berretti S,Bimbo D,Pala P.3D face recognition using iso-geodesic stripes[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2010,32(12):2162-2177.[DOI:10.1109/TPAMI.2010.43]
[20]Gupta S,Markey M K,Bovik A C,et al.Three dimensional face recognition based on geodesic and Euclidean distances[C]//Proceedings of the International Society for Optical Engineering.California:International Society for Optics and Photonics,2008,64990:1-11.[DOI:10.1117/12.704535]
[21]Li X L,Da F P.A rapid method for 3D face recognition based on rejection algorithm[J].Acta Automatica Sinica,2010,36(1):153-158.[DOI:10.3724/SP.J.1004.2010.00153][李晓莉,达飞鹏.基于排除算法的快速三维人脸识别方法[J].自动化学报,2010.36(1):153-158.]