一种改进的三维局部约束模型初始化方法
|
摘要
三维局部约束模型(3D Constrained Local Model,CLM-Z)算法,综合利用灰度和深度信息检测三维人脸数据中的特征点(如眼角、鼻尖和嘴角),实现了较高的检测精度。CLM-Z方法一般使用人脸位置和平均三维人脸模型进行初始化。设计了四个实验定量地分析CLM-Z参数初始化对算法精度的影响:在BU-4DFE库上评估CLM-Z算法精度;通过平移人脸边界框扰动平移参数的初始值;通过缩放人脸边界框扰动尺度参数的初始值;通过给定绕y轴和z轴的旋转角扰动旋转参数的初始值。实验结果表明,CLM-Z算法可容忍平移扰动约为人脸宽的1/6,在(0.75,1.50)缩放范围内算法精度不会下降,可容忍y轴和z轴旋转角约20°。基于以上评估结果,进一步提出在纹理图像上检测特征点作为初始化,然后再进行CLM-Z迭代。在BU-4DFE数据库上的评估结果证明,该初始化方法能有效提升CLM-Z方法的特征点定位精度。
3D Constrained Local Model( CLM-Z) achieves high accuracy in detecting 3D facial landmarks( e.g.,eye corners,nose tip and mouth corners) via taking full advantage of both intensity and depth information.CLM-Z is conventionally initialized based on the location of face and mean 3D facial model.The effect of CLM-Z initialization on detection accuracy is evaluated quantitively by carrying out the follow ing experiments: assessing the accuracy of CLM-Z with the conventional initialization method on the BU-4DFE database,translating the face to perturb the initial value of translation parameter,varying the size of detected face to perturb the initial value of scale parameter,varying the rotation angles around y-axis and z-axis to perturb the initial value of rotation parameter. Experimental results show that CLM-Z can tolerate translations up to approximately 1/6 of the width of the face,scalings betw een 0.75 and 1.50,and rotations within 20 degrees.Based on the above evaluation results,a novel initialization method is proposed further that exploits facial landmarks detected firstly on 2D texture images.Experiments on the BU-4DFE database show that the proposed initialization method can successfully improve the 3D landmark localization accuracy of CLM-Z approach.
3D Constrained Local Model( CLM-Z) achieves high accuracy in detecting 3D facial landmarks( e.g.,eye corners,nose tip and mouth corners) via taking full advantage of both intensity and depth information.CLM-Z is conventionally initialized based on the location of face and mean 3D facial model.The effect of CLM-Z initialization on detection accuracy is evaluated quantitively by carrying out the follow ing experiments: assessing the accuracy of CLM-Z with the conventional initialization method on the BU-4DFE database,translating the face to perturb the initial value of translation parameter,varying the size of detected face to perturb the initial value of scale parameter,varying the rotation angles around y-axis and z-axis to perturb the initial value of rotation parameter. Experimental results show that CLM-Z can tolerate translations up to approximately 1/6 of the width of the face,scalings betw een 0.75 and 1.50,and rotations within 20 degrees.Based on the above evaluation results,a novel initialization method is proposed further that exploits facial landmarks detected firstly on 2D texture images.Experiments on the BU-4DFE database show that the proposed initialization method can successfully improve the 3D landmark localization accuracy of CLM-Z approach.
引文
[1]谢文浩,翟素兰.基于加权稀疏近邻表示的人脸识别[J].计算机技术与发展,2016,26(2):22-25.
[2]祝磊,朱善安.基于二维广义主成分分析的人脸识别[J].浙江大学学报:工学版,2007,41(2):264-267.
[3]孔万增,朱善安.基于正交补空间的人脸识别[J].浙江大学学报:工学版,2008,42(4):571-573.
[4]赵武锋,严晓浪.基于多尺度梯度角和SVM的正面人脸识别方法[J].浙江大学学报:工学版,2008,42(4):590-592.
[5]李文书,何芳芳,钱沄涛,等.基于Adaboost-高斯过程分类的人脸表情识别[J].浙江大学学报:工学版,2012,46(1):79-83.
[6]高文,金辉.面部表情图像的分析与识别[J].计算机学报,1997,20(9):782-789.
[7]姜大龙,高文,王兆其,等.面向纹理特征的真实感三维人脸动画方法[J].计算机学报,2004,27(6):750-757.
[8]Cristinacce D,Cootes T F.Feature detection and tracking with constrained local models[C]//British machine vision conference.[s.l.]:[s.n.],2006:929-938.
[9]Gu L,Kanade T.A generative shape regularization model for robust face alignment[C]//European conference on computer vision.Berlin:Springer,2008:413-426.
[10]Baltruaitis T,Robinson P,Morency L P.3D constrained local model for rigid and non-rigid facial tracking[C]//IEEE conference on computer vision and pattern recognition.[s.l.]:IEEE,2012:2610-2617.
[11]Zhu X,Ramanan D.Face detection,pose estimation,and landmark localization in the wild[C]//IEEE conference on computer vision and pattern recognition.[s.l.]:IEEE,2012:2879-2886.
[12]Yin L,Chen X,Sun Y,et al.A high-resolution 3D dynamic facial expression database[C]//8th IEEE international conference on automatic face&gesture recognition.Amsterdam:IEEE,2008:1-6.
[13]Burgos-Artizzu X P,Perona P,Dollár P.Robust face landmark estimation under occlusion[C]//Proceedings of the IEEE international conference on computer vision.Sydney:IEEE,2013:1513-1520.
[14]Zhou E,Fan H,Cao Z,et al.Extensive facial landmark localization with coarse-to-fine convolutional network cascade[C]//Proceedings of the IEEE international conference on computer vision workshops.Sydney:IEEE,2013:386-391.
[2]祝磊,朱善安.基于二维广义主成分分析的人脸识别[J].浙江大学学报:工学版,2007,41(2):264-267.
[3]孔万增,朱善安.基于正交补空间的人脸识别[J].浙江大学学报:工学版,2008,42(4):571-573.
[4]赵武锋,严晓浪.基于多尺度梯度角和SVM的正面人脸识别方法[J].浙江大学学报:工学版,2008,42(4):590-592.
[5]李文书,何芳芳,钱沄涛,等.基于Adaboost-高斯过程分类的人脸表情识别[J].浙江大学学报:工学版,2012,46(1):79-83.
[6]高文,金辉.面部表情图像的分析与识别[J].计算机学报,1997,20(9):782-789.
[7]姜大龙,高文,王兆其,等.面向纹理特征的真实感三维人脸动画方法[J].计算机学报,2004,27(6):750-757.
[8]Cristinacce D,Cootes T F.Feature detection and tracking with constrained local models[C]//British machine vision conference.[s.l.]:[s.n.],2006:929-938.
[9]Gu L,Kanade T.A generative shape regularization model for robust face alignment[C]//European conference on computer vision.Berlin:Springer,2008:413-426.
[10]Baltruaitis T,Robinson P,Morency L P.3D constrained local model for rigid and non-rigid facial tracking[C]//IEEE conference on computer vision and pattern recognition.[s.l.]:IEEE,2012:2610-2617.
[11]Zhu X,Ramanan D.Face detection,pose estimation,and landmark localization in the wild[C]//IEEE conference on computer vision and pattern recognition.[s.l.]:IEEE,2012:2879-2886.
[12]Yin L,Chen X,Sun Y,et al.A high-resolution 3D dynamic facial expression database[C]//8th IEEE international conference on automatic face&gesture recognition.Amsterdam:IEEE,2008:1-6.
[13]Burgos-Artizzu X P,Perona P,Dollár P.Robust face landmark estimation under occlusion[C]//Proceedings of the IEEE international conference on computer vision.Sydney:IEEE,2013:1513-1520.
[14]Zhou E,Fan H,Cao Z,et al.Extensive facial landmark localization with coarse-to-fine convolutional network cascade[C]//Proceedings of the IEEE international conference on computer vision workshops.Sydney:IEEE,2013:386-391.