人脸姿态分析与仿真
|
摘要
驾驶员的工作状念是决定行车安全的重要因素之一,由于驾驶员工作状态不良而引发的交通事故,主要原因在于驾驶员的疲劳和精神疏忽,而脸部的姿态运动是关键性因素之一。本文的研究内容是使用一个普通的摄像头对人的脸部姿态进行实时的分析,并通过OpenGL三维建模对人脸姿态分析算法进行验证,以此来判断驾驶员当前的驾驶状态是否存在不安全因素。
首先我们检测出镜头内的人脸区域,通过边缘检测及模板匹配算法检测出人眼和嘴角区域,以此为基准计算脸的偏转方向。接下来,通过OpenGL建立三维的人脸模型,把人脸姿念的运动参数实时的表现出来。最后,我们对不安全的状态予以提示。经验证,在实验室环境下,本系统能较准确的检测出人脸以及各特征点,并应用仿射变换原理对人脸的姿念进行了估计以及对人脸姿态进行实时的仿真。
The work state of drivers is one of the most important factors of safety during driving. There are two important reasons which result traffic accident. They are tiredness and carelessness of drivers, which reflected by face pose where the shoe pinches. This paper main presents the real time analysis of face pose using an ordinary camera and tests the results by 3D modeling using opengl, by means of which judging whether driver is at safety state.
First, we recognize the whole face in camera lens. Then eyes and mouth are recognized by edge detection and template match which are looked upon as benchmark counting how the face rotated. The 3-D model shows the real time parameters of face pose. At last we warn of the insecurity states. The system is efficient at experimentation situation. By experiments in our lab's platform, the system proposed in this paper can detect out each face feature points exactly, and apply the principle of affine transformation to estimate the stance of the faces and realize the real-time simulation of the faces.
首先我们检测出镜头内的人脸区域,通过边缘检测及模板匹配算法检测出人眼和嘴角区域,以此为基准计算脸的偏转方向。接下来,通过OpenGL建立三维的人脸模型,把人脸姿念的运动参数实时的表现出来。最后,我们对不安全的状态予以提示。经验证,在实验室环境下,本系统能较准确的检测出人脸以及各特征点,并应用仿射变换原理对人脸的姿念进行了估计以及对人脸姿态进行实时的仿真。
The work state of drivers is one of the most important factors of safety during driving. There are two important reasons which result traffic accident. They are tiredness and carelessness of drivers, which reflected by face pose where the shoe pinches. This paper main presents the real time analysis of face pose using an ordinary camera and tests the results by 3D modeling using opengl, by means of which judging whether driver is at safety state.
First, we recognize the whole face in camera lens. Then eyes and mouth are recognized by edge detection and template match which are looked upon as benchmark counting how the face rotated. The 3-D model shows the real time parameters of face pose. At last we warn of the insecurity states. The system is efficient at experimentation situation. By experiments in our lab's platform, the system proposed in this paper can detect out each face feature points exactly, and apply the principle of affine transformation to estimate the stance of the faces and realize the real-time simulation of the faces.
引文
[1]周维新,李磊.汽车主动安全性的人机因素分析[J].人类工效学,1999,5(4):60-61
[2]廖传锦,秦小虎,黄席樾.以人为中心的汽车主动安全技术综述[J].计算机仿真,2004,21(9):152-156
[3]石坚.人—车—路综合环境下主动安全性模拟系统的研究[D].上海交通大学博士学位论文,2000
[4]H H Rosenbrock.Flexible Manufacturing Systemin which the Operator is not subservient to the machine[M],Research project mines.Umist,Manchester,1983
[5]孙宁,邹采荣,赵力.人脸检测综述[J].电路与系统学报,2006,11(6):101-107
[6]R CheHappa,C L Wilson,S Sirohey.Lluman and Machine Recognition of Faces:A Survey[A].Proceedings of the IEEE[C],1995,83:705-741
[7]W Zhao,R Chellappa,P J Phillips,et al.Face recognition:A literature survey[J].ACM Computing Surveys,2003,35(4):399-458
[8]E Hjelmas,B K.Low Face Detection:A Survey Computer Vision and Image Understanding[A].2001,83:236-274
[9]M H Yang,D J Kriegman,N Ahuja,Detecting Faces in Images:A survey[J],IEEE Trans.Pattern Analysis and Machine Intelligence,2002,24:34-58
[10]T F Cootes,G J Edwards,C J Taylor.Active appearance models[A].5~(th)European Conference ou Computer Vision[c].1998,2:484-498
[11]T F Cootes,C J Taylor,DH Cooper,et al.Active shape model-their training and application[J].Computer Vision and Image Understanding,1995,61(1):38-59
[12]J Yang,A Waibel.A real-time face tracker[A].IEEE Proc of the 3~(rd)Workshop on Applications of Computer Vision[C].Florida,1996
[13]H P Graf,T Chen,E Petajan,et al.Locating Faces and Facial Parts [A].Proc First Intel Workshop Automatic Face and Gesture Recognition[C].1995,41-46
[14]T S Jebara,K Russell,A Pentland.Mixtures of Eigenfeaturesfor Real-Time Structure from Texture[A].Proc.Sixth IEEE Intel Conf.Computer Vision[C].1998,128-135
[15]刘明,姚鸿勋,高文.彩色图像的实时人脸跟踪力法[J].计算机学报,1998,21(6):527-532
[16]T W YOO,I S Oh.A fast algorithm for tracking human faces based on chromatic histograms[J].Pattern Recognition Letters,1999,20(10):967-978
[17]D Chai,K N Ngan.Locating Facial Region of a Head-and-Shoulders Color Image[A].Proc.Third Intel Conf.Automatic Face and Gesture Recognition[C].1998,124-129
[18]凌旭峰,杨杰,叶晨洲.彩色序列图像的人脸检测和识别系统[J].电子学报,2003,31(4):544-547
[19]J C Terrillon,M N Shirazi,I I Fukamachi,et al.Cornparative Performance of Different Skin Chrominance Models and Chrominance Spaces for the Automatic Detection of Human Faces in Color Images[A].Proc.IEEE intel Conf.on Face and.Gesture Recognition[C].2000,54-61
[20]M Turk,A Pentland.Eigenthces for Recognition[J].J.cognitive Neuroscienee,1991,3(1):71-86
[21]V Vapnik The Nature of Statistical Learning Theory[M].New York,Springer-Verlag,1995
[22]A V Nefian,M H Hayes.Face detection and recognition using hidden Markov models[A].Proc IEEE Conference on Image Processing[C].Chicago,1998,141-145
[23]A V Nefian,M H Hayes.An embedden HMM based approach for face detection and recognition[A].Proc IEEE Conference on Acoustics,Speech,and Signal Processing[C].Phoenix,1999,3553-3556
[24]陈茂林,戚飞虎.自组织隐马尔可夫模型的人脸检测研究[J].计算机学报,2002,25(11):1165-1169
[25]S Z Li,Z Q Zhang.FloatBoost learning and statistical face detection[J].IEEE Trans,Pattern Analysis and Machine Intelligence,2004,28(9):1112-1123
[26]黎松,平西建,丁益洪.开放源代码的计算机视觉类库OpenCv的应用[J].计算机应用与软件,2005,22(8):134-136
[27]林维训,潘纲,吴朝晖,潘云鹤.脸部特征定位方法[J].中国图象图形学报,2003,8(8):847-859
[28]周长发.精通Visum C++图像编程[M].第三版,北京:电子工业出版社,2006
[29]何斌,马天予,王运坚,朱红莲.Visum C++数字图像处理[M].第二版,北京:人民邮电出版社,2002
[30]张杰,杨小飞,赵瑞莲.基于Hough变换圆检测的人眼精确定位方法[J].计算机工程与应用,2005,27:43-45
[31]董文会,曲培树,吴晓娟.复杂背景下多姿态人脸图像中的人眼检测[J].山东大学 学报,2006,36(3)
[32]陶亮,庄镇泉.复杂背景下人眼自动定位[J].计算机辅助设计与图形学学报,2003,15(1)
[33]古红英,潘虹,吴飞,庄越挺,潘云鹤.虹膜自相似性识别方法研究[J].计算机辅助设计与图形学学报,2004,16(7):973-977
[34]邱丽梅,胡步发.基于仿射变换和线性回归的3D人脸姿态估计方法[J].计算机应用,2006,26(12):2877-2880
[35]张洪民,赵德斌,高文.基于肤色模型、神经网络和人脸结构模型的平面旋转人脸检测[J].计算机学报,2002,25(11):1250-1256
[36]Morimoto C H,Flickner M.Real-time multiple face detection using active illumination.In:Proceedings of the Fourth International Conference on Automatic Face and Gesture Recognition,Grenoble,France,2000,8-13
[37]Miao J,Yin B C,Wang K Q,Shen L S,Chen X C.A hierarchical multiscale and multiangle system for human face detection in a complex background using gravity-center template.Pattern Recognition.1999,32(7):1237-1248
[38]Rowley H A,Baluja S,Kanade T.Neural network-based face detection.IEEE Transaction on Pattern Analysis and Machine Intelligence,1998,20(1):23-38
[39]Sung K K,Poggio T.Example-based learning for view-based human face detection.IEEE Transaction on Pattern Analysis and Machine Intelligence,1998,20(1):39-50
[40]Osuna E,Freund R,Girosi F.Training support vector machines:an application to face detection.In:Proceedings of the Sixth IEEE Conference on Computer Vision and Pattern Recognition,Puerto Rico,1997:130-136
[41]Liu M B.Study on Human Face Detection and Tracking[Ph.D.Dissertation].Harbin Institute of Technology,Harbin,1997(in Chinese)
[42]Edward Angel.OpenGL程序设计指南[M].第二版.北京:清华大学出版社,2005
[43]彭晓明,王坚.OpenGL深入编程与实例揭秘[M].北京:人民邮电出版社,1999
[44]梁国远.基于三维模型的单目图像序列人脸姿态跟踪[D].北京:北京大学,2005
[45]YAO P,EVANS G,CALWAY A.Using Affine Correspondence to Estimate 3D Facial Pose[A].Proceedings of the IEEE International Conference on Image Proceeding[C].Thessaloniki,2001,Vol 3:919-922
[46]彭进业,俞卞章,王大凯,李楠.多尺度对称变换及其应用于定位特征脸[J].电子学报,2002,3(3):363-366
[47]庄连生,张浩,杨俊安,庄镇泉.基于ASM的人脸特征点自动标定[J].电路与系统 学报,2006,11(3):101-106
[48]孙大瑞,吴乐南.基于Gabor变换的人眼定位[J].电路与系统学报,2001,6(4):29-33
[49]颜蒋国,潘立登.基于Gabor小波的人脸特征点跟踪方法[J].计算机应用,2004,24(7):50-51
[50]王湘平,张星明.基于Gabor小波的眼睛和嘴巴检测方法[J].计算机工程,2005,31(22):169-171
[50]段鸿,程义民,王以孝,蔡尚书.基于Kanade-Lucas-Tomasi算法的人脸特征点跟踪方法[J].计算机辅助设计与图形学学报,2004,16(3):279-283
[51]侯云舒,付中华,张艳宁,赵荣椿.基于改进ASM的人脸特征点提取[J].计算机应用研究,2005,11:255-257
[52]张娜娜,马燕,苏桂莲.基于灰度投影函数的眼睛定位方法[J].计算机工程,2006,32(10):193-195
[53]梁国远,查红彬,刘宏.基于三维模型和仿射对应原理的人脸姿态估计方法[J].计算机学报,2005,28(5):792-800
[54]李华明.基于中国人面貌形态学特征的人脸姿态估计方法研究[D].西安:西北大学,2005
[55]WANG Ke,YIN Bao-cai,W ANG Yan-lai.Face Feature ai-acking and the Head Pose Estimating[J].北京工业大学学报,2005,31(2):220-224
[56]胡迎春,张增芳,邓翔.人脸图像特征点眼睛的定位与提取[J].广西工学院学报,2003,14(1):35-39
[57]王荣本,郭克友,储江伟,初秀民.适用驾驶员疲劳状态监测的人眼定位方法研究[J].公路交通科技,2003,20(5):111-114
[58]李晗,辛戚,窦爱萍.一种基于肤色和脸部特征的人脸特征点检测算法[J].航空计算技术,2006,36(1):106-110
[59]李生平,贾振堂,贺贵明,韩艳芳,董梅.综合利用人脸特征和活动轮廓技术的人脸检测及跟踪算法[J].小型微型计算机系统,2003,24(10):1837-1840
[2]廖传锦,秦小虎,黄席樾.以人为中心的汽车主动安全技术综述[J].计算机仿真,2004,21(9):152-156
[3]石坚.人—车—路综合环境下主动安全性模拟系统的研究[D].上海交通大学博士学位论文,2000
[4]H H Rosenbrock.Flexible Manufacturing Systemin which the Operator is not subservient to the machine[M],Research project mines.Umist,Manchester,1983
[5]孙宁,邹采荣,赵力.人脸检测综述[J].电路与系统学报,2006,11(6):101-107
[6]R CheHappa,C L Wilson,S Sirohey.Lluman and Machine Recognition of Faces:A Survey[A].Proceedings of the IEEE[C],1995,83:705-741
[7]W Zhao,R Chellappa,P J Phillips,et al.Face recognition:A literature survey[J].ACM Computing Surveys,2003,35(4):399-458
[8]E Hjelmas,B K.Low Face Detection:A Survey Computer Vision and Image Understanding[A].2001,83:236-274
[9]M H Yang,D J Kriegman,N Ahuja,Detecting Faces in Images:A survey[J],IEEE Trans.Pattern Analysis and Machine Intelligence,2002,24:34-58
[10]T F Cootes,G J Edwards,C J Taylor.Active appearance models[A].5~(th)European Conference ou Computer Vision[c].1998,2:484-498
[11]T F Cootes,C J Taylor,DH Cooper,et al.Active shape model-their training and application[J].Computer Vision and Image Understanding,1995,61(1):38-59
[12]J Yang,A Waibel.A real-time face tracker[A].IEEE Proc of the 3~(rd)Workshop on Applications of Computer Vision[C].Florida,1996
[13]H P Graf,T Chen,E Petajan,et al.Locating Faces and Facial Parts [A].Proc First Intel Workshop Automatic Face and Gesture Recognition[C].1995,41-46
[14]T S Jebara,K Russell,A Pentland.Mixtures of Eigenfeaturesfor Real-Time Structure from Texture[A].Proc.Sixth IEEE Intel Conf.Computer Vision[C].1998,128-135
[15]刘明,姚鸿勋,高文.彩色图像的实时人脸跟踪力法[J].计算机学报,1998,21(6):527-532
[16]T W YOO,I S Oh.A fast algorithm for tracking human faces based on chromatic histograms[J].Pattern Recognition Letters,1999,20(10):967-978
[17]D Chai,K N Ngan.Locating Facial Region of a Head-and-Shoulders Color Image[A].Proc.Third Intel Conf.Automatic Face and Gesture Recognition[C].1998,124-129
[18]凌旭峰,杨杰,叶晨洲.彩色序列图像的人脸检测和识别系统[J].电子学报,2003,31(4):544-547
[19]J C Terrillon,M N Shirazi,I I Fukamachi,et al.Cornparative Performance of Different Skin Chrominance Models and Chrominance Spaces for the Automatic Detection of Human Faces in Color Images[A].Proc.IEEE intel Conf.on Face and.Gesture Recognition[C].2000,54-61
[20]M Turk,A Pentland.Eigenthces for Recognition[J].J.cognitive Neuroscienee,1991,3(1):71-86
[21]V Vapnik The Nature of Statistical Learning Theory[M].New York,Springer-Verlag,1995
[22]A V Nefian,M H Hayes.Face detection and recognition using hidden Markov models[A].Proc IEEE Conference on Image Processing[C].Chicago,1998,141-145
[23]A V Nefian,M H Hayes.An embedden HMM based approach for face detection and recognition[A].Proc IEEE Conference on Acoustics,Speech,and Signal Processing[C].Phoenix,1999,3553-3556
[24]陈茂林,戚飞虎.自组织隐马尔可夫模型的人脸检测研究[J].计算机学报,2002,25(11):1165-1169
[25]S Z Li,Z Q Zhang.FloatBoost learning and statistical face detection[J].IEEE Trans,Pattern Analysis and Machine Intelligence,2004,28(9):1112-1123
[26]黎松,平西建,丁益洪.开放源代码的计算机视觉类库OpenCv的应用[J].计算机应用与软件,2005,22(8):134-136
[27]林维训,潘纲,吴朝晖,潘云鹤.脸部特征定位方法[J].中国图象图形学报,2003,8(8):847-859
[28]周长发.精通Visum C++图像编程[M].第三版,北京:电子工业出版社,2006
[29]何斌,马天予,王运坚,朱红莲.Visum C++数字图像处理[M].第二版,北京:人民邮电出版社,2002
[30]张杰,杨小飞,赵瑞莲.基于Hough变换圆检测的人眼精确定位方法[J].计算机工程与应用,2005,27:43-45
[31]董文会,曲培树,吴晓娟.复杂背景下多姿态人脸图像中的人眼检测[J].山东大学 学报,2006,36(3)
[32]陶亮,庄镇泉.复杂背景下人眼自动定位[J].计算机辅助设计与图形学学报,2003,15(1)
[33]古红英,潘虹,吴飞,庄越挺,潘云鹤.虹膜自相似性识别方法研究[J].计算机辅助设计与图形学学报,2004,16(7):973-977
[34]邱丽梅,胡步发.基于仿射变换和线性回归的3D人脸姿态估计方法[J].计算机应用,2006,26(12):2877-2880
[35]张洪民,赵德斌,高文.基于肤色模型、神经网络和人脸结构模型的平面旋转人脸检测[J].计算机学报,2002,25(11):1250-1256
[36]Morimoto C H,Flickner M.Real-time multiple face detection using active illumination.In:Proceedings of the Fourth International Conference on Automatic Face and Gesture Recognition,Grenoble,France,2000,8-13
[37]Miao J,Yin B C,Wang K Q,Shen L S,Chen X C.A hierarchical multiscale and multiangle system for human face detection in a complex background using gravity-center template.Pattern Recognition.1999,32(7):1237-1248
[38]Rowley H A,Baluja S,Kanade T.Neural network-based face detection.IEEE Transaction on Pattern Analysis and Machine Intelligence,1998,20(1):23-38
[39]Sung K K,Poggio T.Example-based learning for view-based human face detection.IEEE Transaction on Pattern Analysis and Machine Intelligence,1998,20(1):39-50
[40]Osuna E,Freund R,Girosi F.Training support vector machines:an application to face detection.In:Proceedings of the Sixth IEEE Conference on Computer Vision and Pattern Recognition,Puerto Rico,1997:130-136
[41]Liu M B.Study on Human Face Detection and Tracking[Ph.D.Dissertation].Harbin Institute of Technology,Harbin,1997(in Chinese)
[42]Edward Angel.OpenGL程序设计指南[M].第二版.北京:清华大学出版社,2005
[43]彭晓明,王坚.OpenGL深入编程与实例揭秘[M].北京:人民邮电出版社,1999
[44]梁国远.基于三维模型的单目图像序列人脸姿态跟踪[D].北京:北京大学,2005
[45]YAO P,EVANS G,CALWAY A.Using Affine Correspondence to Estimate 3D Facial Pose[A].Proceedings of the IEEE International Conference on Image Proceeding[C].Thessaloniki,2001,Vol 3:919-922
[46]彭进业,俞卞章,王大凯,李楠.多尺度对称变换及其应用于定位特征脸[J].电子学报,2002,3(3):363-366
[47]庄连生,张浩,杨俊安,庄镇泉.基于ASM的人脸特征点自动标定[J].电路与系统 学报,2006,11(3):101-106
[48]孙大瑞,吴乐南.基于Gabor变换的人眼定位[J].电路与系统学报,2001,6(4):29-33
[49]颜蒋国,潘立登.基于Gabor小波的人脸特征点跟踪方法[J].计算机应用,2004,24(7):50-51
[50]王湘平,张星明.基于Gabor小波的眼睛和嘴巴检测方法[J].计算机工程,2005,31(22):169-171
[50]段鸿,程义民,王以孝,蔡尚书.基于Kanade-Lucas-Tomasi算法的人脸特征点跟踪方法[J].计算机辅助设计与图形学学报,2004,16(3):279-283
[51]侯云舒,付中华,张艳宁,赵荣椿.基于改进ASM的人脸特征点提取[J].计算机应用研究,2005,11:255-257
[52]张娜娜,马燕,苏桂莲.基于灰度投影函数的眼睛定位方法[J].计算机工程,2006,32(10):193-195
[53]梁国远,查红彬,刘宏.基于三维模型和仿射对应原理的人脸姿态估计方法[J].计算机学报,2005,28(5):792-800
[54]李华明.基于中国人面貌形态学特征的人脸姿态估计方法研究[D].西安:西北大学,2005
[55]WANG Ke,YIN Bao-cai,W ANG Yan-lai.Face Feature ai-acking and the Head Pose Estimating[J].北京工业大学学报,2005,31(2):220-224
[56]胡迎春,张增芳,邓翔.人脸图像特征点眼睛的定位与提取[J].广西工学院学报,2003,14(1):35-39
[57]王荣本,郭克友,储江伟,初秀民.适用驾驶员疲劳状态监测的人眼定位方法研究[J].公路交通科技,2003,20(5):111-114
[58]李晗,辛戚,窦爱萍.一种基于肤色和脸部特征的人脸特征点检测算法[J].航空计算技术,2006,36(1):106-110
[59]李生平,贾振堂,贺贵明,韩艳芳,董梅.综合利用人脸特征和活动轮廓技术的人脸检测及跟踪算法[J].小型微型计算机系统,2003,24(10):1837-1840