基于视觉的驾驶疲劳实时检测系统研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
由于疲劳驾驶导致的交通事故数量不断上升,疲劳驾驶已成为一个严重的社会问题。因此,研制疲劳驾驶监测预警系统,对于避免交通事故,提高交通系统的安全性有着重要意义。
     本文针对基于计算机视觉的疲劳检测方法进行研究,构建了一个实时的驾驶疲劳检测系统。该系统可以通过CCD摄像头实时地采集驾驶员上半身的视频图像到计算机,然后通过计算机视觉算法捕获驾驶员的眼睛闭合度和嘴唇特征来估计驾驶员的疲劳程度,检测出疲劳。本文研究的核心内容包括:人脸定位、眼睛定位、眼睛跟踪、眼睛信息提取、嘴唇特征提取和疲劳度计算等算法的实现与改进。
     在人脸检测方面,提出了肤色检测与面部特征空间位置验证相结合的方法。首先针对人脸肤色在色彩空间中的分布及其特性展开研究,建立了有效的肤色模型,对图像进行肤色分割;接着,对分割结果依据人脸的矩特征去掉部分非法的肤色区域;最后,在所得区域内检测出面部特征,按照特征之间的空间位置关系对候选脸区的真假进行验证。经实验表明,该方法在保证较高的检测率的基础上,大大降低了误检率。
     在眼睛定位方面,采用了基于Haar-Like特征级联分类器的检测方法,在人脸区域内按照不同尺度搜索存在的眼睛。在眼睛跟踪中,提出了一种基于卡尔曼滤波与Mean Shift算法相结合的眼睛跟踪方法,此法能够进行尺度更新和准确地跟踪闭眼。
     在眼睛信息提取方面,在分析了相关的研究方法基础上,本文提出一种计算眼睛闭合程度的新方法—虹膜外接矩形法,其原理是通过一个外接矩形绑定虹膜区域,然后用该矩形的宽高比值来估计眼睛闭合度。与以往的算法相比该方法可以更精确地表示眼睛的状态。
     在疲劳度计算方面,提出综合眼睛信息和嘴唇特征计算疲劳程度的方法,并在PC机上对算法进行了仿真实验,取得了良好的实验结果。
The increasing number of traffic accidents due to a driver's fatigue has become a scrious problem for the society.With the background, developing a system for monitoring the driver's level of vigilance and alerting the driver when he fatigues is essential.
     This paper chooses computer vision based method as the study target to build a real-time detection system of driver fatigue.The system has a CCD camera which collecting videos of driver's upper-body to a computer,and uses some algorithm of computer vision to compute the percentage of eyelid closure and lip features,and then,estimates the level of driver fatigue.The core content of this paper is that realizing and improving algorithm such as face location,eye location,eye information extraction ,lips information extraction and fatigue level calculation.
     In order to detect frontal face,a method which combined skin color detection and validated spatial facial features scope is presented.The distribution and characteristic of skin color is firstly studied in color space to establish effective skin color model and to use it in image segmentation.Then,some unseemliness regions in segmentation are eliminated according to moment features.At last,we locate the facial features based on the acquired skin color,and to validate whether this face region contains face or not according to the relative location among features.The experiment results show that this method decrease false detection rates enormously.
     In order to locate eyes on the face, a Cascade Classifier based on Haar-Like features is used to search all existing eyes in the face region in different scale. Fourthly, Kalman filtering and mean shift algorithm based eye tracking method which can track close eyes and change size of eyes is proposed.
     In order to get eye information extraction,some relative researches have been analyzed,before a novel method,named as iris's external rectangle based method,is proposed to calculate the percentage of eyelid closure.The principle of the iris's external rectangle based algorithm is that: bind the iris region by using an external rectangle,use the ratio of the width and height of the rectangle to estimate the percentage of eyelid closure.This method can represents eye states more precisely than others relative method.
     In order to compute percentage of eyelid closure, eye information and lip features is used to evaluate the fatigue level of driver.The results of tests based on PC show good ability of this research.
引文
[1]张灵聪,王正国,朱佩芳.汽车驾驶疲劳研究综述[J].人类工效学.2003,9(1):38-41.
    [2]纵滔,高进东.陕西省高速公路致死性交通事故的特点[J].中国交通医学杂志.2004,18(4):368-370.
    [3]张志斌,陈阳丹,杨玉珍.基于Blackfin533的驾驶疲劳实时检测预警系统[J].计算机测量与控制.2008,16(11):1567-1570.
    [4]Shinjiro Kawato and Jun Ohya.Real-time Detection of Nodding and Head-shaking by Directly Detecting and Tracking the "Between-Eyes"[J].ATR Media Integration and Communications Research Laboratories.2000,5(12):23-26.
    [5]http://www.nhlbi.nih.gov/health/prof/sleep/drsy_dry.htm.2008.
    [6]www.aaafoundation.org/resources/ndex.efm?button=rsreheat.2008.
    [7]Matthias K.Advanced Driver Assistance Systems Research within INVENT[J].Global Automative Manufacturing&Technology,2002,6(12):321-324.
    [8]K Yi,M Woo,S H Kim,et al.An Experimental Investigation of a CW/CA System for Automobiles Using Hardware-in-the-loop Simulation.San Diego[C].Proceeding of the American control conference,1999:724-728.
    [9]A Takahashi,N Asanuma.Introduction of HONDA ASV-2[M].USA:Proceeding of the IEEE Intelligent Vehicles Symposium,2000:694-701.
    [10]H Masuda,Y Hirosima.Development of Daihatsu ASV2[M].USA:Proceedings of the IEEE Intelligent Vehicles Symposium,2000:708-713.
    [11]R.Bishop,R.Bishop Consulting.A Survey of Intelligent Vehicle Applications Worldwide[J].Proceedings of the IEEE Intelligent Vehicles Symposium 2000,2000.10:25-30.
    [12]U Franke,D Gavrila,et al.Autonomous Driving Goes Downtown[J].IEEE Intelligent Systems.1998,13(6):40-48.
    [13]U Hofmann,A Rieder,E D Dickmanns.Application to Hybrid Adaptive Cruise Control[A].Intelligent Vehicles Symposium Proceedings of the IEEE,2000,468-473.
    [14]P.ellutta,R.Matthies,K..Rankin.Califomia Institute of Technology[A].Terrain Perception for DEMO Ⅲ[C].Proceedings of the IEEE Intelligent Vehicles Symposium 2000,2000.10:326-331.
    [15]National Highway Traffic Safety Administration,Traffic Safety Facts 1996-Motor Vehicle Crash Data from FARS and GES "Related Factors for Drivers Involved In Fatal Crashes".http://www.fars.nhtsa.dot.gov.2009.
    [16]刘晓君.丰田先进安全车[J].世界汽车.1998,02(5):34-38.
    [17]Bekiaris,E.,et.al.Save project Final Report[M].1999,1.
    [18]Traffic Safety Facts 2000:A Compilation of Motor Vehicle Crash Data From the Fatality Analysis Reporting System and the General Estimates System[Z].U.S.Dept Transportation Administration,National Highway Traffic Safety Report DOT HS 809337,2001:234-236.
    [19]D.Anderson,A.Abdalla,B.Pomietto.Gold.Distracted Driving:Review of Current Needs,Efforts and Recommended Strategies[C].Senate Document No.14Common wealth of Virginia,Richmond,2002,10:158-167.
    [20]Ashley Craig,Peter Boorda,Hung guyen.Development of an algorithm for an EEG-based driver fatigue counter measure[J].Joumal of safety Research.2003,34:321-328.
    [21]李琪,宋凯.疲劳驾驶预警装置的实现与软件设计[J].辽宁大学学报.2003,30(4):367-369.
    [22]梁路宏,艾海舟,徐光佑.人脸检测研究综述[J].计算机学报.2002,1(3)5-7.
    [23]Kithil W.,Jones D.,John MacCuish.Development of Driver Alertness Detection System Using Overhead Capacitive Sensor Array[J].SAE Technical Paper Series 982292,SAE International,1998:94-96.
    [24]Jean Chfistophe,Phippe S.Pierre L.Using Driver's Head Movements Evolution As A Drowsiness Indicator[C].Proceedings of the IEEE International Conferenceon Intelligent Vehicles Symposium.2003:616-621.
    [25]金键,杜文.驾驶疲劳机理及馈选模式研究[J].中国铁道科学.2003,24(3):48-51.
    [26]李贞,冯晓毅.基于传感器技术的驾驶疲劳检测方法综述[J].测控技术.2007,26(4):1-3.
    [27]Sung K,Poggio T.Example-based learning for view based human face detection[J].IEEE Trans Pattern Analysis and Machine Intelligence.1998,20(1):39-51.
    [28]Nakaho Numata,Hiroki Kitajima,Yoshihiro Goi.Analysis Of Drivers' Behavior Before and After Crashes In Simulated Expressway Driving To Predict Sleepiness Levels For Doze Alarm Activation[J].Proceedings of the JSAE Review.1998,19:269-275.
    [29]Takehiro Ito,Shiniji Mita,Kazahiro Kozuka.Driver Blinking Measurement by the Motion Picture Processing and its Application to Drowsiness Detection[C].Proceedings of the IEEE International Conference on Intelligent Transportation Systems.2002:168-173.
    [30]Richard Grace,Vicky E.Byrne.A Drowsy Driver Detection System for Heavy Vehicles[C].Proceedingsof the 17th Digital Avionics Systems Conference.1998,2:1-8.
    [31]Haisong Gu,Qiang Ji,Zhiwei Zhu.Active Facial Tracking for Fatigue Detection[J].Proceedings of the Sixth IEEE Workshop on Applications of Computer Vision(WACV'02).2002:137.
    [32]Martin Eriksson,Nikolaos P.Papanikolopoulos.Eye-tracking for detection of driver's fatigue[C].Proceedings of the In IEEE Conference on Intelligent Transportation Systems.1997:314-319.
    [33]Sarbjit Singh,Nikolaos P.Papanikolopoulos.Monitoring Driver Fatigue Using Facial Analysis Techniques[C].Proceedings of the 1999 IEEE/IEEJ/JSAI Conference on Intelligent Transportation Systems.1999:314-318.
    [34]梁路宏,艾海舟,何克忠.基于多模板匹配的单人脸检测[J].中国图象图形学报.1999,4A(10):823-830.
    [35]Ai H Z,Liang L H,Xu G Y.A general framework for face detection[C].In:Tan Tie-Niu,Shi Yuan Chun,Gao Wen eds.In:Proc the 3rd Conference on Multimodal Interfaces,Lecture Notes in Computer Science,1948,Berlin:Springer-Verlag,2000,10:119-126.
    [36]Miao J,Yin B C,Wang K Q et al.A hierachical multiscale and multiangle system for human face detection in a complex background using gravity-center template[J].Pattem Recognition,1999,32(10):1237-1248.
    [37]Xing Xin,Wang Kong Qiao,Shen Lan Sun.Organ-based real-time face tracking method[J].ACTA Electronica Sinica,2000,28(6):29-31.
    [38]董文会,吴晓娟,徐祗军.基于图像处理的驾驶员疲劳检测方法[J].计算机应用与软件,2006,12,23(12):70-77.
    [39]D.F.Dinges,M.Mallis,G.Maislin,J.W.Powell.Evaluation of techniques for ocular measurement as an index of fatigue and the basis for alertness management[J].Dept.Transportation Highway Safety Publication,Washington,DC,Tech.Rep.808 762,Apr.1998:567-572.
    [40]W.Wierville,L.A.Ellsworth.Research on vehicle based driver status performance monitoring:Development,validation, and refinement of algorithms for detection of driver drowsiness[J].Nat.Highway Traffic Safety Admin.,Washington, DC, Tech. DOT HS 808 247,1994:48-53.
    [41] Grace,R.,Byrne,V.E.,Bierman,D.M. A drowsy driver detection system for heavy vehicles[C].Digital Avionics Systems Conference,1998.Proceedings,17th DASC. The AIAA/IEEE/SAE Volume 2,31Oct.-7 Nov.1998:345-360.
    [42] Haisong Gu,Qiang Ji,Zhiwei Zhu.Active facial tracking for fatigue detection.Applications of Computer Vision,2002.(WACV 2002).Proceedings[J]. Sixth IEEE Workshop on 3-4 Dec.2002:137-142.
    [43] Eriksson,M.,Papanikotopoulos,N.P.. Eye-tracking for detection of driver fatigue[C]. Intelligent Transportation System,1997.ITSC 97.IEEE Conference on 9-12 Nov. 1997:314-319.
    [44] Singh,S.,Papanikolopoulos,N.P..Monitoring driver fatigue using facial analysis techniques[C].Intelligent Transportation Systems,1999.Proceedings,1999 IEEE International Conference on 5-8 Oct. 1999:314-318.
    [45] Wen-Bing Horng,Chih-Yuan Chen,Yi Chang. Driver fatigue detection based on eye tracking and dynamic, template matching[C]. Networking, Sensing and Control,2004 IEEE International Conference on Volume 1,2004,3(11):7-12.
    [46] Wang Rongben,Guo Lie,Tong Bingliang.Monitoring mouth movement for driver fatigue or distraction with one camera[C]. Intelligent Transportation Systems,2004.Proceedings.The 7th International IEEE Conference on 3-6,2004,10:314-319.
    [47] Luke Fletcher,Nicholas Apostoloff,Lars Petersson,and Alexander Zelinsky[J].Vision in and outof Vehicles Intelligent Systems,IEEE.Volume 18,Issue 3,May-Jun 2003:12-17.
    [48] Qiang Ji,Lan,P.,Looney,C..A Probabilistic Framework for Modeling and Real-Time Monitoring Human Fatigue[J]. Systems,Man and Cybernetics, Part A,IEEE Transactions on Volume 36, 2006,9(5):862-875.
    [49] Yang,G,Lin,Y.,Bhattacharya,P..A driver fatigue recognition model using fusion of multiple features[J].Systems, Man and Cybernetics,2005 IEEE International Conference on Volume2, 2005,10(2):1777-1784.
    [50] Ing-Sheen Hsieh,Kuo-Chin Fan.A statistic approach to the detection of human faces in color nature scene[J]. Pattern Recognition,2002,25(2):1583-1596.
    [51] K.Jain.Face Detection in Color Images[J]. IEEE Trans.Pami, 2002, 5(24):696-706.
    [52]H.Greenspan,J.Goldberger,I.Eshet.Mixture model for face-color modeling and Segmentation[J].Pattern Recognition Letters 2001,22(14):1525-1536.
    [53]毛燕芬,施鹏飞.基于对象的视频图像分割技术[J].中国图像图形学报.2003,7(12):759-763.
    [54]Rein-Lien Hsu,Mohamed Abdel-Motaleb.Face Detection in Color Images[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2002,24(5):696-706.
    [55]Ing-Sheen Hsieh,Kuo-Chin Fan,Chiunhsiun Lin.A statistic approach to the detection of human faces in color nature scene[J].Pattern Recognition,2002,35(7):1583-1596.
    [56]J.D.Brand,Dr.J.S.D.Mason.A skin probability map and its use in face detection,Proceedings[C].International Conference on Image Processing,2001,Vol 1,7-10Oct 1034-1037.
    [57]Kwok-Wai Wong,Kin-Man Lam,Wan-Chi Siu.An efficient algorithm for human face detection and facial feature extraction under different conditions[J].Pattern Recognition,2001,34(11):1993-2004.
    [58]张洪明,赵德斌.高文.基于肤色模型、神经网络和人脸结构模型的平面旋转人脸检测[J].计算机学报.2002,25(11):1250-1256.
    [59]Karin Sobotka,Ioannis Pitas.Extraetion of Facial Regions and Features using Color and Shape Information[C].Proceedings of the 13th International Conference on Patem Recognition,2008,9(3):421-425.
    [60]Sanun Srisuk,Werasak Kurutach.A new robust face detection in color images[C].Proc of the 5th IEEE International Conference on Automatic Face and Gesture Recognition(FGR'02),2002:65-69.
    [61]Karin Sobottka.Face Localization and Facial Feature Extraction based on shape and color information[C].IEEE International Conference on Image Processing,Lausanne,Switzerland,1996,9(3)483-486.
    [62]胡伏泉.复杂背景下快速人脸检测与识别[D]:[硕士学位论文].西安:西北工业大学.2004.
    [63]韩艳丽,杨慧宇,苏伟.基于分形和肤色模型的自然态人脸检测方法研究[J].计算机工程与设计.2009,30(1):251-255.
    [64]徐之海,冯华君.基于KL变换的人脸识别研究[J].光电工程.2001,6:48-51.
    [65]周宗恒,韩懿,高艳芳.基于KL肤色的人脸初定位[J].计算机工程.2001, 27(4):109-111.
    [66]www.cse.msu.edu/—hsureinUfacloc/tpami13783.pdf.2008.
    [67]Frank S.WERBLIN.Control of Retinal Sensitivity[J].The Journal of Genera Physiology,1974,63(1):62-87.
    [68]李雪威.复杂背景下基于肤色的人脸检测[D]:[硕士学位论文].天津:天津大学.2004.
    [69]J.Yang,Y Xu,and C.Chen.Human action learning via hidden Markov model[J].IEEE Transactions on Systems,Man and Cybernetics,Part A(Systems and Humans),1997,1(27):34-44.
    [70]王磊,莫玉龙,戚飞虎.基于霍夫变换和眼睑弹性模板的眼睛特征提取[J].红外与毫米波学报.1999,18(1):53-60.
    [71]王瑞,高文,马继涌.一种快速、鲁棒的唇动检测与定位方法[J].计算机学报.2001,24(8):866-871.
    [72]M.Jones.Rapid Object Detection Using a Boosted Cascade of Simple Features[J].Kauai Marriott,Hawaii,Proc.of CVPR,2001:511-518.
    [73]杨彬.汽车司机驾驶疲劳报警器的研究及设计[D]:[硕士学位论文].福州:福州大学.2005.
    [74]耿磊.基于DSP的疲劳检测算法及应用优化研[D]:[硕士学位论文].济南:山东大学.2006.
    [75]L.B.Wolff,D.A.Soeolinsky,C.K.Eveland.Faces recognition in the thermal infrared[J].Advances in Pattern Recognition Computer Vision Beyond the Visible SPeetrum.2005:167-191.
    [76]P.Viola.Empirical Analysis of Detection Cascades of Boosted Classifiers for Rapid Object Detection[J].MRL Technical Report,May 2002,revised December 2002.
    [77]Funkunage K,Hostetler L.The Estimation of the Gradient of a Density Function,with Applications in Pattern Recognition[J].IEEE Trans.Information Theory,2005,21(1):32-34.
    [78]Takei,Y.,Furukawa,Y..Estimate of Driver's Fatigue Through Steering Motion Systems[J].Man and Cybernetics,2005 IEEE International Conference on Volume 2,2005,10(2):1765-1770.
    [79]R.Bishop.A Survey of Intelligent Vehicle Applications Worldwide[J].Overview.Proceedings of the IEEE Intelligent Vehicles Symposium 2000,2000,2(10):25-30.
    [80]董文会,吴晓娟,曲培树.基于规则与卡尔曼滤波的人眼跟踪[J].计算机工程与科学,2006,28(11):27-29.
    [81]O.Comaniciu,V Ramesh.Mean Shift and Optimal Prediction for Efficient Objecttracking[J].IEEE 1th Conf.Image Processing,Vancouver,Canada,2000,12(3):70-73.
    [82]周宏仁,敬忠良,王培德.机动目标跟踪[M].北京:国防工业出版社,1991.
    [83]D.Comaniciu,V.ramesh,P.meer.Kernel-based object tracking[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2003,25(5):564-577.
    [84]A.Djouadi,O.Snorrason,F.D.Garber.The Quality of Training-Sample Estimates of the Bhattacharyya Coefficient[J].IEEE Trans.Pattern Analysis Machine Intelligent,1990,12:92-97.
    [85]Federal Highway Administration.Eye-activity measures of fatigue and napping as fatigue countermeasure.Federal Highway Administration Tech Brief.http://fhwdot.gov,2008,4.
    [86]叶剑波,夏利民.基于卡尔曼粒子滤波器的人眼跟踪[J].计算机工程,2006,32(3):196-198.
    [87]FHWA.Eye-activity measures of fatigue and napping as a fatigue countermeasure[J].Technical Report No.MC-99-028,1999.
    [88]FHWA.PERCLOS:A Valid physiological Measure of Alertness As Assessed byPsychomotor Vigilance[M].Office of motor carriers,1998,(4):58-65.
    [89]郑培.机动车驾驶员驾驶疲劳测评方法的研究[D]:[博士学位论文].北京:中国农业大学.2001.
    [90]张志斌.基于计算机视觉的驾驶员疲劳实时检测研究[D]:[硕士学位论文].北京:北京工业大学.2008.
    [91]http://www.general.monash.edu.au.muarc/rptsum/eser72.htm.2009.
    [92]Zhu,Q.Ji.Eye and gaze tracking for interactive graphic display Mach Vision[J].In Proceedings of IEEE Intelligent Vehicles Symposium,2004,15(3):139-148.
    [93]C.Cudalbu,B.Anastasiu,R.Radu,R.Crueeanu,E.Sehmidt.Driver monitoring with a single high speed camera and IR illumination[J].In:International Symposium on Signals,Circuits and Systems.ISSCS 2005,Iasi Romania,vol.1.July 2005,10(4):219-222.
    [94]韩相军,关永,王雪立.基于DSP的疲劳驾驶实时监测系统研究[J].计算机技术与发展.2006,16(2):47-49.
    [95]郑培,宋正河,周一鸣.基于PERCLOS的机动车驾驶员驾驶疲劳的识别算法[J].中国农业大学学报.2002,7:104-109.
    [96]陈艳琴.关于司机疲劳监测的人眼检测与跟踪研究[D]:[硕士学位论文].长沙:中南大学.2004:46-54.
    [97]李衡峰.基于综合集成的驾驶疲劳识别[D]:[硕士学位论文].长沙:中南大学.2005:34-42.
    [98]Q.Ji,X.Yang.Real time eye gaze and face pose tracking for monitoring driver vigilance[J].Real-Time Imaging,2002,8(4):357-377.
    [99]T.Orazio,M.Leo,C.Guaragnella.A visual approach for driver inattention detection[J].Pattern Recognition 2007,40(22):2341-2355.
    [100]Grace R,Byrne VE,Legand JM.A Machine Vision Based Drowsy Driver Detection System for Heavy Vehicles[C].Proeeedings of The Ocular Measures of Driver Alertness Conference,FHWC-MC-99-136,Washing DC:FHWA Tech.1999,75-86.
    [101]Texas.Instruments.TMS320DM642 Technical Overview.http://www.ti.com.
    [102]http://www.ic37.com/htm_tech/2008-9/52647_297340.htm.2009.
    [103]Texas Instruments Incorporated.TMS320C6000系列DSP编程工具与指南[M].北京:清华大学出版社,2007:2-3.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700