用户名: 密码: 验证码:
驾驶员疲劳状态检测技术研究与工程实现
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
在频繁发生的道路交通事故中,驾驶员的疲劳驾驶往往是肇事的主要原因之一,因此对驾驶员的疲劳状态进行实时检测,减少由疲劳驾驶引发的交通事故,有着重要的现实意义。本文利用机器视觉技术对驾驶员人脸进行图像分析,提取多个有效的驾驶员疲劳特征信息,结合模糊逻辑与人工神经网络技术对驾驶员疲劳状态进行检测与预警,取得了较好的效果。本文的主要研究工作和贡献在于:
     (1)对疲劳及驾驶疲劳的形成过程进行了分析,建立了基于人-车-环境的驾驶员疲劳分析系统。根据驾驶行为S-O-R理论,建立了驾驶行为过程模式,并在此基础上,建立了以人为中心的驾驶疲劳行为模式。
     (2)从心理学、生理学及行为科学等角度对驾驶员疲劳的机理进行了分析。驾驶员操纵车辆的动作是驾驶行为,而驾驶员驾车时脑中所思、所想、所感等则是驾驶心理。研究表明,人体昼夜觉醒水平的变化规律与驾驶员疲劳引发的驾驶事故的时间分布是完全一致的。
     (3)从驾驶时间,驾驶速度、驾驶环境、身体状况、道路状况等因素对驾驶疲劳的影响进行了分析,得出:随着驾驶时间增长,各个因素对驾驶员疲劳的影响加剧;中断后,具有可恢复性。
     (4)提出了一种基于投影和分块复杂度的眼睛定位方法。首先采用由粗到细的两级定位策略,根据人脸图像的投影定出人眼的大致区域;然后将此区域分割成若干小块,找出复杂度最大的几个小块,建立判定规则,排除非眼睛的小块,剩下的两块即为左右眼睛。
     (5)提出了基于颜色和纹理复合特征的双状态人眼跟踪算法。该算法的要点在于对计算所得的人眼睁开状态的权重附加了一个判定准则,即当本轮粒子更新时的最大粒子概率小于某个阈值P_(min)时认为该轮更新无效,在试验中我们取P_(min)=0.65,取得了较好的跟踪效果。
     (6)提出了基于Gabor小波滤波器的人眼纹理特征提取的计算方法。通过将Gabor小波滤波器提取的人眼纹理特征向量送入RBF神经网络进行学习、分类,输出值设定为0,1,2,3,4,分别对应眼睛五种闭合程度状态0%,25%,50%,75%,100%,可以简单方便的计算参数PERCLOS和AECS的值。
     (7)通过对多种人脸识别方法进行比较分析,提出采用Hopfield神经网络进行驾驶员疲劳检测时的人脸识别方法。
     (8)针对实时驾驶员疲劳状态检测的要求,建立了以DM642为核心处理器的实时图像采集、处理硬件系统。利用模糊神经网络技术,将驾驶员疲劳视觉特征参数进行有机融合,设计了新的驾驶员疲劳状态检测方法。
     本文的主要创新点如下:
     (1)提出了一种基于投影和分块复杂度的眼睛定位方法。。
     (2)提出了基于颜色和纹理复合特征的双状态人眼跟踪算法
     (3)提出了基于Gabor小波滤波器的人眼纹理特征提取方法,将特征向量通过RBF神经网络进行分类输出,可以方便地计算PERCLOS和AECS的值。
     (4)提出了将模糊神经网络技术应用到驾驶员疲劳实时检测系统中的新的疲劳检测方法。首先利用计算机视觉技术对在行车过程中的驾驶员表情变化、眨眼变化、眼动变化及视线变化等进行监控,从监控所得图像数据中提取PERCLOS、AECS、NodFreq、YawnFreq等四个疲劳特征参数,通过模糊神经网络将这四个疲劳特征参数信息进行融合,将检测出来的特征值与PVT量化值对比评价,以确定驾驶员的疲劳级别,从而采取相应的报警级别。实验表明,这个系统在驾驶员疲劳实时检测中具有较好的效果。
It is well known that driver fatigue is one of main causes of the traffic accident. Thus,the real-time detection of the driver fatigue has the vital practical significance in reducing the accidents caused by driver fatigue.Some beneficial improvement have been achieved in this field by employing the machine vision technology to analysis the facial image,then extracting many effective driver fatigue characters from these informations,and finally using the fuzzy logic and the artificial neural networks technology to detect and provide the early warning about the state of fatigue.The main task and contribution of this paper lie in:
     (1) The fatigue and the process that causes the driving fatigue are analyzed.Then based on the person-vehicle-environment systems,the driver fatigue analysis system has been established.Furthermore,the model of the driver behavior is also proposed based on the S-O-R theory.With these preparations,the person-focused model is established to analyze the driver fatigue behavior.
     (2) The mechanism of driver fatigue is studied from a psychological,physiological and behavioral science point of view.The actions employed by the driver to control the vehicles are named driver behavior.And the thought and feeling of the driver during the driving is called the driver psychology.It is proved that the time distribution of the traffic accident caused by the driver fatigue is just the same as the level of the sleeping or the wake of human beings.
     (3) We mainly study the influence of the following factors such as the driving time, speeding,driving environment,the background of the driving,social environment, health,road conditions etc.,to the driving fatigue.It is proved that the influence of these factors to the driver fatigue is greatly augmented as the driving time increases.However, such an influence can be resumed if the driving is stopped.
     (4) A new algorithm is proposed to locate the eyes,which is based on the projection and the intersected complexity.Specifically,a coarse-to-fine two level localization strategy is first adopted to approximately locate the area of the eyes based on the projection of the face image.Then,this area is divided into several small regions and some of them with high complexity are extracted.Finally,the regions that do not correspond to eyes are excluded by using the judging rules,and the rest is just in relation to the eyes.
     (5) Based on the color and texture compound characterization,the double state eye's tracking algorithm is proposed.The main idea of this algorithm lies in adding an additional determination criterion to the weight which denotes the open degree of the human eyes.More specifically,if the probability of the biggest granule is smaller than a given threshold P_(min) as the granule updates in the epicycle.We take P_(min)=0.65 on trial and achieved good tracking effect.
     (6) Based on the Gabor wave filterings,an algorithm is proposed to extract the texture of eyes.The obtained characteristics is imported into RBF neural network to learn and its output is classified into five types as 0,1,2,3,4 which correspond to the value of the parameters PERCLOS and AECS 0%,25%,50%,75%,100%,respectively.
     (7) Many of face detection and identification methods are studied.Firstly we introduce many face detection and face recognition method.Then the Hopfield neural network is adoptted to carry out the facial recognition.The experimental results illustrate that such a recognition method has higher identification accuracy in small sample set than BP neural networks.
     (8) An experimental platform is estabilished to real time detect the fatigue of the driver,in which the DM642 is the main processor.By employing the fuzzy neural network technique,the parameters that denote the degree of the driver fatigue are fused and then a new algorithm is presented to detect the driver fatigue.
     The main contributions of this paper are as follows:
     (1) A new algorithme,which is based on the projection and the intersected complexity,is proposed to locate the eyes.
     (2) A double state eye's tracking algorithm which is based on the color and texture compound characterization is proposed.
     (3) An algorithm based on the Gabor wave filterings is proposed to extract the texture of eyes,by which the PERCLOS and ECS can be obtained through the output of the RBF neural network.
     (4) Fuzzy neural network is introduced to detect the driver fatigue.The computer vision technology is first used to collect the changes of the driver's expression,blinks, movement of the eyes,and the line of sight etc.And then the four fatigue characteristic parameters named PERCLOS,AECS,NodFreq,and YawnFreq are extracted from these image informations.Finally,these obtained datas are fused by the fuzzy neural network and the output is just corresponded to the classification of the fatigue.Compared these value with the PVT,the degree of the driver fatigue is decided and then the corresponding warning degree is confirmed.The results of the experiment have indicated that our method is more efficient in real-time fatigue detection.Furthermore, the proposed algorithm is also valuable for the other related fields.
引文
[1]Gao Xiaohong.Cross Century Transportation:Its Goals,Trends and Solutions[J].Journal of Wuhan Transportation University,1999,22(2):111-114.
    [2]交通事故年鉴.北京:《中国交通年鉴》编辑委员会.1997-2007.
    [3]何勇.我国道路交通安全现状及对策[J].公路交通科技,2003,6(增刊):119-122.
    [4]Parker,D.,Reason,J.T..Driving errors,driving collations and accident prevention[J].Ergonomics,1995,(38):1036-1048.
    [5]Jun Miura,Motokuni Itoh,Yoshiaki Shirai.Toward Vision-based Intelligent Navigator[J].IEEE Transactions on Intelligent Transportation System,2002,3(2):136-146.
    [6]Carnegie Mellon Research Institute Highlights Article.Alert at the wheel:Sensor system for trucks will help reduce highway fatalities,http://www.cmu.edu/cmri/adm alert.html.2000.
    [7]Dawson,D.,Lamond,N.,Donkin,K.& Reid,K..Quantitative similarity betweenthe cognitive psychomotor performance decrement associated with sustained wakefulness and alcohol intoxication[C].Proceedings of the Third International Conference on Fatigue and Transportation,Fremantle,Western Australia Elsevier Science Ltd.,Oxford UK.In Hartley,L.R.(Ed.) Managing Fatigue in Transportation.1998.
    [8]Driver Fatigue-a Kill on the Roads[Z].1998,10.http://www.fmcsa.dot.gov.
    [9]Federal Motor Carder Safety Administration.Research and Technology Program:Driver alertness and fatigue focus area summary[Z].Intemet publication at 2000,http://www.fmcsa.dot.gov/safetyprogs/research/driverfatigue.htm.
    [10]Gerry E.warning System For Fatigued Drivers Nearing Reality with New Eye Data[N].Science Daily,99.7.27.
    [11]S.A.Nobe,F.Y.Wang.An overview of recent developments in automated lateral and longitudinal vehicle controls[C].IEEE International Conference on SMC.2001,5:3447-3452.
    [12]Penn Schoen Associates Inc.User acceptance of commercial vehicle operations services:Task B,Critical issues relating to acceptance by Interstate Truck and Hus Drivers[R].Final Report,Contract No.DTFH61-94-R-00182.1995.
    [13]Federal Highway Administration U.S.Department of Transportation Tracking Research Institute.Commercial Motor Vehicle Driver Fatigue and Alertness Study Technical Summary[R].American Trucking Associations Foundation Transportation Development Centre Safety and Security Transport,Canada.1996,11.
    [14]郑培.机动车驾驶员驾驶疲劳测评方法的研究[D].北京:北京农业大学,2001.
    [15]Fletcher A& Dawson D.Field-based Validations Of A Work-related Fatigue Model Based On Hours Of Work[C].Paper presented at the 4th International Conference on Managing Fatigue in Transportation,Fremantle.2000.
    [16]Knipling,R.R.,Wang,J.S.&Kanianthra,J.N..Current NHTSAdrowsyddver R&D[C].Proceedings of the Fifteenth International Technical Conference on the Enhanced Safety of Vehicles.Melbourne,Australia.1996,1.
    [17]Carroll,R.J..Ocular Measures of DriverAlertness[C].Technical Conference Proceedings FHWA Technical Report No.FHWA-MC-99-136.Washington,DC:Federal Highway Administration,Office of Motor Cartier and Highway Safety.1999.
    [18]W.Wierwille et al.Research on vehicle-based driver status/performance monitoring:development,validation,and refinement of algorithms for detection of driver drowsiness[R].Washington,DC,National Highway Traffic Safety Administration,1994.
    [19]R F(?)raud,OJ Bemier,JE Viallet,M Collobert.A Fast and Accurate Face Detection Based on Neural Network[J].IEEE Trans.Pattem Analysis and Machine Intelligence,2001,23(1):42-53.
    [20]黄瀚敏.基于汽车驾驶员疲劳状态监测技术的汽车主动安全系统研究[D].重庆:重庆大学.2007.4.
    [21]王磊,吴晓娟.驾驶疲劳/瞌睡检测方法的研究进展[J].生物医学工程学,2007,24(1):245-248.
    [22]R.Grace,V.E.Byrne,J.M.Legrand,et al.A machinevisionbased drowsy driver detection system for heavy vehicles[C].Proceedings of The Ocular Measures of Driver Alertness Conference,1999:75-86.
    [23]STEERING ATTENTION MONITOR[EB/OL].http://www.carkits.com.au/index.htm.
    [24]毛喆,初秀民,严新平等.汽车驾驶员驾驶疲劳监测技术研究进展[J].中国安全科学学报,2005,15(3):108-112.
    [25]Q.Ji,X.Yang.Real-Tune Eye,Gaze,and Face Pose Tracking for Monitoring Driver Vigilance[J].Real-Tune Imaging,2002,8:357-377.
    [26]FaceLAB(?)v4[EB/OL].http://www.seeingrnachines.com/facelab.htm.
    [27]S.Boveris.Driver fatigue monitoring technologies and future ideas[C].Proc.AWAKE Road Safety Workshop,2004.
    [28]孙玮,李晓莹.避免疲劳驾驶的“驾驶员警示系统”[J].交通世界(运输·车辆),2006,(1):57.
    [29]孙伟,张为公,张小瑞,等.疲劳驾驶预警系统的研究进展[J].汽车电器,2009,1::4-8.
    [30]RL Hsu,M Abdel-Mottaleb,AK Jain.Face Detection in Color Images[J].Pattern Analysis and Machine Intelligence,IEEE Transactions on PAMI.2002,24(5):696-706.
    [31]周鹏.疲劳事故隐患消除技术与方法[J].汽车电器,1998,8:27-30.
    [32]张殿业,金键,杜文.机车司机失衡性实时监测系统[J].西南交通大学学报,1999,34(5):594-597.
    [33]石坚,吴远鹏,卓斌,等.汽车驾驶员主动安全性因素的辨识与分析[J].上海交通大学学报,2000,34(4):441-444.
    [4]李增勇,王成焘.驾驶疲劳与汽车人机工程学初探[J].机械设计与制造工程,2001,30(5):12-14.
    [35]杨渝书.驾驶疲劳的人机工程学分析和定量评价实验研究[D].上海交通大学,2002.
    [36]李峰,曾超,徐向东.驾驶防瞌睡装置中人眼快速定位方法研究[J].光学仪器,2002,24(4):70-72.
    [37]王光娟.基丁DSP的驾驶疲劳检测系统的研究与实现[D].镇江:江苏大学,2007.
    [38]周宝宽.医疲劳与亚健康研究[D].沈阳:辽宁中医学院,2003.
    [39]王坤根.疲劳的中医保健[M].北京:民卫生出版社,2000.
    [40]蔡笑岳.驾驶心理学[M].北京:中国劳动出版社,1998.9.
    [41]焦昆,李增勇,王成焘.形成驾驶疲劳的理论分析与系统建模[J].汽车科技,2006,2:13-15.
    [42]浅居喜代治.现代人机工程学概论[M].北京:科学出版社,1992.
    [43]郭青山,汪元辉.人机工程设计[M].天津:天津大学出版社,1994.
    [44]谢燮正.人类工程学[M].浙江:浙江教育出版社,1987.
    [45]Q W.Hannaman,D.H.Wodedge.Some development in human reliability approaches and tools[J].Reliability engineering and systems safety,1988,22:235-256.
    [46]任桂秀主编.行为医学[M].成都:四川大学出版社,2004.4.
    [47]金键.驾驶疲劳机理及馈选模式研究[D].西安:西南交通大学,2002.
    [48]皇甫恩.航空心理学[M].西安:陕西科学出版社,1989.
    [49]Gillberg M,Kecklund G,Akerstedt T.Relations between performance and subjective ratings of sleepiness during a night awake[J].Sleep,1994,17(3):236-241.
    [50]Wilhelm B,Wilhelm H,Ludtke H,et al.Pupillographic assessment of slee-piness in sleep-depdved healthy subjects[J].Sleep,1998,21(3):258-265.
    [51]Lal SKL,Craig A.Driver Fatigue:Psychophysiological effects[C].Australia:The Fourth International Conference on Fatigue and Transportation,2000.
    [52]付兆君,马瑞山,程宏伟.睡眠剥夺条件下应用咖啡因对人的工效及情绪情感状态的影响(摘要),全国第5次暨全军第8次航空航天医学学术会议论文摘要[C],1999,108.
    [53]Makeig S,Inlow M..Lapses in alertness:coherence of fluctuations in performance and EEG spectrum[J].Electroenceohalogr Clin Neurophysiol,1993,86(1):23-35.
    [54](?)kerstedt T,Torsvall L,Gillberg M.Sleepiness in laboratory and field experiments.In:Koella,W.P.,R(u|¨)ther,E.,Schulz,H.,eds.Sleep.Gustav Fischer Verlag,Stuttgart,1984.88-89.
    [55]Hartley LR,Arnold PK.Indicators of fatigue in truck drivers[J].Appl Ergonomics,1994,25(3):143-156.
    [56]Schubert M,Johannes S,Koch M,et al.Differential effects of two motor tasks on ERPs in an auditory classification task-evidence of shared cognitive resources[J].Neurosci Research,1998,30(2):125-134.
    [57]Borbely AA,Neuhaus HU.Endogenous sleep-promoting substances and sleep regulation[J].Physiol Rev,1989,69(2):605-670.
    [58]Nilsson T,Nelson TM,Carlson D.Development of fatigue symptoms during simulated driving[J].Acrid Anal Prev.1997,29(4):479-488.
    [59]Linda G,Shapiro George C,Stockman.计算机视觉[M].北京:机械工业出版社,2005.
    [60]赵新灿,左洪福,任勇军.眼动仪与视线跟踪技术综述[J].计算机工程与应用,2006,12:118-120.
    [61]Robert J K Jacob,Keith S Kam.Eye tracking in human computer interaction and usability research:Ready to deliver the pormises[J].Computer Vision and Image Understanding,2003,24:682-701.
    [62]李衡峰.基于综合集成的驾驶疲劳[D].长沙:中南大学,2005.
    [63]Federal Highway Administration.Eye-activity measures of fatigue and napping as a fatigue countermeasure.Federal Highway administration Tech Brief.Publication number:FHWA-MCRT-99-010,1999.
    [64]Wierwille,WW,Ellsworth,LA,Wreggit,SS,Fairbanks,RJ,Kim,CL.Research on vehicle-based driver status/performance monitoring:development,validation,and refinement of algorithms for detection ofdriver drowsiness.National Highway Traffic Safety Administration FinalReport:DOT HS 808 247,1994.
    [65]余杨,黄惟一.机器人视觉目标识别光电混合处理系统的理论和实验研究[D].南京: 南京大学,2002.
    [66]芮同林,彭国华.一种改进的直方图均衡化算法的研究与应用[J].微电子学与计算机.2006,23(11):58-59.
    [67]WW.Bledsoe.Man-machine facial recognition[C].Panoramic Research Inc,PaloAlto,CA,1966.
    [68]张翠平,苏光大.人脸识别技术综述[J].中国图象图形学报,2000,5(11):885-894.
    [69]Belhumeur P N,Hespanha J P,Kriegman D J.Eigen faces vs fisherfaces:Recognition using calss specific linearprojection[C].In:IEEETran.On PAMI,1997,19(7).
    [70]Moghaddam B,Jebara T,Pentland A.Bayesian face recognition[J].Pattern Recognition,2000,(33):1771-1782.
    [71]Barnabas Takaes.Comparing face image using the modified hausdorff distance[J].Pattern Recognition,1998,vol.31(12):1873-1881.
    [72]邸海燕.人脸识别技术研究[D].浙江:浙江工业大学,2005.
    [73]王守觉.仿生模式识别(拓扑模式识别)——一种模式识别新模型的理论与应用[J].电子学报,2002,30(10):1417-1420.
    [74]王守觉,徐健,王宪保.基于仿生模式识别的多镜头人脸身份确认系统研究[J].电子学报,2003,31(1):1-3.
    [75]沈传平.离散型Hopfidd神经网络特性分析与设计[D].湖北:武汉科技大学,2003.
    [76]范宏深,倪国强,申会堂.用黑斑的椭圆性质在二值化图象中探测眼睛[J].光学技术,2001,27(4):307-309.
    [77]刘文予,潘锋.离散对称变换在人脸图像眼睛定位中的应用[J].红外与毫米波学报,2001,20(5):375-380.
    [78]解明,马泳.基于对称变换的人脸图像眼睛定位方法[J].光学技术,2004,30(2):237-239.
    [79]王磊,莫玉龙,戚飞虎.基于霍夫变换和眼睑弹性模板的眼睛特征提取[J].红外与毫秒波学报,1999,18(2):53-60.
    [80]王磊,莫玉龙,戚飞虎.眼球的自动定位[J].红外与毫秒波学报,1998,17(10):349-356.
    [81]孙大瑞,吴乐南.基于Gabor变换的人眼定位[J].电路与系统学报,2001,6(4):29-32.
    [82]李国辉,柳伟,曹莉华.一种基于颜色特征的图象检索方法[J].中国图象图形学报,1999,Vol.4A(3):248-251.
    [83]伯晓晨,刘健平.基于颜色直方图的图像检索[J].中国图象图形学报,1999,4A(1):33-37.
    [84]G.Smith,I.Bums.Measuring texture classification algorithms[J].Pattern Recognition Letters,1997,18(14):1495-1501.
    [85]阮秋琦.数字图像处理学[M].北京:电子工业出版社,2001.
    [86]王蕴红,朱勇,谭铁牛.基于虹膜识别的身份鉴别[J].自动化学报,2002,28(1):1-10.
    [87]徐杰,施鹏飞.基于Crabor小波特征的多姿态人脸图像识别[J].计算机工程与应用,2003,21:17-18.
    [88]Zhiwei Zhu,Qiang Ji.Active 3d face pose tracking from an uncalibrated monocular camera[C],IEEE Transactions of Pattern Analysis and Machine Intelligence,2003.
    [89]冯建强.人脸分割和特征提取技术研究[D].南京:南京航空航天大学,2004.
    [90]张雄伟,曹铁勇.DSP芯片的原理与开发应用[M].电子工业出版社,2000.
    [91]Wale Karl.Comparative evaluation of the TMS320C67X digital signal processor[J].Electronic Engineering(London),1998,72(862):21-23.
    [92]俞斌,贾雅琼.基于DSP的驾驶员疲劳瞌睡检测系统[J].电子测量技术,2007,30(3):36-38.
    [93]Texas Instruments Incorporated.TI DSP集成化开发环境(CCS)使用手册[M].北京:清华大学出版社,2004.
    [94]TMS320C62X/C67X CPU and Instruction Set Reference Guide Texas Instruments.1998,3.
    [95]陈东华,黄贤武,孙兵.基于TMS320C6711DSK的实时视频图像处理系统设计[J].苏州大学学报,2003,19(1):42-48.
    [96]李志春,何仁,何翠群.模糊神经网络在驾驶员疲劳检测中的应用[J].江苏大学学报(自然版),2008,29(2):123-126.
    [97]David F.Dinges,M.Mallis,G.Maislin,and J.W.Powell,\Evaluation of techniques for ocular measurement as an index of fatigue and the basis for alertness management,"Department of Transportation Highway Safety publication.DOS HS 808 762,1998,4.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700