基于小波变换和支持向量机相结合的步态识别新方法研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
步态识别是生物特征识别技术中的一个新兴领域。它旨在根据人们的走路姿势实现对个人身份的识别或生理、病理及心理特征的检测,具有广阔应用前景,成为近年来生物医学信息检测领域备受关注的前沿方向。步态识别主要针对含有人体步行运动图像进行分析,其关键是寻找合适的步态特征及分类方法,融合了计算机视觉、模式识别以及视频/图像序列处理等多种技术。
     本研究主要采用如下处理流程:先提取目标人体的轮廓信息并将其规格化,经叠加处理后获取步态特征图,然后用小波变换将步态特征图分解,再依据骨架理论和图像空间不变矩提取两种人体模型的步态特征参数,输入至支持向量机(Support Vector Machine,SVM)进行步态识别。分别使用中国科学院自动化研究所(CASIA)和美国南佛罗里达大学(USF)的步态数据库进行了实验,分别取得了93.67%与83%-100%的良好识别率。
     考虑到不同应用环境,本论文还分析了红外热成像技术用于步态识别的可行性,并自建了天津大学红外步态数据库(Tianjin University Infrared Gait Database,TIGD)。实验表明该技术识别率受人体携带外物影响较小,而仅受衣着影响较大,值得深入研究与应用。作者还尝试设计了一套实用的智能步态识别门禁系统实验平台,具有步态图像实时采集、定位、特征提取与自动分类等功能,可实现对人体目标的安全监控。
     本研究中的创新性主要体现在:
     i.首次将步态识别领域中的两种人体模型进行了有机结合,弥补了单一模型存在的缺陷;并将骨架特征参数与不变矩矩参数同时运用于步态识别中,减弱了背景、光照、衣着、速度等因素变化的影响,提高了算法的实用性。
     ii.首次将小波变换与支持向量机相结合用于步态识别,提高了分类算法的精确性;并在步态特征参数提取中将小波变换与矩理论相结合,有效地提高了基于人体轮廓信息及区域特征的步态识别效果。
     iii.首次采用红外热成像技术获取步态图像数据,借助于红外成像可夜视、易定量的优势,提升了步态图像序列采集与识别的技术层次,并拓展了其应用领域。
     iv.构建了基于步态图像特征进行身份识别的门禁系统硬件平台,研究开发了智能门禁系统软件,为步态识别技术的实际应用进行了初步探索。
Recognition by gait is a new field for the biometric recognition technology. Its aim is to recognize people or detect physiological, pathological and mental characters by their walk style. The future of this technique will be very good. Gait recognition, as one of the attractive research area of biomedical information detection, attracts more and more attention. Gait recognition mainly analyzes moment images including walk style. For this technique the key factors is to find out the gait characters and classification method. It contains many kinds of techniques, such as computer vision, pattern recognition, video and image sequences processing and etc.
     This study deals with the following process. Body silhouette sequences of gait were extracted and normalized in this study. The sequences were added together and gait character image could be obtained. The method of wavelet transform was used to decompose the image of gait character. In this paper two models were combined for the body object. At the same time moment invariants and skelecton theory were used in extracting gait character parameters. Then support vector machine (SVM) was applied for classification and recognition. This technique was applied to CASIA and USF gait data-set and achieves probability of correct recognition of 93.67% for the former and 83%-100% for the latter.
     Considering the different environment, the infrared thermal imaging technology was used to research gait recognition. Infrared imaging camera was presented for the TJU Infrared Gait Database (TIGD). The experiment was performed in this data-set. It is proved that recognition result was insensitive for the person with object such as backpack and ball. For the term of wearing down coat, recognition rate is affected apparently. So we should give attention to the study and application for infrared gait recognition. In this paper, the application of gait recognition was engaged in research. The experiment platform of automatic gait access control system was established. This system can be used to watch body objects. The function involves of real-time image collection, image orientation, feature extraction, recognition and etc.
     The originalities of this thesis were the followings:
     i. For the first time, two models of body were united in the filed of gait recognition. This method can repair the deficiency of using single model. Feature parameter of skelecton and moment invariants was applied together in gait recognition. This technique reduces the influence by noises such as background, light, clothes, speed and etc. At the same time it strengthens the application for practice.
     ii. For the first time, wavelet transform and support vector machine were combined to use recognize gait. It enforces the precision of classification. Moment invariants and wavelet transform were used to extract feature parameter of gait. This method can function as an efficient gait recognition based on body silhouette and area feature.
     iii. The new concept of using infrared imaging camera in gait recognition developed the attractive research areas. Infrared imaging camera can be used in night and transforms the temperature of body to the image. The level of research was improved in image collection of gait sequences and gait recognition.
     iv. This new access control system based on gait feature was built. The software of this system was compiled. Elementary work was researched in the application involving gait recognition.
引文
[1] A.K. Jain, R. Bolle, S. Pankanti. Biometrics: personal identification in a networked society[M], Kluwer Academic Publishers, 1999:103 ~ 121
    [2] Javier Ortega-Garcia, Josef Bigun, Douglas Reynolds, et al. Authentication gets personal with biometrics. IEEE Signal Processing Magazine, 2004; 21(2):50~62
    [3] Anil K. Jain, Arun Ross, Salil Prabhakar. An introduction to biometric recognition. IEEE Transactions on Circutts and Systems for Video Technology, 2004; 14(l):4~20
    [4] Nixon M S, Carter J N, Cunado D, et al. Automatic gait recognition [A]. In: Biometrics: Personal Identification in Networked Society[M], Netherlands: Kluwer Academic Publishers, 1999:231—250
    [5] Mark S. Nixon, John N. Carter. Advances in automatic gait recognition. In: Proceedings. Sixth IEEE International Conference on Automatic Face and Gesture Recognition. 2004: 139~144
    [6] Johansson G. Visual Perception of Biological Notion and a Model for Its Analysis. Perception Psychophys, 1973; 14(2): 201~211
    [7] Cutting J.E, L.T.Kozlowski. Recognition of friends by their walk. Bulletin Psychonomic Soc. 1977; 1(9):353~356
    [8] Barclay C, Cutting J, Kozlowski L. Temporal and spatial factors in gait perception that influence gender recognition. Perception and Psychophysics. 1978, 23(2):145~152
    [9] Cutting J E, Kozlowski L T. Recognizing friends by their walk: gait perception without familiarity cues. Bull Psychonom, Society, 1977; 9(5): 353~356
    [10] Sourabh A. Niyogi, Edward H. Adelson. Analyzing gait with spatiotemporal surfaces. In: Proceedings of IEEE Workshop Non-Rigid Motion, 1994:24~29
    [11] Murase H, Sakai R. Moving object recognition in eigenspace representation: gait analysis and lip reading. Pattern Recognition Letters, 1996, 17:155—162
    [12] Little J, Boyd J. Recognizing people by their gait: the shape of motion. Journal of Computer Vision Research, 1998; 1(2): 22~32
    [13] Shutler J, Nixon M, Harris C. Statistical gait recognition via temporal moments. In: Proc IEEE Southwest Symposium on Image Analysis and Interpretation, Austin, Texas, 2000:291~295
    [14] J.Hayfron-Acquah, M.Nixon, J. Carter. Automatic gait recognition bysymmetry analysis. In Proc. Int. Con. Audio-Video-Based Biometric Person Authentication, 2001:272~277
    [15] Chiraz BenAbdelkader, Ross Cutler, Larry Davis. Motion-based recognition of people in eigengait space. In: Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition, 2002:254—259
    [16] Robert T. Collins, Palph Cross, Jianbo Shi. Silhouette-based human identification from body shape and gait [A]. In: Proceedings of Fifth IEEE International Conference on Automatic Face and Gesture Recognition[C], Washington DC, USA, 2002:351~356
    [17] Foster J P, Nixon M S. Prugel-Bennet A. Automatic gait recognition using area based metrics. Pattern Recognition Letters, 2003; 24:2489
    [18] Sudeep Sarkar, Jonathon Phillips, Zongyi Liu. The humanID gait challenge problem: data sets, performance, and analysis. IEEE transactions on pattern analysis and machine intellgence. 2005, 27(2): 162— 176
    [19] Rezaul K. Begg, Marimuthu Palaniswami, Brendan Owen. Support vector machines for automated gait classification. IEEE transactions on bio-medical engineering, 2005; 52(5):828—838
    [20] Wang Liang, Tan Tie-niu, Hu Wei-ming, et al. Automatic gait recognition based on statistical shape analysis [J]. IEEE Transaction on Image Processing, 2003,12(9):1120—1131
    [21] 韩鸿哲,李彬,王志良等,基于傅立叶描述子的步态识别,计算机工程, 2005,31(2):48~49
    [22] 田光见,赵荣椿,基于连续隐马尔可夫模型的步态识别,中国图象图形学 报,2006:11(6):867~871
    [23] G. V. Veres, L. Gordon, J. N. Carter, et al. What image information is important in silhouette-based gait recognition? In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recogntion, Washington D.C, USA, 2004; 2:776~782
    [24] Cunado D, Nixon M, Carter J. Using gait as a biometric, via phase-weighted magnitude spectra. In: Proc International Conference on Audio- and Video-based Biometric Person Authentication, Crans-Montana, Switzerland, 1997.95 ~ 102
    [25] Nash J, Carter J, Nixon M. Extraction of moving articulated-objects by evidence gathering [A]. In: Proceedings of the Ninth British Machine Vision Conference BMVC98[C], 1998; 609~618
    [26] Lee L, Grimson W. Gait analysis for recognition and classification [A]. In:Proceedings of IEEE Conference on Face and Gesture Recognition'02[C], 2002: 55~62
    [27] Wagg, D.K, M.S. Nixon. Automated markerless extraction of walking people using deformable contour models. Computer Animation and Virtual Worlds. 2004, 15(3):399~406
    [28] J.Little and J.Boyd. Describing motion for recognition, in Proc.of International Symposium on Computer Vision, 1995:235~240
    [29] Murray M P, Drought A B, Kory R C. Walking patterns of normal men [J]. Bone and Joint Surgery, 1964; 46-A(2):335~360
    [30] Murray M P. Gait as a total pattern of movement [J]. American Journal of Physical Medicine, 1967; 46(l):290~332
    [31] J. Cutting and L. Kozlowski. Recognizing friends by their walk: gait perception without familiarity cues. Bulletin of the Psychonomic Society, vol. 9, pp. 353~356
    [32] J.T.Cutting, D.R.Proffitt, L.T.Kozlowski. A biomechanical invariant for gait perception. J.Exp. Psych.:Human Perception and Performance, 1978:357—372
    [33] DA Winter. The Biomechanics and Motor Control of Human GaitNormal, Elderly and Pathological,2nd Eds [M]. Waterloo Biomechanics, 1991
    [34] 明东,李树楠,万柏坤等,基于步行器行走的上肢动力学研究,北京生物 医学工程,2005,24(4):268~272
    [35] 胡雪艳,恽晓平,步态分析在临床中的应用,中国康复理论与实践,2003, 9(11):677~679
    [36] 明东,万柏坤,胡勇等,基于危势轨迹图的截瘫FES行走步态分析新技 术研究,信息与控制,2005,34(3):274~279
    [37] Aggarwal J K, Cai Q. Human motion analysis: a review [A]. In: IEEE Proceedings of Nonrigid and Articulated Motion Workshop[C], San Juan, Puerto Rico, 1997; 1:90~102
    [38] Kale A, Rajagopalan N, Cuntoor N, et al. Gait based recognition of humans using continuous HMMs[A]. In: Proceeding of Fifth IEEE International Conference on Automatic Face and Gesture Recognition [C], Washington D C, USA, 2002:321~326
    [39] Vogler C, Sun H, Metaxas D. A framework for motion recognition with applications to American sign language and gait recognition [A]. In: Proceedings of Workshop on Human Motion [C], Austin Texas, USA, 2000:33~38
    [40] Bhanu B, Han J. Kinematic-based human motion analysis in infrared sequences [A]. In: Proceedings of Sixth IEEE Workshop on Applications of Computer Vision[C], Orlando, Florida, United States, 2002:208~212
    [41] T Olson. Moving Object Detection and Event Recognition Algorithm for Smart Cameras [ J ]. PROC Image UnderstandingWorkshop, May 1997
    [42] Haritaoglu I, Harwood D, Davis L S. W4 : real-time surveillance of people and their activities[J]. IEEE Trans Pattern Analysis & Machine Intelligence ,2000 ,22 (8) : 809~822
    [43] Stauffer C, Grimson W. Adaptive background mixture models for real time tracking [C]. Proc of the IEEE CS Conference on Computer Vision and Pattern Recognition , Collins : IEEE Computer Society , 1999 :246~252
    [44] McKenna S, Jabri S, Duric Z, et al. Tracking groups of people [J]. Computer Vision & Image Understanding, 2000, 80(l):42~56
    [45] J IANG C, Ward M O. Shadow identification[C]. Proc of IEEE Int'l Conference on Computer Vision and Pattern Recognition (CVPR '92) , Champaign , Illinois : IEEE Computer Society, 1992 : 606~612
    [46] Kilger M. A shadow handler in a video2based real2time traffic monitoring system[C]. Proc of IEEE Workshop on Application of Computer Vision , Palm Springs : IEEE Computer Society, 1992: 11~ 18
    [47] Stauder J, Mech R, Ostermann J. Detection of moving cast shadows for object segmentation [J] . IEEE Trans on Multimedia , 1999, 1(1): 65~76
    [48] Cucchiara R, Grana C, Piccardi M, et al. Detecting objects, shadow and ghosts in video streams by exploiting color and motion information[C]. Proc of 11th International Conference on Image Analysis and Processing (ICIAP 2001) : Palermo , Italy , 2001: 1337~1342
    [49] Karmann K P, Von Brant. Moving object recognition using an adaptive background memory[C]. Time varying Image Processing and Moving Object Recognition , Amsterdam , The Netherlands : Elsevier Science, 1990, 2:289~ 296
    [50] Ahmed Elgammal, David Harwood, Larry Davis. Non-parametric model for background subtraction [C]. 6th European Conference on Computer Vision , Dublin , Ireland: Lecture Notes in Computer Science, 2000: 751~767
    [51] Cucchiara R, Grana C, Piccardi M, et al. Detecting moving objects, ghosts, and shadows in video streams [J] . IEEE Trans on Pattern Analysis & Machine Intelligence, 2003, 25(10): 1337~1342
    [52] Xue Zhaojun; Wang Dahai; Ming Dong et al, New gait recognition technique
    used in functional electrical stimulation system control, Proceedings of the World Congress on Intelligent Control and Automation (WCICA), Jun 21-23 2006, p 9421~9424
    [53] 徐建华,图像处理与分析,北京:科学出版社,1992.177~187
    [54] 万柏坤,尹胜琴,綦宏志等,基于小波变换的事件相关电位少次提取方 法,北京生物医学工程,2005,24(5):321~325
    [55] E. P. Simoncelli, W. T. Freeman, E. H. Adelson, and D. J. Heeger. Shiftable Multi-scale Transforms. IEEETrans. 1992,IT-38(2):587~607
    [56] 胡昌华,基于MATLAB的系统分析与设计一小波分析,西安:西安电子 科技大学出版社,2000.157~168
    [57] 张志涌,精通MATLAB 6.5版,北京:北京航空航天大学出版社,2003. 213~220
    [58] 罗军辉,冯平,哈力旦A等,Matlab7.0在图像处理中的应用,北京:机械 工业出版社,2005.165~176
    [59] 曲中水,王建卫,段宏伟,基于MATLAB小波工具箱进行真彩图像的分解 与重构,信息技术,2004,28(6):34~36
    [60] Hu M K. Visual Pattern Recognition by Moment Invariants. IRE Trans. IT, 8, 1962, 179~182
    [61] Flusser Jan Suk Tomas. Pattern recognition by affine moment invariants. Pattern recognition, 26, 1993, 167~174
    [62] Li Y. Reforming the theory of invariant moments for pattern recognition. Pattern recognition, 25, 1992, 723~730
    [63] Perantonis S, Lisboa P. Translation, rotation and scale invariant pattern recognition by high-order neural networks and moment classifiers. IEEE Trans. Neural Networks, 3, 1992, 241~251
    [64] Shvedov A, Schmidt A, Yakubovich V. Invariant system of features in pattern recognition. Automation Remote Control, 40,1979, 131~142
    [65] Dudani S A, Breeding K J, Mcghee R B. Aircraft Identification by Moment Invariants. IEEE Trans, on Comput, 1977,26(1):39~46
    [66] Arbter K, Snyder W E, Burkhardt H, et al. Application of Affineinvariant Fourier Descriptors to Recognition of 3-D Objects. IEEE Trans, on PAMI, 1990,12(7): 640—647
    [67] 柳林霞,陈杰,窦丽华,不变矩理论及其在目标识别中的应用,火力与指 挥控制,2003,28(2):13~15
    [68] Das S, Bir B. A System for Model-based Object Recognition in PerspectiveAerial Iimages. PR, 1998, 31(4): 465~49
    [69] 王晓华,钟山,模式识别中的特征提取与计算机视觉不变量,北京:国防工 业出版社,2001.201~220
    [70] Zakaria F, Vroomen L J. Fast algorithm for the computation of moment invariant. Pattern recognition, 1984, 20: 639~649
    [71] Chen C C. Improved moment invariant for shape discrimination. Pattern recognition, 1993, 26:683~686
    [72] 黎雷生,肖德贵,基于不变矩的步态识别,计算机应用,2005, 25(8):1795~1796
    [73] YOO Jang-hee, NIXON M S, HARRIS C J. Extracting Human Gait Signatures by Body Segment Pmperties[A]. Proceedings of Proc IEEE Southwest Symposium on Image Analysis and Interpretation[C]. University of Southampton, Southampton UK. 2002
    [74] 边肇祺,张学工,模式识别,北京:清华大学出版社,2000.284~300
    [75] 万柏坤,王瑞平,朱欣等,SVM算法及其在乳腺x片微钙化点自动检测 中的应用,电子学报,2004,32(4):587~590
    [76] 高隽,人工神经网络原理及仿真实例,北京:机械工业出版社,2005:76~ 85
    [77] Vapnik V N. The nature of statistical learning theory, New York: Springer-Verlag, 1995
    [78] Nello Cristianini, John Shawe-Taylor. An Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge University Press, 2000
    [79] Chih-Chung Chang, Chih-Jen Lin. LIBSVM: a library for support vector machines, 2001. Software available athttp://www.csie.ntu.edu.tw/~cjlin/libsvm
    [80] CASIA Gait Database, http://www.sinobiometrics.com
    [81] 薛召军,李佳,明东等,基于支持向量机的步态识别新方法,天津大学学 报,2007,40(1):78~82
    [82] 韩力群,人工神经网络理论、设计及应用,北京:化学工业出版社,2002. 87~95
    [83] P. Jonathon Phillips, Sudeep Sarkar, Isidro Robledo et al. Baseline results for the challenge problem of human ID using gait analysis. In: Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition, 2002.130—135
    [84] Sudeep Sarkar, P. Jonathon Phillips, Zongyi Liu, et al. The HumanID Gait Challenge Problem: Data Sets, Performance, and Analysis. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2005, 27(2): 162~165
    [85] P. Jonathon Phillips, Sudeep Sarkar, Isidro Robledo etc. Baseline results for the challenge problem of human ID using gait analysis. In: Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition, 2002.130~135
    [86] Kittler J, Illingworth J. Threshold selection based on a simple image statistic. CVGIP, 1985,30 : 125 ~ 147
    [87] Kapur J N, Sahoo P K, Wong A K C. A new method for grey-level picture thresholding using the entropy of the histogram. CVGIP , 1985, 29: 273—285
    [88] 薛景浩,章毓晋,林行刚,图像分割中的交叉熵和模糊散度算法,电子学 报,1999,22(10):131~134
    [89] 刘文萍,吴立德,一种对空中目标图像自适应分割方法,红外与毫米波学 报,1996,15(4):257~261
    [90] 章毓晋,图像分割,北京:科学出版社,2001.45~46
    [91] SAHOO P K, SOLTANI S. A survey of thresholding techniques [J]. Comput.Vis.Graph.Image Process, 1988, 41(5): 233—260
    [92] YANG Y, YAN H. An adaptive logical method for binarization of degraded document images [J]. Pattern Recognition, 2000, 33(5): 787—807
    [93] 代雪晶,汤澄清,生物特征识别技术,中国公共安全,2004:126~127
    [94] 桂珍,谌海新,马丙辰,用AVICap窗口类实现双目视频的捕获,信息技 术,2005:(3):48~51
    [95] 飞思科技产品研发中心,MATLAB7基础与提高,北京:电子工业出版社, 2005
    [96] 沈庭芝,方子文,数字图像处理及模式识别,北京:北京理工大学出版社, 1998.150~213
    [97] 张学工.关于统计学习理论与支持矢量机[J].自动化学报,2000,26(1): (32—42)
    [98] Bhanu, B., Han, J.: Bayesian-based performance prediction for gait recognition. In: IEEE Workshop on Motion and Video Computing, Orlando, Florida, 2002: 145-150
    [99] Ben-Abdelkader, C, R.Cutler, Davis, L.: Person identification using automatic height and stride estimation. In: 16th International Conference on PatternRecognition, Quebec, Quebec, 2002, 377-380
    [100] Laszlo, J., van de Panne, M., Fiume, E.: Limit cycle control and its application to the animation of balancing and walking. In: SIGGRAPH 96. (1996) 155 ~ 162
    [101] Murray, M.P., Bernard, A., Kory, R. C. Walking patterns of normal men. The Journal of Bone and Joint Surgery 46A (1964) 335~359
    [102] Von Tscharner, V., Goepfert, B.: Gender dependent emgs of runners resolved by time/frequency and principal pattern analysis. Journal of Electromyography and Kinesiology. 2003, 13:253~272
    [103] Von Tscharner, V., Goepfert, B.: Gender dependent emgs of runners resolved by time/frequency and principal pattern analysis. Journal of Electromyography and Kinesiology. 2003, 13: 253—272
    [104] Kale A, Rajagopalan N, Cuntoor N, et al. Gait based recognition of humans using continuous HMMs [A]. In: Proceeding of Fifth IEEE International Conference on Automatic Face and Gesture Recognition[C], Washington D C, USA, 2002:321~326
    [105] Bhanu B, Han J. Kinematic-based human motion analysis in infrared sequences [A]. In: Proceedings of Sixth IEEE Workshop on Applications of Computer Vision[C], Orlando, Florida, United States, 2002:208—212

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700