用户名: 密码: 验证码:
基于红外与可见光的多源传感器协同检测与跟踪技术研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
运动目标检测与跟踪技术是计算机视觉领域重要的研究方向之一,在现代工业、农业、国防以及空间技术等领域都有着广泛的应用。然而,在实际应用中,由于单一传感器往往不能提供足够的场景信息,所以,基于多源传感器的协同检测与跟踪技术已经成为当前的研究热点。
     本文基于红外与可见光模式,研究了多源传感器协同检测与跟踪技术,主要工作有:
     (1)研究了运动目标检测与提取技术。提出了一种基于自适应背景模型的运动目标检测法,并在此基础上,实现了目标提取。在多种复杂的自然环境下的实验表明,该方法能够较好地完成运动目标的检测和提取。
     (2)研究了运动目标跟踪技术。详细介绍了运动预测技术,并在此基础上,提出了一种基于扩展卡尔曼滤波器的运动目标跟踪方法,实验证明该方法具有一定的实际应用价值。
     (3)研究了单源跟踪结果评价因子和多源跟踪结果综合评价技术。首先研究分析了单源跟踪结果,确定了四个评价因子:目标面积惯性、目标宽长比惯性、目标位置惯性和目标速度惯性,并对各种评价因子建立了具体的数学模型。其次在单源跟踪结果评价的基础上,研究了多源跟踪结果综合评价技术,提出了基于灰色关联分析理论的综合评价技术。最后进行了仿真验证,结果证明了所建数学模型的正确性以及所提出方法的有效性。
     (4)研究了图像配准技术。针对红外与可见光图像,提出了两种图像配准方法,一个是基于子图像边缘相关性的红外与可见光图像配准方法,另一个是基于角点的图像配准方法,实验验证了这两种方法的有效性。
Moving target detection and tracking technology is one of the most important research direction in the field of computer vision, and widely used in modern industry, agriculture, national defense and space technology. However, a single sensor cannot provide sufficient information of the scene in practical applications, so multi-sensor collaborative detection and tracking technology has become hot spots now.
     This paper focus on the multi-sensor collaborative detection and tracking technology based on infrared and visual images. The main work is as follows.
     (1) Moving target detection and extraction technologies are studied. A moving target detection method based on adaptive background model is adopted to achieve target detection, and on this basis, target extraction is accomplished. Experiments in complex natural environment show that the method can complete the moving target detection and extraction better.
     (2) Moving target tracking technology is researched. Movement prediction technology is introduced in detail, and on this basis, a moving target tracking method based on extended Kalman filter is brought forward. Experiments show that the method has some practical value.
     (3) The evaluation factors of single-sensor tracking results and synthesized evaluation technology of multi-sensor tracking results are studied. First, single-sensor tracking results are analysed. Four evaluation factors are chosen: target area inertia, target width length ratio inertia, target displacement inertia and target speed inertia. Specific mathematical models are established for all evaluation factors. Second, synthesized evaluation technology of multi-sensor tracking results is studied based on the single-sensor evaluation. A multi-sensor evaluation method based on the theory of gray relational analysis is proposed. Finally, the simulation is carried out, and the results prove the correctness of the mathematical model and the effectiveness of the method.
     (4) The image registration technology is studied. Two image registration methods are put forward for infrared and visual images. One is based on the edge relevance of the sub-image, and the other is based on the corner of the image. Experients show that the algorithms are effective.
引文
[1]郑世友.动态场景图像序列中运动目标俭测与跟踪[D].南京:东南大学,2006.
    [2]Toet,A.,Schoumans,N..Uspeert,J.K..Perceptual evaluation of different nighttime imaging modalities[C].Proceedings of the Third International Conference on Information Fusion.Paris:IEEE Press,2000:TUD3/17-TUD3/23.
    [3]张华睿.面向目标跟踪的传感器管理算法研究[D].长沙:国防科学技术大学,2006.
    [4]熊大容.杨烜.基于多传感器信息融合的远距离目标检测[J].红外技术.2006,28(12):695-698.
    [5]Heesung Kwon,Sandor Z.Der,Nasser M.Nasrabadi.Adaptive multisensor target detection using feature-based fusion[J].Optical Engineering,2002,41(1):69-80.
    [6]Torresan Helene,Turgeon Benoit.Ibarra Castanedo,et al.Advanced surveillance systems:combining video and thermal imagery for pedestrian detection[C].Proc.SPIE.Orlando:SPIE Press,2004:506-515.
    [7]朱毅,张朝亮.周君.视频监控系统中的图像预处理技术[J].计算机与数字工程,2007,35(11):102-104.
    [8]张小虎.靶场图像运动目标检测与跟踪技术研究[D].长沙:国防科学技术大学,2006.
    [9]Haritaoglu I.,Harwood D.,Davis L.S..W~4:Real-time surveillance of people and their activities[J].IEEE Trans Pattern Analysis and Machine Intelligence,2000,22(8):809-830.
    [10]C.Anderson,P.Bert,G.Van der Wal.Change detection and tracking using pyramids transformation techniques[J].In Proc of SPIE Intelligent Robics and Computer Vision.1985,579:72-78.
    [11]郑江滨.视频监视方法研究[D].西安:西北工业大学,2002.
    [12]王栓,艾海舟.何克忠.基于差分图象的多运动目标的检测与跟踪[J].中国图象图形学报.1999.4(6):1057-1012.
    [13]T.E.Boult R.Micheals.X.Gao,P.Lewis.et al.Frame rate omnidirectional surveillance and tracking of camouflaged and occluded targets[C].Proceedings of the Second IEEE Workshop on Visual Surveillance.Washington:IEEE Computer Society,1999:45-48.
    [14]Ross Cutler,Larry Davis.View-based Detection and Analysis of Periodic Motion[C].14~(th) International Conference on Pattern Recognition.Brisbane,Australis:[s.n.]1998:490-500.
    [15]Haritsoglu I.,harwood D.,Davis L.S..Multiple people detection and tracking using silhouettes[C].Second IEEE Workshop on Visual Surveillance.Fort Collins:IEEE Computer Society,1999:6-13.
    [16]G.P.Stein.Tracking from multiple view Points:Self-calibration of space and time[J].Computer Vision and Pattern Recognition,1999,1:521-527.
    [17]杨根.复杂背景下运动目标的协同检测技术研究[D].西安:西北工业大学,2007.
    [18]Nagel H..Displacement Vectors Derived From Second-Order Intensity Variations in Image Sequences[J].Computer Graphics Image Processing,1983,10(9):85-117.
    [19]Horn B.,Schunck.Determing Optical Flow[J].Artificial Intelligence,1981,17(8):185-203.
    [20]刘贵喜,邵明礼,刘先红,等.真实场景下视频运动目标自动提取方法[J].光学技术,2006,26(8):1150-1155.
    [21]Li Gang,Zeng Rui-li,Lin Ling.Moving Target Detection in Video Monitoring System[J].The IEEE Sixth World Congress on Intelligent Control and Automation,2006,(2):9778-9781.
    [22]M.Kim,J.G..Choi,D.Kim,et al.A VOP Generation Tool:Automatic Segmentation of Moving Objects in Image Sequences Based on Spatio-Temporal Information[J].IEEE Transactions on Circuits and Systems for Video Technology,1999,9(8):1216-1226.
    [23]冈萨雷斯等著,阮秋琦等译.数字图像处理(MATLAB版)[M].北京:电子工业出版社,2005.
    [24]娄越,相里斌,刘波.基于背景粗糙度估计的红外目标检测算法[J].光子学报, 2007.36(9):1759-1763.
    [25]刘文.刘朝晖.熊仁生.一种利用窗口结构提取红外弱小目标的方法[J].光子学报.2008.37(3):618-620.
    [26]刘瑞祯.于仕琪.OpenCV教程基础篇[M].北京:北京航空航天大学出版社,2007.
    [27]Intel Corporation.Open Source Computer Vision Library ReferenceManual[M].USA:Intel Corporation,2000.
    [28]Haifeng Xu,Younis A.A.,Kabuka M.R..Automatic moving object extraction for content-based applications[J].IEEE Transactions on Circuits and Systems for Video Technology,2004,14(6):796-812.
    [29]杨洪丰.运动目标跟踪研究[D].西安:西安理工大学,2003.
    [30]徐艳丽.运动目标提取检测与跟踪有关问题的研究[D].吉林:吉林大学.2007.
    [31]赵世喆.基于序列图像的运动目标检测和跟踪算法研究.北京:北方工业大学,2006.
    [32]Liang-qun Li,Hong-bing Ji.A Novel Maneuvering Target Tracking Algorithm with Two Passive Sensors[C].2006 IEEE 8~(th) International Conference on Signal Processing.Beijing:[s.n.],2006:796-812.
    [33]Foresti,G.L..Object recognition and tracking for remote video surveillance[J].IEEE Transactions on Circuits and Systems for Video Technology,1999,9(7):1045-1062.
    [34]Foresti,G.L..A real-time system for video surveillance of unattended outdoor environments[J].IEEE Transactions on Circuits and Systems for Video Technology,1998,8(6):697-704.
    [35]Wixson L..Detecting salient motion by accumulating directionally-consistent flow[J].IEEE Transactions on Pattern Analysis and Machine Intelligence.2000,22(8):774-780.
    [36]Wren,C.R.,Azarbayejani,A.,Darrell,T..et al.Pfinder:Real-time tracking of the Human Body[J].IEEE Transactions on Pattern Analysis and Machine Intelligence. 1997,19(7):780-785.
    [37]D.Koller,J.Weber,T.Huang,et al.Towards Robust Automatic Traffic scene Analysis in Real-time[J].Proceedings of the 33~(rd) IEEE Conference on Decision and Control,1994,4:3776-3781.
    [38]Bakowski A.,Jones G.A..Video surveillance tracking using colour region adjacency graphs[J].Seventh International Conference on Image Processing and Its Applications,1999,2:794-798.
    [39]Alan J.Lipton.Local application of optic flow to analyse rigid versus non-rigid motion[DB/OL],http://www.eecs.lehigh.edu/FRAME/Lipton/iccvframe.html,2009.
    [40]Jianbo Shi,Carlo Tomasi.Good Features to Track[C].IEEE Conference on Computer Vision and Pattern Recognition.Ithaca,NY,USA:Cornell University,1994:593-600.
    [41]L.Dreschler,H.-H.Nagel.Volumetric Model and 3D Trajectory of a Moving Car Derived From Monocular TV Frame Sequences of a Street Scene[J].Computer Vision,Graphics and Image Processing,1981,20(3):199-228.
    [42]David Salmond.Target Tracking:Introduction and Kalman Tracking Filter[J].Target Tracking:Algorithms and Applications,2001,2:1/1-1/16.
    [43]Chunling Wu,Chongzhao Han.Strong Tracking Finite-Difference Extended Kalman Filtering for Ballistic Target Tracking[C].IEEE International Conference on Robotics and Biomimetics.Sanya:[s.n.],2007:1540-144.
    [44]刘刚,刘明,匡海鹏,等.多目标跟踪方法[J].电光与控制,2004,11(3):71-74.
    [45]李辉,张安,何胜强,等.基于神经网络的多机动目标跟踪算法[J].西北工业大学学报,2006,24(5):552-557.
    [46]孙现召,潘广贞.基于细胞神经网络运动目标跟踪算法研究[J].电脑开发与应用,2008,21(6):13-14.
    [47]金花,谢萍,马炜,等.基于模糊神经网络的机动多目标跟踪的研究[J].华北电力大学学报,2006,33(4):76-79.
    [48]王睿,缑娜,苏蓉.基于小波多分辨率分析的机动目标跟踪算法[J].空军工程大学学报,2007,8(5):29-32.
    [49]刘钢,刘明,匡海鹏.等.运动背景下多目标跟踪的小波方法[J].光电工程.2005,32(5):12-15.
    [50]Zou Wei-jun,Bo Yu-ming,Chen Yi.Windows-tracking technology for an electro-optical tracking and pointing platform[J].Infrared and Laser Engineering,2008.37(4):602-606.
    [51]张覃平,张启衡.数字自适应波门跟踪系统[J].光电工程,1991.18(5):19-24.
    [52]Boyd J.E.,Meloche J.,Vardi,Y.,et al.Statistical tracking in video traffic surveillance[J].The Proceedings of the Seventh IEEE International Conference on Computer Vision,1999,1:163-168.
    [53]丁玉美,阔永红.高新波.数字信号处理-时域离散随机信号处理[M].西安:西安电子科技大学出版社,2002.
    [54]V.Y.Mariano,J.Min,J.-H.Park,et al.Performance Evaluation of Object Detection Algorithms[J].16~(th) International Conference on Pattern Recognition,2002,3:965-969.
    [55]M.Bertozzi,A.Broggi P.Grisleri.et al.A Tool for vision based pedestrian detection performance evaluation[C].2004 IEEE Intelligent Vehicles symposium.Parma,Italy:[s.n.],2004:784-789.
    [56]刘思峰.郭天榜.党耀国等.灰色系统理论及其应用[M].北京:科学出版社,1999.
    [57]肖新平,黎德扬.灰色关联分析应用的最新进展[J].大自然探索,1996,15(58):50-56.
    [58]张绍良.张国良.灰色关联度计算方法比较及其存在问题分析[J].系统工程,1996,14(3):45-49.
    [59]周秀文.灰色关联度的研究与应用[D].吉林:吉林大学,2007.
    [60]邓聚龙.灰色控制系统.武汉:华中理工大学出版社,1985,364-366
    [61]傅立.灰色系统理论及其应用[M].上海:科学技术文献出版社.1992.
    [62]万琴,王耀南.基于卡尔曼滤波起的运动目标检测与跟踪[J].湖南大学学报.2007.34(3):36-40.
    [63]Yang Biwu.Guo Xiaosong,Zhao Jingmin.et al.An Algorithm on Geometric Global Registration of Parallax Images Based on Wavelet Transform[J].Acta Photonica Sinica,2007,36(3):574-576.
    [64]曹闻,李弼程,邓子健.一种基于小波变换的图像配准方法[J].测绘通报,2004,2004(2):16-19.
    [65]Keller Y.,Averbuch A..Implicit similarity:a new approach to muti-sensor image registration[C].2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Madison,USA:IEEE Press,2003:543-548.
    [66]L.G.Brown.A survey of image registration techniques[J].ACM Computer Surveys,1992,24(4):325-376.
    [67]Tomislav Hrkac,Zoran Kalafatic,Josip Krapac.Infrared-Visual Image Registration Based on Corners and Hausdorff Distance[J].Lecture Notes in Computer Science,2007,2007(4522):383-392.
    [68]高军,李学伟,张建,等.基于模板匹配的图像配准算法[J].西安交通大学学报,2007,41(3):307-311.
    [69]王忆锋,张海联,李灿文,等.多传感器数据融合中的配准技术[J].红外与激光工程,1998,27(1):38-41.
    [70]求是科技.Visual C++数字图像处理典型算法及实现[M].北京:人民邮电出版社.2006.
    [71]张坤华,王敬儒,张启衡.多特征复合的角点提取方法[J].中国图像图形学报,2002,7(4):319-324.
    [72]陈利军,刘侍刚.一种改进的MIC的角点提取方法[J].电子科技,2004,2004(9):34-37.
    [73]金宝刚,王晓蕾.一种红外与可见光图像的自动配准方法[J].光学与光电技术,2007,5(6):60-62.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700