四路摄像头协同多重触控技术研究与实现
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
理想的人机交互模式是利用人类自然形成的与自然界沟通的认知习惯和形式进行的自由交互。多重触控技术就是一种以用户为中心的自然人机交互方式,通过构建一种能同时检测到多个触点的多重触控平台,允许用户双手自由交互甚至多人协同交互,并以用户本能的交互手势进行交互,降低了用户的认知负担,充分释放了用户交互潜力,成为人机交互技术的研究热点之一。它在军事\民用指挥决策、商业零售、公共信息查询、信息家电、大众传媒以及教育等许多领域有着广泛的应用前景。
     多重触控技术的研究包括多重触控平台的构建及其多触点检测、定位和跟踪方法,以及多重触控手势描述与识别方法。目前多重触控平台构建方法是其中研究最深入的部分,也涌现出了大量的成果并得到成功应用,促使了多重触控技术的兴起,但是现有的多重触控平台大多具有成本高昂,尤其是构建大范围交互平台成本高昂,另外对交互环境和用户的交互行为有特殊要求,而且安装不方便,需要对现有显示平台进行改装和占用较大的空间,不具有移植性,此外大部分多重触控平台的多触点检测、定位和跟踪方法无法解决多触点之间的遮挡问题,定位精度较低,这些因素一定程度上限制了多重触控技术的发展。多重触控手势是多重触控平台与用户之间的桥梁,目前的多重触控应用局限于设定的几种手势,不能根据应用约束以及用户的交互习惯定制用户手势,需要用户去学习,记忆和适应指定的手势,限制了用户的自由和潜力,脱离了以人为中心的自然交互理念,且手势识别方法大都需要复杂的训练,手势定义的变动容易颠覆现有的识别结果,而且对用户操作的差异不够灵活,成为限制多重触控技术广泛应用的主要瓶颈。
     本文分别对其展开研究,具体内容如下:
     多重触控平台构建方法。提出一种四路摄像头协同的多重触控平台构建方法,该方法只需要简单的红外光源和四路广角红外摄像头,适用于构建各种尺寸的多重触控平台,且不需要对现有显示器进行改装,能直接安装于显示器前方,具有构建简单,安装方便,便于移植,成本低廉等特点。
     多触点检测定位跟踪方法。首先基于灰度梯度的单幅图像目标检测实现多触点的亚像素级检测,然后利用查找表法/消失点法/立体标定法构建触点在每个摄像头中的方向线,并利用四路摄像头空间约束关系去除触点间遮挡的影响,实现多个触点的精确定位,最后采用改进最近邻数据关联法,利用触点目标的位置、速度和方向特征对落在卡尔曼滤波预测范围内的目标构建加权二部图的权,并用KM算法求解加权二部图的最优匹配来实现多触点目标的稳定跟踪。
     多重触控手势描述。提出一种应用导向的多重触控语义交互手势描述方法,且基于OWL的多重触控手势本体描述结果能利用推理工具进行检验,发现并指导解决冲突,从而使得用户可以根据应用和自己的喜好自定义手势,能够方便地增加,删除,修改手势定义,或从现有手势继承派生出新的手势,且该方法适用于任意多重触控平台,具有较好的扩展性、重用性和语义性。
     多重触控手势识别。提出一种基于轨迹形状特征及约束关系的多重触控手势识别方法,使得手势模板建立简单,且用户修改手势定义或从现有手势继承派生出的新手势能直接存储为模板,不需要进行复杂的重新训练,而且能适应不同用户操作速度,幅度上的差异,具有较好的鲁棒性。此外,该方法适用于任意多重触控平台的任意条轨迹组成的复杂手势。
     多重触控系统实现。设计开发了四路摄像头协同多重触控系统,构建了2.4 m*1.35 m尺寸的四路摄像头协同多重触控平台,开发了应用导向的多重触控手势描述工具,并针对3维对象操控任务设计调查问卷采集面向三维物体操控的多重触控手势,并组织大量用户进行测试,对本文方法进行了验证,达到了较好的效果。
The ideal human-machine interaction pattern is to use the cognitive habits and styles, which are naturally formed during people’s communications with the nature. Multi-touch technology is a user-centered natural computer interaction method, and refers to a set of interaction techniques, including a touch screen or touchpad, as well as software that recognizes multiple simultaneous contact points. It allows users to interact with a system through the concurrent use of several fingers and permits multiple users to work together through collaborative hand gestures, which reduces the cognitive burdens on users and fully releases potentials of users’interactions, thereby it has become one of the hot spots of human-computer interaction research. It has widespread application prospects in many areas, such as the military or civilian command and decision-making, commercial retail, public information inquiry, information appliances, the mass media as well as the education and so on.
     Multi-touch system research includes the multi-touch platform construction and its detection, localization and tracking methods of multi contacts, as well as multi touch gesture description method and recognition method. Currently multi-touch platform construction method is one of the most extensive sections, and has emerged in a large number of platforms with successful applications, which contributes to the emergence of multi touch technology. However, most of the existing multi touch platforms are costly, particularly in the construction of large-size platforms, in addition to special requirements on the interactive environment or user interactions, and inconvenient installations, which require modification of the existing display platforms and occupies large spaces, therefore they owns little transplantation. Furthermore most of the detecting, locating and tracking methods are unable to resolve occlusions between contacts, and with low locating accuracies. These issues limit the popularization of multi-touch to some extend.
     Multi-touch gesture is the bridge between the platform and the user. Current multi-touch applications are limited to a set of predefined gestures, which could not be customized according to application constraints and users’interaction habits, consequently require users to learn, memorize and adapt to specified gestures and limit user's freedoms and potentials, which are separated from user-center natural interaction concept. Furthermore, the multi-touch gesture recognition methods mostly require sophisticated trainings, and any definition changes may easily subvert recognition results of existing gestures, moreover, it is lack of flexibility for users’differences. These problems make it the main bottleneck to promote the widespread of multi-touch application.
     This dissertation addresses these issues as follows:
     1) Four collaborative cameras based multi-touch platform construction method.
     It requires only simple infrared light sources and four wide-angle infrared cameras, and is suitable for construction of various sizes of multi touch platforms, and requires no alterations to existing monitors, on the contrary it can be installed directly in front of existing monitor. It has such characteristics as easily setup, convenient installation, and transplantation, low cost, etc.
     2) Multiple contacts detection, location and tracking methods.
     Detecting multiple contacts in sub-pixel based on gray gradient of a projected image for tracking points, and then use the lookup table method or Vanishing Point method or stereo calibration method to build direction lines in each camera, and solve the occlusion by position and space constraints, which can achieve precise location. Finally use an improved nearest neighbor data association method to achieve the stable tracking of contacts. The improvement includes building the weighted bipartite graphs for contacts falling in the estimation of Kalman filter based on location, speed and direction features, and use the KM algorithm to find the maximum matching of the weighted bipartite graphs to build the data association of multiple contacts.
     3) A semantic and application-oriented interactive multi-touch gestures description method.
     The description results of multi-touch ontology based on OWL can utilize reasoning tools to identify and guide the resolution of conflicts, which allows the user to customize gestures according to application constraints and their own preferences, and it can easily add, delete, or modify definitions, or derive new gestures from existing results. It is applicable to arbitrary multi-touch platform; therefore it has good extensibility, reusability and semantics.
     4) Multi-touch gesture recognition method based on shape features and constraints of trajectories.
     It simplifies the templates building templates, and users’modifications of gesture definitions or new gestures inherited from existing gestures can be directly stored as templates, which requires no complex re-trainings. Moreover, it is robust to different users’operating speed, amplitude differences. In addition, the method is suitable for any complex composition of trajectories for any multi-touch platform.
     5) Multi-touch system implementation.
     A four collaborative cameras based multi-touch system is set forth, including a multi-touch platform of 2.4m*1.35m, an application-oriented multi-touch gestures description tool, and a 3-dimensional object manipulation application. A questionnaire for the application is designed and analyzed to build the mostly acceptable gesture sets, and a set of users are invited to testing methods advanced here. Results prove the applicability of these methods.
引文
[1]董士海,人机交互的进展及面临的挑战[J],计算机辅助设计与图形学学报,2004,16(1):1-13. .
    [2]袁保宗,阮秋琦,王延江等,新一代(第四代)人机交互的概念框架特征及关键技术[J],电子学报,2003,31(12A):1945-1954.
    [3]普建涛,陈文广,王衡,董士海,多通道用户界面关键技术和未来发展趋势研究[J],计算机研究与发展,2001,38(6):684-690.
    [4]徐光祐 ,陶霖密,史元春,张翔,普适计算模式下的人机交互[J],计算机学报,2007,30(7):1041-1053.
    [5]付永刚,张凤军,戴国忠.双手交互界面研究进展[J],计算机研究与发展,2005,42(4):604-613.
    [6]王滔,基于多Agent理论和虚拟现实技术的工控人机系统研究及应用[D],上海大学,博士学位论文, 20050601.
    [7] Wikipedia, Multi-touch[EB/OL], http://en.wikipedia.org/wiki/Multi_touch, 2010-6-23.
    [8]李江,信息化战场下军事指挥决策的人机交互技术与方式研究[J],国防科技,2009,30(6):9-12.
    [9] Mark Micire, Holly A. Yanco, Improving disaster response with multi-touch technologies[C],International Conference on Intelligent Robots and Systems(IROS 2007), San Diego, California, USA., 2007: 2567-2568.
    [10] Perceptive pixel Inc., Interactive Media Wall[EB/OL], http://www.perceptivepixel.com/,2010-6-23.
    [11]老松杨,黄广连,张国华,凌云翔,衡翔安,双手触摸交互触控平台[J],中国科技成果,2009,10(11):58-60.
    [12] Bill Buxton,Multi-Touch Systems that I Have Known and Loved[EB/OL], (2008-2-5),http://www.billbuxton.com/multitouchOverview.html.
    [13] RHODA ALEXANDER,触摸屏驱动PC在2010年蓄势待发[EB/OL],http://www.isuppli.com.cn/products/monitors/specialty-monitors/051710,2010-05-20.
    [14] Ann Morrison,Giulio Jacucci,Peter Peltonen,CityWall: Limitations of a Multi-Touch Environment[C],Advanced Visual Interfaces (AVI) Workshop on Designing Multi-Touch Interaction Techniques for Coupled Public and Private Displays,2008,Naples,Italy,2008:31-35.
    [15] Bill Gates, 2008 Microsoft CES Keynote[EB/OL], http://www.microsoft.com/winme/0801/31781/CES_010608_31781.asx,January 6, 2008.
    [16] Perceptive Pixel Inc., Multi-Touch Wall[EB/OL] ,http://www.perceptivepixel.com/about.html, 2010-6-23.
    [17] Jefferson Y. Han, Low-Cost Multi-Touch Sensing through Frustrated Total Internal Reflection [C], Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, Seattle, WA, USA., Oct. 2005: 315-319.
    [18] Microsoft ,Microsoft Surface[EB/OL]. http://www.microsoft.com/surface/index.html.Nov 11, 2008.
    [19] iPhone. http://www.apple.com/iphone, Nov 11, 2008.
    [20] Dietz, P. and Leigh, D. DiamondTouch: A Multi-User Touch Technology[C], Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology (UIST), Orlando Florida, Nov 2001:219-226.
    [21] Hodges, S., Izadi, S., Butler, A., Rrustemi, A., and Buxton, B.. ThinSight: Versatile Multi-touch Sensing for Thin Form-factor Displays[C]. In Proceedings of the 20th Annual ACM Conference on User Interface Software and Technology ,Rhode Island, USA, Oct. 2007: 259-268.
    [22]卢如西,周春景,李军明,一种红外线触摸屏及其多点触摸定位方法[P],中国专利申请号:200710031082.6, 2007年10月.
    [23] Ali Mazalek, Matthew Reynolds, Glorianna Davenport. "The TViews Table in the Home," [C], Second Annual IEEE InternationalWorkshop on Horizontal Interactive Human-ComputerSystems. (TABLETOP'07),地点,2007: 52-59.
    [24]苹果电脑有限公司,多点触摸屏[P],中国专利申请号:200580011740.4, 2005年4月.
    [25] Rekimoto, J., SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces[C]. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Changing Our World, Changing Ourselves, Minneapolis, Minnesota, USA, April, 2002:113-120.
    [26] Ntrig[EB/OL], www.n-trig.com.
    [27] Nextwindow[EB/OL],http://www.nextwindow.com. .
    [28] Itai Katz, Kevin Gabayan, Hamid Aghajan, A Multi-Touch Surface Using Multiple Cameras [J], Advanced Concepts for Intelligent Vision Systems (ACIVS), Aug. 2007:97-108.
    [29]武斌,红外弱小目标检测技术研究[D],西安电子科技大学博士学位论文, 2008年12月.
    [30] Ankur Agarwal, Shahram Izadi, Manmohan Chandraker, Andrew Blake, High Precision Multi-touch Sensing on Surfaces using Overhead Cameras[C], Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems, TABLETOP '07:197-200.
    [31] Chia Shen, Multi-User Interface and Interactions on Direct-Touch Horizontal Surfaces: Collaborative Tabletop Research at MERL, TABLETOP 2006: 53-54.
    [32]徐一华,李善青,贾云得,一种基于视觉的手指屏幕交互方法[J],电子学报,2007,35(11):2236-2240.
    [33]王鹏,黄广连,老松杨,凌云翔,一种红外多点触摸式双手交互技术[J],小型微型计算机系统,2009,30(7):1467-1472.
    [34]何友,修建娟,张晶炜,关欣,等,雷达数据处理及应用[M],北京:电子工业出版社,第一版,2006.1.
    [35]顾立忠,基于表观的手势识别及人机交互研究[D],上海交通大学,博士学位论文, 20080601.
    [36] Wobbrock Jacob O., Morris Meredith Ringel , Wilson Andrew D., User-defined Gestures for Surface Computing[C], CHI '09: Proceedings of the 27th International Conference on Human Factors in Computing Systems,2009,Boston, MA, USA,1083-1092.
    [37]单彩峰,用于人机交互的视觉手势识别[D],中国科学院自动化研究所硕士学位论文,2004年1月,.
    [38] Ruiduo Yang, Sudeep Sarkar, Gesture Recognition using Hidden Markov Models from Fragmented Observations[C], CVPR '06: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York, NY ,2006: 766-773.
    [39] Webel Sabine,Keil Jens,Zoellner Michael, Multi-touch Gestural Interaction in X3D using Hidden Markov Models[C], Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology,Bordeaux,France,2008:263-264.
    [40] Daehwan Kim,Jinyoung Song,Daijin Kim,Simultaneous Gesture Segmentation and Recognition based on Forward Spotting Accumulative HMMs [J], Pattern Recognition,40(11),2007:3012-3026.
    [41] Yung-Hui Lee, Cheng-Yueh Tsai, Taiwan Sign Language (TSL) Recognition based on 3D Data and Neural Networks[J], Expert Systems with Applications,36(2),2009:1123-1128.
    [42] Bailador Gonzalo , Roggen Daniel , Tr\"{o}ster Gerhard , Trivi\,{n}o Graci\'{a}n, Real Time Gesture Recognition Using Continuous Time Recurrent Neural Networks[C], BodyNets '07: Proceedings of the ICST 2nd international conference on Body area networks, Florence, Italy, 2007: 1-8.
    [43] P .Hong, M .Turk, and T .Huang, Gesture Modeling and Recognition using Finite State Machines[C], in Proc. IEEE Intel Conference on Automated Face and Gesture Recognition( FG'00),Grenoble, France ,2000:410-415.
    [44] Jeroen. F. Lichtenauer, Emile. A. Hendriks, Marcel J. T. Reinders, Sign Language Recognition by Combining Statistical DTW and Independent Classification[J], in IEEE Transactions On Pattern Analysis and Machine Intelligence,30(11),2008:2040-2046.
    [45] Yen-Ting Chen, Kuo-Tsung Tseng, Multiple-angle Hand Gesture Recognition by Fusing SVM Classifiers[C], in Proceedings of the 3rd IEEE International Conference on Automation Science and Engineering,Scottsdale,Arizona,USA,2007:527-530.
    [46] Yikai Fang, Jian Cheng, Kongqiao Wang, Hanqing Lu, Hand Gesture Recognition Using Fast Multi-scale Analysis[C], in Proceedings of IEEE international Conference on Image and Graphics,Chengdu,China,2007:694-698.
    [47] Moaath Al-Rajab, David Hogg , Kia Ng, A Comparative Study on Using Zernike Velocity Moments and Hidden Markov Models for Hand Gesture Recognition[C], AMDO '08: Proceedings of the 5th international conference on Articulated Motion and Deformable Objects,Mallorca, Spain,Volume 5098,2008:319-327.
    [48] Popa Daniel, Simion Georgiana ,Gui Vasile ,Otesteanu Marius, Real Time Trajectory based Hand Gesture Recognition [J], WSEAS Transactions on Information Science and Applications, 2008, 5(4): 532-546.
    [49] Ming Hsuan, Y., A. Narendra, T. Mark, Extraction of 2D Motion Trajectories and Its Application to Hand Gesture Recognition [J], IEEE Transactions on Pattern Analyze Machine Intelligence, 2002, 24(8): 1061-1074.
    [50] Johannes Sch?ning, Michael Rohs, Antonio Krüger, Using Mobile Phones to Spontaneously Authenticate and Interact with Multi-Touch Surfaces[C], PPD 2008: Workshop on Designing Multi-touch Interaction Techniques for Coupled Public and Private Displays, as part of AVI 2008, May 2008, Naples, Italy:41-45.
    [51] Philip L. Davidson, Jefferson Y. Han, Synthesis and Control on Large Scale Multi-touch Sensing Displays[C], Proceedings of the 2006 Conference on New Interfaces for Musical Expression, Paris, France, 2006: 216 - 219.
    [52] Hrvoje Benko, Andrew D. Wilson, Patrick Baudisch, Precise Selection Techniquesfor Multi-Touch Screens[C], CHI 2006, Montréal, Québec, Canada, Apr. 2006:1263-1272.
    [53] Nima Motamedi. HD Touch: Multi-touch and Object Sensing on a High Definition LCD TV [C], Extended Abstracts of ACM Conference on Human Factors in Computing Systems, CHI '08, Florence,Italy, Apr,2008.
    [54] Bill Buxton, Surface and Tangible Computing, and the "Small" Matter of People and Design, Solid-State Circuits Conference[C], (ISSCC 2008), Digest of Technical Papers, IEEE International, San Francisco, CA, USA, Feb. 2008: 24-29.
    [55] Alan Esenther, Kent Wittenburg, Multi-User Multi-Touch Games on DiamondTouch with the DTFlash Toolkit[J], Intelligent Technologies for Interactive Entertainment (INTETAIN), Madonna di Campiglio, Italy, November 2005: 315-319.
    [56] Kathy Ryall, Meredith Ringe, Morris, Katherine Everitt, Clifton Forlines, Chia Shen,Experiences with and Observations of Direct-Touch Tabletops[C], Tabletop 2006: 89-96.
    [57] Andrew Woolls-King,Making electronic games more sociable[R],Philips Research Password ,Issue 26 , February 2006,24-27.
    [58] SMART Technologies.“Digital Vision Touch Technology.”White Paper[EB/OL], http://www.smarttech.com/dvit/DViT_white_paper.pdf. February 2003.
    [59]马颂德,张正友,计算机视觉:计算理论与算法基础[M].北京:科学出版社,1998, 60-63.
    [60]尹文生,罗瑜林,李世其,基于OpenCV的摄像机标定[J],计算机工程与设计,2007,28(1):197-199.
    [61] Jean-Yves Bouguet, Camera Calibration Toolbox for Matlab[EB/OL], http://www.vision.caltech.edu/bouguetj/calib_doc/.
    [62]吴福朝,计算机视觉中的数学方法[M],北京:科学出版社, 2008年3月,1-1,p54-2.
    [63] Torr P H S. A structure and motion toolkit in matlab[R]. Microsoft Research Technical Report, MSR-TR-2002-56, 2002 , Cambridge, UK,http://research.microsoft.com/?philtorr/.
    [64]陈泽志,吴成柯,一种高精度估计的基础矩阵的线性算法[J],软件学报,2002,13(04):840-845.
    [65]王伟,吴成柯.估计基础矩阵的6点综合算法[J].中国科学(E辑),1997,27(2):165 -170.
    [66]胡明星,袁保宗,唐晓芳,基于遗传算法不同策略下的基础矩阵估计方法[J],计算机研究与发展,2002,39(12):1604-1612.
    [67]胡明星,袁保宗,唐晓芳,基于混合遗传算法的对极几何估计[J],电子学报,2003,31(10):1481-1485.
    [68]李宏言,盛利元,闻姜,娄继冰,基于改进遗传算法的基础矩阵估计方法[J],计算机工程与应用,2006, 34:57-59,91.
    [69]深圳市朱宁伟业数码科技有限公司,快乐e族[EB/OL],www.znwydz.com.
    [70]郭杰锋,陈桂林,云天背景下单帧红外图像的点目标检测[J],激光与红外,2007,37(9):898-901.
    [71]周成,季云松,赵毅,一种单帧图像红外弱小目标检测算法及DSP实现[J],激光与红外,2009,39(12) .
    [72]彭嘉雄,周文琳.红外背景抑制与小目标分割检测[J],电子学报,1999,12,27(12).47-51.
    [73]陈朝阳,张桂林.提高红外点目标图像单帧检测概率的背景抑制法[J].华中理工大学学报,1997, 27(6):21-24.
    [74]冈萨雷斯,伍兹.阮秋琦,阮宇智等译,数字图像处理(第二版)[M],北京:电子工业出版社,2007.
    [75]管志强,陈钱,钱惟贤,胡永,一种背景自适应调整的弱点目标探测算法[J],光学学报,2007,27(12):2163-2168.
    [76]叶斌,彭嘉雄,基于形念学Top-hat算子的小目标检测方法[J],中国图像图形学报,2002,7(7):638-642.
    [77]宗思光,王江安,多尺度形态算子融合图像滤波技术及滤波质量评价[J],光学学报,2005,25(9):1176-1180.
    [78]曾明,李建勋,基于改进遗传算法优化的形态学修正TOP-HAT滤波器设计方法[J],光学学报,2006,26(4):510-515.
    [79]温佩芝,史泽林,于海斌,基于小波变换的复杂海面背景红外小目标检测[J],激光与红外,20003,33(6):449-452.
    [80]徐永兵,裴先登,夏涌,基于向量小波变换及Fisher算法的红外弱小目标检测[J],红外技术,2004,26(1):17-24.
    [81]顾静良,万敏,张卫,郑捷,基于小波变换和数掘融合技术的弱小目标检测[J],强激光与粒子束,2005,17(7):983-986.
    [82]温晓君,海杂波背景下基于神经网络的目标检测[J],系统仿真学报,2007,19(7):1639-1641.
    [83]章敏晋,图像处理和分析技术-2版[M],北京:高等教育出版社,2008年3月第二版,页码.
    [84]魏伟波,芮筱亭,图像边缘检测方法研究[J],计算机工程与应用,2006,42(30):88-9l.
    [85]张而飞,王东峰,时永刚,邹谋炎,基于形变模型的图像分割技术综述[J],电子与信息学报,2003,25(3):395-403.
    [86]张翔,刘媚洁,陈立伟,基于数学形态学的边缘提取方法[J],电子科技大学学报,2002,31(5):492-495.
    [87]同武勤,凌永顺,黄超超,杨华,樊祥,数学形态学和小波变换的红外图像处理方法[J],光学精密工程,2007,15(1):138-144.
    [88]韩思奇,王蕾,图像分割的阈值法综述[J],系统工程与电子技术,2002,24(6):91-94.
    [89]尹显东,姚军,李在铭,基于BP神经网络的图像感兴趣区自动检测技术[J],系统工程与电子技术,2006,28(2):192-195,287.
    [90]杨治明,王晓蓉,彭军,陈应祖,BP人工神经网络在图像分割中的运用[J],计算机科学,2007,34(3),234-236.
    [91]何伟,蒋加伏,齐琦,基于粗糙集理论和神经网络的图像分割方法[J],计算机工程与应用,2009,45(1):188-190.
    [92]李国嵩,孟卫华,基于小波变换的目标边缘搜索分割方法[J],红外与激光工程,38(1):185-188.
    [93]王振华,陈杰,窦丽华,基于空域多分辨分析的小波变换图像分割方法[J],模式识别与人工智能,2008,21(2):93-198.
    [94]吴一全,吴文怡,罗子娟,基于最小一乘和遗传算法的红外弱小目标检测[J],系统王程与电予技术,2009,31(3):575-578.
    [95]张怀柱,向长波,宋建中,乔双,改进的遗传算法在实时图像分割中的应用[J],光学精密工程,2008,16(2):333-337.李康顺,李茂民,张文生,一种改进遗传算法的图像分割方法[J],计算机应用研究,2009,26(11):4364-4367.
    [97]侯叶,郭宝龙,基于图论的运动对象分割[J],吉林大学学报(工学版),2008,38(4):902-906.
    [98]冯林,孙焘,吴振宇,管慧娟,基于分水岭变换和图论的图像分割方法[J],仪器仪表学报,2008,29(3):649-653.
    [99]刘锁兰,王江涛,王建国,杨静字,一种新的基于图论聚类的分割算法[J],计算机科学,2008,35(9):245-247.
    [100] Collins R, Lipton A, Kanade T, et al. A system for video surveillance andmonitoring:VSAM final report[R]. Pittsburgh, Peen, America: Carnegie MelonUniversity, 1999.
    [101]林洪文,姚作樑,涂丹,李国辉,基于减背景技术的运动目标检测方法研究[J],国防科技大学学报,2003 ,25 (3):66-69.
    [102] Haritaoglu I, Harwood D, Davis L. W4: Real-time surveillance of people and theiractivities[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2000,22(8): 809-830.
    [103] Stauffer C, Eric W, Grimson L. Learning patterns of activity using real timetracking[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2000,22(8): 747-757. .
    [104] Allili M S, Bouguila N, Ziou D. A robust video foreground segmentation by usinggeneralized gaussian mixture modeling[C]. In Fourth Canadian Conference onComputer and Robot Vision, 2007: 503-509. .
    [105] Stenger B, Ramesh V, Paragios N. Topology free hidden markov models:Application to background modeling[C]. In Proceedings of IEEE InternationalConference on Computer Vision, Vancouver, Canada: 2001, 1: 294-301.
    [106] Kim K, Chalidabhongse T H, Harwood D. Background modeling and subtraction byCodebook construction[C]. In Proceedings of IEEE International Conference onImage Processing, Singapore: 2004: 3061-3064.
    [107]包红墙,张兆扬.基于时空标记场最大后验概率的多视频目标分割算法[J].电子与信息学报. 2006, 26(2): 232-236. .
    [108] A. Murat Tekalp著,崔之祜,江春,陈丽鑫译.数字视频处理[M].北京,电子工业出版社, 1998.
    [109]罗寰,于雷,廖俊,穆中林,复杂背景下红外弱小多目标跟踪系统[J],光学学报,2009,29(6):1536-1541.
    [110] Singer R.A.,Sea R.G. ,Housewright K.B.,A new filter for optimal tracking in densemultitarget environment[C], proceedings of the ninth Allerton conference on circuitand system theory,urbana, Urbana-Champaign(USA):Univ of Illinois,1971:201-211.
    [111]田宏伟,敬忠良,胡士强,李建勋,基于多速率运动模型的多帧最近邻数据关联算法[J],上海交通大学学报,2005, 39(3):413-416.
    [112]涂虬,许毅平,周曼丽,基于全局最小化活动轮廓的多目标检测跟踪[J],计算机应用研究,2010,27(2):794-797.
    [113] Bar-Shalom Y, Fortman T E. Tracking and data association [M] . New York :Academic , 1998 : 151 - 163.
    [114] Jaffer A.J. ,Bar-Shalom Y. ,on optimal tracing in multiple target environments[C],proceedings of the third Symposium on Non-Linear Estimation theory and its applications, San Diego, CA, September 1972:112-117.
    [115]秦卫华,胡飞,秦超英,一种简化的联合概率数据关联算法[J],西北工业大学学报,2005,23(2):276-279.
    [116]巴宏欣,赵宗贵,杨飞,曹雷,多传感器多目标跟踪的JPDA算法[J],系统仿真学报,2004,16(7):1563-1566
    [117]李辉,张安,赵敏,庞勤,沈莹,基于两点式数据关联算法的多机动目标跟踪[J] ,电子学报, 2005, 33 (12) :2125 - 2129.
    [118]李辉,张安,赵敏,沈莹,两点式数据关联算法在多目标跟踪中的应用[J],兵工学报,2007,28(5):633-637.
    [119] Reid D B.An algorithm for tracking multiple targets[J].IEEE Transactions on Automatic Control,1979,24(6):583-854..
    [120] S. S. Blackman, Multiple hypotheses tracking for multiple target tracking [J], IEEE Trans. ON Aerospace and Electronic Systems Magazine, 2004, 19(1):5-18.
    [121] R. Danchick and G.E. Newnam, A Fast Method for Finding the Exact N-Best Hypotheses for Multitarget Tracking[J], IEEE Trans. Aerospace and Electronic Systems, 1993,29(2):555-560.
    [122] H. T. Nguyen, J. Qiang, and A. W. M. Smeulders, Robust multi-target tracking using spatio-temporal context, in Computer Vision and Pattern Recognition[C], 2006 IEEE Computer Society Conference on, 2006, pp. 578-585.
    [123] Sengupta, D.; Iltis, R. A., Neural Solution to the Multi-target Tracking Data Association Problem [J],IEEE Transactions on Aerospace and Electronic Systems, 1989, 25(1): 96-108.
    [124]敬忠良,张国伟,周宏仁.随机神经网络在机动多目标跟踪中的应用[J].航空学报,1994 , 15 (7) : 812 - 818.
    [125]范凯,陶然,周思永.基于神经网络数据融合的目标跟踪简化算法[J].系统工程与电子技术,2001,23(3):82-84.
    [126]窦丽华,杨国胜,陈杰,陈立潮,多目标数据关联的神经网络方法[J],火力与指挥控制,2002,27(4):28-33.
    [127] Kettnaker V, Zabih R. Bayesian multi-camera surveillance[C]. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 1999, Fort Collins, Colourado, 2253-2259.
    [128] Makris D, Ellis T, and Black J. Bridging the gaps between cameras[C]. In Conference on Computer Vision and Pattern Recognition, 2: 205-210, Washington, DC, USA, 2004.
    [129] Porikli F, Divakaran A. Multi-camera calibration, object tracking and query generation[C]. In Proceedings of International Conference on Multimedia and Expo, 1: 653-656, Baltimore, Maryland, 2003.
    [130] Javed O, Rasheed Z, Shafique K, et al. Tracking across multiple cameras with disjoint views[C]. In ICCV 2003, 952-957.
    [131] Bi Song, Amit K, Roy-Chowdhury. Stochastic adaptive tracking in a camera network[C]. In IEEE ICCV 2007, 1-8.
    [132] Khurram S, Mubarak S. A non-iterative greedy algorithm for multi-frame point correspondence [J], IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27(1): 51-65.
    [133]刘少华,张茂军,陈旺,无重叠视域多摄像机的数据关联算法[J],计算机应用,2009,29(9):2378-2382.
    [134]何援军,图形变换的几何化表示[J],计算机辅助设计与图形学学报,2005,17(4):723-728.
    [135]彭宇新,Ngo Chong-Wah,肖建国,一种基于二分图最优匹配的镜头检索方法[J],电子学报,2004,32(7),1135-1139.
    [136]刘少华,非重叠监控摄像机网络中运动目标检测与跟踪[D],国防科学技术大学博士学位论文,2010.1.
    [137] Mark Micire, Munjal Desai, Amanda Courtemanche, Katherine M. Tsui, Holly A.Yanco, Analysis of Natural Gestures for Controlling Robot Teams on Multi-touchTabletop Surfaces[C], ITS '09 :Proceedings of the ACM International Conference onInteractive Tabletops and Surfaces, Banff, Alberta, Canada, November 2009:41-48.
    [138] Wu M., Shen C., Ryall K., Forlines C., Balakrishnan R., Gesture Registration,Relaxation, and Reuse for Multi-point Direct-touch Surfaces[C], TABLETOP 2006:Proceedings of the First IEEE International Workshop on Horizontal InteractiveHuman-Computer Systems, Adelaide, Australia 2006:183-190.
    [139] Elias, G., Westerman, C., Haggerty, Myra Mary. Multi-touch Gesture Directory [P],United States Patent Application: 20070177803,2007.
    [140] Songyang Lao,Xiang’an Heng,Guohua Zhang,Yunxiang Ling, Peng Wang,AGestural Interaction Design Model for Multi-touch Displays[C], Proceedings of the2009 British Computer Society Conference on Human-ComputerInteraction,Cambridge,United Kingdom,2009:440-446.
    [141]纪连恩,张凤军,付永刚,戴国忠,虚拟环境下基于语义的三维交互技术[J],软件学报, 2006. 117(7): 1535-1543.
    [142]侯阿临,张志芳,周鹏,王楠,王明明, MPEG-7视觉区域形状描述子的商标图像检索[J],现代电子技术,2009,32(8):84-86,96.
    [143]魏怡,何一伟,倪海峰,张蔚,形状描述方法在图像检索中的应用综述[J],系统工程与电子技术,2009,31(7):1755-1762.
    [144] D. S. Zhang and G. Lu, Review of Shape Representation and DescriptionTechniques[J]. Pattern Recognition, 37(1):1-19, 2004.
    [145] Oliver Bimber,Continuous 6dof Gesture Recognition:A Fuzzy Logic Approach[C],in Proceedings of VII International Conference in Central Europe on ComputerGraphics, Visualization and Interactive Digital Media,Campus Bory, Plzen -Bory,Czech Republic,1999:24-30.
    [146] Allen, J., G. Ferguson, Actions and Events in Interval Temporal Logic [M], Spatialand Temporal Reasoning, Oliveiro Stock: Kluwer Academic Publishers,1997:205-245.
    [147]邓志鸿,唐世渭,张铭等.ontology研究综述[J].北京大学学报(自然科学版),2002,38(5):730一738..
    [148]白亮,本体支持的视频情报分析方法与技术研究[D],国防科技大学博士学位论文,2008年10月.
    [149]谭立球,基于本体的图像检索相关技术研究[D],中南大学博士学位论文,2009年5月.
    [150]袁燕妮,基于本体的电信产品信息融合服务框架研究与实践[D],北京邮电大学博士学位论文,2008年1月.
    [151] W3C. OWL Web ontology language overview[ EB/ OL] . (2004-02-10) . http: / /www. w3. org/ TR/2004 /REC-owl-features- 20040210 / .
    [152]陆梦嫣,朱国进,贺佳琳,管理信息系统业务流程的OWL本体模型[J],计算机应用研究,第2007,24(9):61-63.
    [153] Standford University,Protege[EB/OL],http://protege.stanford.edu/.
    [154] Standford University,Reasoners[EB/OL],http://protegewiki.stanford.edu/wiki/Using_Reasoners.
    [155] Dmitry Tsarkov,Ian Horrocks,OWL:FaCT++[EB/OL],http://owl.man.ac.uk/factplusplus/.
    [156] Ronald Poppe, A Survey on Vision-based Human Action Recognition[J], Image and Vision Computing,28,2010:976-990.
    [157]王西颖,戴国忠,张习文等,基于HMM-FNN模型的复杂动态手势识别[J]. 2008. 19(9): 2302-2312.
    [158]刘江华,陈佳品,程君实,基于光流及耦合隐马尔可夫模型的动态手势识别[J].上海交通大学学报, 2003,37(5): 720-723.
    [159] Davis and M. Shah, Visual gesture recognition,Vision[J], Image and Signal Processing, vol. 141, 1994, no. 2, pp. 101-106.
    [160] P. Hong, M. Turk, and T. Huang, Constructing finite state machines for fast gesture recognition[C], in Proc. IEEE Intel Conf. on Pattern Recognition (ICPR '00), 2000, Vol3, pp .:691-694.
    [161] M.-H. Yang and N. Ahuja, Recognizing Hand Gestures Using Motion Trajectories[C], In Proceedings of the 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 99), Fort Collins, v 1, p 466-472, 1999.
    [162]任海兵,祝远新,徐光祐等,连续动态手势的时空表观建模及识别[J],计算机学报, 2000. 23(8): 824-828.
    [163] M.J. Black, A.D. Jepson, A probabilistic framework for matching temporal trajectories : CONDENSATION-based recognition of gestures and expressions [C],ECCV'98, Proceedings of the 5th European Conference on Computer Vision; 1998 June 2-6; Freiburg, Germany.: Springer-Verlag; 1998; 1: 909-924.
    [164] M.J. Black, A.D. Jepson,Recognizing temporal trajectories using the Condensation algorithm[C], Int. Conf. on Automatic Face and Gesture Recognition, Nara, Japan, 1998, pp. 16-21.
    [165] S. McKenna, S. Gong, Gesture recognition for visually mediated interaction using probabilistic event trajectories[C], British Machine Vision Conference(BMVC’98), Southampton, UK, 1998, vol. 2,pp498-507.
    [166] Shin, M.C., Tsap, L.V. and Goldgof, D.B., Gesture recognition using Bezier curves for visualization navigation from registered 3D data[J]. Pattern Recognition, 2004,37(5): 1011-1024.
    [167] Aaron F. Bobick, James W. Davis,The Recognition of Human Movement using Temporal Templates[J],IEEE Transactions On Pattern Analysis and Machine Intelligence,23(3),2001:257-267.
    [168] M.K. Bhuyan, D. Ghosh, P.K. Bora,Estimation of 2D Motion Trajectories from Video Object Planes and Its Application in Hand Gesture Recognition[C],PReMI'05:First International Conference on Pattern Recognition and Machine Intelligence ,Indian Statistical Institute, Kolkata, December 18-22, LNCS 3776, 2005:509-514.
    [169] M.K. Bhuyan, D. Ghosh, P.K. Bora,Feature Extraction from 2D Gesture Trajectory in Dynamic Hand Gesture Recognition[C],IEEE Conference on Cybernetics and Intelligent Systems, Bangkok, Thailand,Volume 2,2006:1-6.
    [170]周航,基于计算机视觉的手势识别系统研究[D],北京交通大学,博士学位论文, 20071101.
    [171] Sylvie Jeannin, Ajay Divakaran,MPEG-7 Visual Motion Descriptors[J], IEEE Transactions on Circuits and Systems for Video Technology, 11(6),2001:720-724.
    [172]王涛,刘文印,孙家广,张宏江,傅立叶描述子识别物体的形状[J],计算机研究与发展, 2002,39(12):1714-1719.
    [173]张良国,吴江琴,高文,姚鸿勋,基于Hausdorff距离的手势识别[J],中国图像图形学报.2002,7(7):1144-1150.
    [174] Ryan Schmidt,Karan Singh,Ravin Balakrishnan,Sketching and composing widgets for 3D manipulatin[J],Computer Graphics and Forum,2008,27(2):301-310.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700