面向多自由度机器人的非受限智能人机交互的研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
随着人类对未知领域(太空或深海等)的探索欲望增加以及某些高危工作的需求,用于人类不可到达和未知环境的远程机器人已得到广泛关注。为了使远程机器人准确安全地完成任务并且实现人类与远程机器人和谐交流的目标,在远程机器人的诸多关键技术中,人机交互、智能辅助和信息感知三方面尤为重要,成为确保远程机器人能否完成任务的先决条件。
     本文提出的面向多自由度机器人的智能人机交互模型研究旨在从一个崭新的角度研究如何更自然,更直观有效地与多自由度机器人打交道,让人与机器人的交流犹如人与人交流一样自然流畅,并尽可能地缩短人机之间的交互距离,交互延时,扩大了人机之间的交互带宽。面向多自由度机器人的智能人机交互技术是通过将认知科学、计算机科学、机械科学、人工智能技术、生命科学等多种学科交叉结合起来,对人机交互中的交互行为、交互方式、机器辅助模型和人机协作模型等要素进行研究,充分发挥机器的智能性与自主性、人类的主导性和能动性,实现人机优势互补,互相协作的一门技术。本文的创新性成果包括:一是深入研究面向多自由度机器人交互的发展与趋势,根据面向多自由度机器人的交互特性分析与对比了各种人机交互方式在多自由度机器人交互过程中的优势与不足;二是提出了基于三维手势的面向多自由度机器人交互模型,相对其他交互方式,该模型能快速实时地对多自由度机器人进行高效率交互;三是深入研究了多智能体协作模型技术,对智能体的特征、智能体的推理规则和智能体的协作机制进行了详细的描述,提出了异态智能体的协作模型,可以有效地结合人类与机器人的各自优势,达到取长补短的效果;四是提出了多种智能辅助方法,针对多自由度机器人的特点,从多自由度机器人的路径规划方面,安全保障方面、操作辅助方面进行了深入的研究,提出了多种智能辅助模型,确保多自由度机器人在非机构化环境中具有一定的自主性,既能确保自身的安全,又能辅助用户完成高难度作业。五是详细地分析了人与机器在感知方面的特点,比较了人与机器在感知方面各自的优缺点,从而建立了分工与合作模型,划分了不同的感知任务,分工明确,互相协作;六是提出了面向多自由度机器人的智能人机交互模型,对智能人机交互模型中的交互空间进行了深入的分析,在此基础上,提出了面向决策的分层模型,能有效地解决人类和多自由度机器人之间的协调问题。
     本文作者在博士期间先后参加了多个国家863予项目,并在这些项目中在研究面向机器人的自然人机交互技术以及面向机器人的智能辅助技术方面做了大量的工作,取得了很多重要的成果,包括发表了多篇国际学术论文和申请了多个国家发明专利。本文作者在参与项目的研发和开发的基础上,基于项目的研究成果对面向多自由度机器人的智能人机交互模型进行了深入的研究,并结合实际情况应用于各项科研实体,验证了该模型的有效性。
An increase in demand for certain high-risk work with the human desire to explore uncharted territory, remote robot which used in humans can not be reached and an unknown environment (space or deep sea) has received extensive attention by many researchers. In order to make the remote robot can accurately and safely complete the task and the remote robot can harmoniously communicate with humans, in many of the key technologies of remote robot, human-computer interaction, intelligent assistance and information perception is particularly important, become a prerequisite to ensure that the remote robot able to complete the task.
     This paper proposed a multi-degree of freedom robot intelligent human-computer interaction model aimed at from a new perspective to study how more natural, more intuitive and effective in dealing with multi-degree-of-freedom robot. Let the human and robot communication as natural and smooth as the communication between people. And shorten the distance of the interaction between man and machine, reduce the interaction delay, expand the bandwidth of the interaction between man and machine. Intelligent human-computer interaction techniques for multi-degree-of-freedom robot combine cognitive science, computer science, mechanical science, artificial intelligence technology, life sciences and other interdisciplinary interaction in the human-computer interaction, interactionmachine-assisted models and human-machine collaboration model elements, give full play to the machine intelligence and autonomy, human-led initiative to achieve human-computer complementary advantages, mutual collaboration of a technology. The innovative achievements of this paper include:1. First, in-depth study for the development of multi-degree-of-freedom robot interaction and trends, based on the analysis of the interactive features of the multi-degree-of-freedom robot and contrast the advantages and disadvantages of a variety of human-computer interaction in multi-degree-of-freedom robot interaction; is proposed based on3D gestures for multi-degree of freedom robot interaction model, relative to other interactions, the model can be quickly and in real-time for efficient interaction of multi-degree-of-freedom robot, depth study of multi-agent collaboration model, characteristics of the agent, the agent's inference rules and the agent coordination mechanism is described in detail, the different states of agent collaboration model, humans and robots can effectively combine their respective advantages, to achieve the effect of each other; Fourth, a variety of intelligent helper methods were proposed, including the characteristics of multi-degree-of-freedom robot, the multi-degree-of-freedom robot path planning, security, operating auxiliary conducted in-depth research, made a variety of intelligent auxiliary model, ensure freedom Manipulators non-institutional environment has a certain autonomy, both to ensure their own safety, but also to assist the user to complete a difficult job. Fifth, a detailed analysis of the characteristics of man and machine perception, comparison between man and machine in the perception of the respective advantages and disadvantages, so as to establish a division of labor and cooperation models, divided into different perceptual tasks, a clear division of labor, mutual collaboration; Sixth, this paper proposed for multi-degree-of-freedom robot intelligent human-computer interaction model, and conducted in-depth analysis of the interaction space intelligent human-computer interaction model, on this basis, a decision-oriented hierarchical model can effectively solve the problem of coordination between the human and multi-degree-of-freedom robot.
     The author has participated in during Dr. countries and863sub-projects, and study the robot natural person-machine interactive technology and the robot intelligent assistive technology has done a lot of work in these projects, has made a number of important results, including the publication of the international academic and applied for a number of national invention patents. Author of this article on the basis of the R&D and development of participating in the project, project-based research on intelligent human-computer interaction model for multi-degree-of-freedom robot in-depth research, combined with the actual situation applied to various research entities to verify the the validity of the model.
引文
[1]方志刚.人机交互技术综述.人类工效学,1998,4(3):64-66
    [2]姚英学.大型产品虚拟装配系统中人机交互关键技术的研究.哈尔滨工业大学博士论文,2006
    [3]化建宁,符秀辉,郑伟,等.基于运动描述语言的轮式移动机器人控制.机器人,2006,28(3):316-320
    [4]李瑞峰,吕开元.基于图形编程技术的服务机器人人机交互系统的研究.制造业自动化,2003年,3(4):40-43
    [5]Chang. S, Kim. J, Kim. I, etal. KIST teleoperationsystem for humanoid robot. Proc.1999 IEEE/RSJ Int. Conf. Intelli-gent Robots and Systems,1999:1198-1203
    [6]Harada. T, Sato. T, Mori. T. Human motion tracking system basedon skeleton and surface integration model using pressure sensors distri-bution bed. Proc. Workshop Human Motion (HUMO'00),2000:99-106
    [7]Tezuka. T, Goto. A, Kashiwa. K, etal. Astudy on space interface for teleoperation system. Proc. IEEE Int.Workshop Robot and Human Communication,1994:62-67
    [8]Bachmann. E. R, McGhee. R. B, Yun. X, etal. Inertial andmagnetic posture tracking for inserting humans into networked virtualenvironments. Proc. ACM Symp. Virtual Reality Software and Tech-nology (VRST), Banff, AB, Canada,2001:9-16
    [9]Fukuda. O, Tsuji. T, Kaneko. M, etal. A human-assisting manipulator teleoperated by EMG signals and arm motions. IEEE Trans Robot. Autom, April 2003, vol.19(2): 210-222
    [10]李刚,黄席樾,袁荣棣,等.以人为中心的机器人系统的人机交互技术.重庆大学学报,2003,26(5):59-63
    [11]Matthew Turk, Mathias Kolsch. Perceptual Interfaces. University of California, Santa Barbara, Technical Report,2003
    [12]王坚,董士海,等.基于自然交互风格的多通道人机交互模型.计算机学报,1996,19(增)
    [13]Ian H S Cullimbre. An analysis and implementation of informal Human-Computer Interaction. Cognitive and Computing Sciences, The University of Sussex, May 2000.
    [14]普建涛,陈文广,王衡,等.多通道用户界面关键技术和未来发展趋势研究.计算机研究与发展,2011,38(6):684-691
    [15]http://blog.sciencenet.cn/home.php?COLLCC=1861810720&mod=space&uid=39479& do=blog&id=332668
    [16]韩纪庆,张磊,吕成国,等.可穿戴计算机中的语音处理技术.计算机科学,2002,29(5):107-109
    [17]孙正兴,冯桂焕,周若鸿.基于手绘草图的人机交互技术研究进展.计算机辅助设计与图形学学报,2005,17(9):1891-1899
    [18]管业鹏.基于立体视觉的非穿戴指势识别.控制理论与应用,2009,26(12):1345-1350
    [19]Du Guanglong, Zhang Ping(张平),Mai Jianhua, etal. Markerless Kinect-Based Hand Tracking for Robot Teleoperation. INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS(SCI),2012, vol(9)
    [20]DU GUANG-LONG, ZHANG PING(张平),Mai Jianhua, etal-Robot Teleoperation Using a Vision-Based Manipulation Method. International Conference on Audio. Language and Image Processing,2010:945-949
    [21]Picard R D.情感计算.北京理工大学出版社,2005
    [22]胡龙娇,张智君.人机交互行为中的情绪研究现状与展望.人类工效学,2010,16(4):87-90
    [23]刘遥峰,王志良.基于情感交互的仿人头部机器人.机器人,2009,31(6):493-500
    [24]李善青.基于穿戴视觉的人机交互技术.北京理工大学博士论文,2010
    [25]
    [26]ZHANG ping(张平),DU guang-long. A Fast Continuous Collision Detection Algorithm Based on K_DOPs. International Conference on Electronics. Communications and Control,2011:617-621
    [27]M.A.L. Nicolelis. Action from thoughts. Nature,2001, vol.409:403-407
    [28]Hoshino.K. Dexterous robot hand control with data glove by human imitation. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS,2006, vol.89(6):1820-1825
    [29]Tran.NX. Wireless Data Glove for Gesture-Based Robotic Control.13th International Conference on Human-Computer Interaction, JUL 19-24,2009, vol.5611:271-280
    [30]Bachmann, Eric.R, McGhee.R.B, etal. Inertialand magnetic posture tracking for inserting humans into networked virtual environments. ACM Symposium on Virtual Reality Software and Technology (VRST), Banff, Canada,2001:9-16
    [31]Pe'rie'.D, Tate.A.J, Cheng.P.L, etal. Evaluation and calibration ofan electromagnetic tracking device for biomechanical analysis of lifting tasks. Journalof Biomechanics, 2002, vol.35(2):293-297
    [32]Verplaetse.C. Inertial proprioceptive devices:self-motion-sensing toys and tools. IBMSystems Journal,1996, vol.35(3):639-650
    [33]Harada, Tatsuya, Tomomasa Sato, etal. Human motion tracking system based on skeleton and surface integration model using pressure sensors distributionbed. Workshop on Human Motion (HUMO'00),2000:99-106
    [34]Chang.S, Kim.J, Kim.I, etal. KIST teleoperation system forhumanoid robot. Proceedings 1999 IEEE=RSJ International Conference on IntelligentRobots and Systems,1999:1198-1203
    [35]Chaudhari, Ajit. M, Bragg.R.W, etal. A video-based markerless motion tracking system for biomechanical analysis in an arbitrary environment. BED-50 Bioengineering Conference,2001:777-778
    [36]Lathuilie're, Fabienne, Jean-Yves Herve'. Visual hand posture tracking in a gripperguiding application. Proc. Int. Conf. Robotics and Automation (ICRA),2000: 1688-1694
    [37]Du Guanglong, Zhang Ping(张平),Mai Jianhua, etal. MarkerlessKinect-Based Hand Tracking for Robot Teleoperation. INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS,2012, vol.9
    [38]Bullock, Dave.J, Zelek.J.S. Real-time tracking for visual interface applicationsin cluttered and occluding situations. Image and Vision Computing,2004, vol.22:1083-1091
    [39]Al-Mouhamed, Toker.M.A.O, Abdulkhalik Al-Harthy. A 3-D vision-based man-machine interface for hand-controlled telerobot. IEEE Transactions on Indus-trial Electronics,2005, vol.52(1):306-319
    [40]Kurpjuhn, Tobias Peter, Kevin Nickels, etal. Development of a visual space-mouse. Proc. Int. Conf. Robotics and Automation (ICRA),1999:3230-3235
    [41]Cipolla, Roberto and Nicholas J. Hollinghurst. Human-robot interface by pointing withuncalibrated stereo vision. Image and Vision Computing,1996, vol.14:171-178
    [42]Hu, Chao, Max QinghuMeng, Peter Xiaoping Liu, and Xiang Wang. Visual gesturerecognition for human-machine interface of robot teleoperation. IEEE=RSJ InternationalConference on Intelligent Robots and Systems, USA,2003:1560-1565
    [43]Coquin, Didier, E. Benoit, H. Sawada, and BogdanIonescu. Fusion of hand and armgestures. In Optomechatronic Machine Vision, ed. by K. Sumi, Proceedings InternationalSociety for Optical Engineering (SPIE) 6051,60510E,2005:1-11
    [44]Jonathan Kofman, SiddharthVerma, Xianghai Wu. Robot-Manipulator Teleoperation by Markerless Vision-Based Hand-Arm Tracking. International Journal of Optomechatronics,2007, vol.1:331-357
    [45]Acampora, G, Cadenas, JM, Loia, V. A Multi-Agent Memetic System for Human-Based Knowledge Selection. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART A-SYSTEMS AND HUMANS,2011, vol.41(5):946-960
    [46]J.D.Cohen, M.C.Lin, D.Manocha and M.K.Ponamgi. I-COLLIDE; An Interactive and Exact Collision Detection System for Large-Scale Environments. In:Proceedings of ACM Interactive 3D Graphics Conference.1995:189-196.
    [47]I.J.Palmer % R .L.Grimsdale. Collision detection for animation using sphere-trees. Computer Graphics Forum,1995,14(2):105-116.
    [48]D.H.Ballard. Strip trees:A hierarchical representation for curves. ACM Communication, 1981,24(5):310-321.
    [49]魏迎梅。虚拟环境中碰撞检测问题的研究。国防科学技术大学研究生院工学博士学位论文。2000.
    [50]Luis M. Munoz, Alicia Casals. Improving the Human-Robot Interface Through Adaptive Multi-space Transformation. IEEE TRANSACTIONS ON ROBOTICS,2009, vol.25(5)
    [51]陈鹰,杨灿军.人机智能系统理论与方法,浙江大学出版社,2006
    [52]蒋再男,赵京东,刘宏.力反馈柔性虚拟夹具辅助遥操作.机器人,2011,vo1.33(6):687-690
    [53]L. B. Rosenberg, "Virtual fixtures:Perceptual tools for telerobotic manipulation,"in IEEE Vritual Reality International Symposium,1993, pp.76-82.
    [54]D. Hennekens, D. Constantinescu and M. Steinbuch. Continuous Impulsive Force Controller for Forbidden-Region Virtual Fixtures.2008 IEEE International Conference on Robotics and Automation Pasadena, CA, USA, May 19-23,2008.
    [55]A. Bettini, P. Marayong, S. Lang, A.M. Okamura, and G.D. Hager, "Vision-assisted control for manipulation using virtual fixtures", IEEE T Robotic, vol.20, no.6, Dec. 2004, pp.953-966.
    [56]H. Kang, Y. S. Park, T. F. Ewing, E. Faulring, and J. E. Colgate, "Visually and haptically augmented teleoperation in D&D tasks using virtual fixtures," in Proc. Amer. Nuclear Soc.10th Int. Conf. Robot. Remote Syst. Hazardous Environ.,2004, pp.466-471.
    [57]Henry C. Lin, Panadda Marayong etc. Portability and Applicability of Virtual Fixtures Across Medical and Manufacturing Tasks. Proceedings of the 2006 IEEE International Conference on Robotics and Automation Orlando, Florida-May 2006.
    [58]Otmane, S., Mallem, M. Active virtual guides as an apparatus for augmented reality based telemanipulation system on the Internet. Simulation Symposium,2000. (SS 2000) Proceedings.33rd Annual.
    [59]Payandeh, S., Stanisic, Z. On application of virtual fixtures as an aid for telemanipulation and training. Haptic Interfaces for Virtual Environment and Teleoperator Systems,2002. HAPTICS 2002. Proceedings.10th Symposium on Issue Date:2002.
    [60]Morikawa, H, Takanashi, N. Ground experiment system for space robots based on predictive bilateral control. Robotics and Automation,1996. Proceedings.,1996 IEEE International Conference on Issue Date:22-28 Apr 1996 On page(s):64-69 vol.1
    [61]Rodolfo Prada,Shahram Payandeh. On study of design and implementation of virtual fixtures. Virtual Reality (2009) 13:117-129
    [62]张斌,黄攀峰,刘正雄,朱建军,基于虚拟夹具的交互式空间机器人遥操作实验[J],宇航学报,February 2011,Vo1.32:446-450
    [63]蒋再男,刘宏,谢宗武等,3D图形预测仿真及虚拟夹具的大时延遥操作技术[J],西安交通大学学报,2008,42(1):78-81
    [64]熊璟,陈恳,夏泽洋,机器人辅助腹腔介入治疗的空间运动约束及控制策略[J],机器人,Nov,2009,Vo1.31(6):612-619
    [65]徐文福,刘厚德,李成,等.双臂空间机器人捕获运动目标的自主路径规划.机器人,2012,vo1.34(6):704-714
    [66]KAVRALU L E, SVESTKA P. Probabilistic roadmaps for path planning in high-dimensional configuration spaces[J].IEEE Transactions on Robotics and Automation, 1996.
    [67]Yu Tian, Lei Yan, Gun-Young Park, Seung-Ha n Yang, Young-Suk Kim, Sang-Ryong Lee, and Choon-Young Lee. Application of RRT-based local Path Planning Algorithm in Unknown Environment[s]. Proceedings of the 2007 IEEE International Symposium on Computational Intelligence in Robotics and Automation Jacksonville,2007, (25):456-459
    [68]周芳,朱齐丹,赵国良.基于改进快速搜索随机树法的机械手路径优化[J].机械工程.2011,47(11):31~35
    [69]刘国栋,谢宏斌,李春光.动态环境中基于遗传算法的移动机器人路径规划的方法[C].机器人,2003.25(4):328~330
    [70]王醒策,张汝波,顾国昌.基于势场栅格法的机器人全局路径规划[J].哈尔滨工程大学学报,2003,24(2):171~174
    [71]W. Warren, Global Path Planning Using Artificial Potential Fields[C]. Robotics and Automation,1989. Proceedings 1989 IEEE International Conference, vol.50, pp.316— 321,1989
    [72]Fei Chen, Pei Di, Jian Huang2, Hironobu Sasaki. Evolutionary Artificial Potential Field Method Based Manipulator Path Planning for Safe Robotic Assembly[C]. Micro-NanoMechatronics and Human Science,2009:232-238
    [73]吴宪祥,郭宝龙,王娟.基于粒子群三次样条优化的移动机器人路径规划算法[J].机器人,2009.31(6):556~560
    [74]杜广龙,张平.具预警功能机器人遥操作动态虚拟夹具的设计.华南理工大学学报,2012,vol.40(4):43-48
    [75]朴明波,付宜利,王树国.一种基于投影面的手术器械碰撞预警算法.机器人,2009,vol.31(2):124-130
    [76]杜广龙,张平.基于人工势场的机器人遥操作安全预警域动态生成方法.机器人,2012,34(1):44-49
    [77]朴明波,付宜利,王树国.一种基于投影面的手术器械碰撞预警算法[J].机器人,2009,31(2):124-130.
    [78]Piao M B, Fu Y L, Wang S G. An early warning algorithm for operation instruments collision based on projection plane[J]. Robot,2009,31(2):124-130.
    [79]丁富强,费燕琼,韩卫军,等.双臂SCARATES机器人实时无碰撞运动规划[J].上海交通大学学报,2003,37(11):1690-1693.
    [80]Ding F Q, Fei Y Q, Han W J, et al. Real-time collision-free motion plan of the dual-arm SCARATES robot[J]. Journal of Shanghai Jiaotong University,2003,37(11):1690-1693.
    [81]张祺,杨宜民.基于改进人工势场法的足球机器人避碰控制[J].机器人,2002,24(1):12-15.
    [82]Zhang Q, Yang Y M. Soccer robot collision avoidance control based on evolutionary artificial potential field[J]. Robot,2002,24(1):12-15.
    [83]Mabrouk M H, Mclnnes C R. Solving the potential field local minimum problem using internal agent states[J]. Robotics and Autonomous System,2008,56(12):1050-1060.
    [84]Zou X Y, Zhu J. Virtual local target method for avoiding local minimum in potential field based robot navigation[J]. Journal of Zhejiang University:Science A,2003,4(3): 264-269.
    [85]朱毅,张涛,宋靖雁.非完整移动机器人的人工势场法路径规划[J].控制理论与应用,2010,27(2):152-158.
    [86]Zhu Y, Zhang T, Song J Y. Path planning for nonholonomic mobile robots using artificial potential field method[J]. Control Theory & Applications,2010,27(2):152-158.
    [87]J Shotton, A Fitzgibbon, M Cook, etal. Real-Time Human Pose Recognition in Parts from a Single Depth Image. In CVPR,2011
    [88]Kofman, Jonathan, Xianghai Wu, etal. Teleoperation of a robot manipulator using a vision-based human-robot interface. IEEE Transactions on Industrial Electronics,2005, vol.52(5):1206-1219
    [89]Dorigo, Marco. Ant system:optimization by a colony of cooperating agents. IEEE Transactions on Systems, Man, and Cybernetics, Part B:Cybernetics,1996, vol.26(1): 29-41.
    [90]Luis M. Munoz, Alicia Casals. Improving the Human-Robot Interface Through Adaptive Multispace Transformation. IEEE TRANSACTIONS ON ROBOTICS, VOL. 25,(5),2009
    [91]P. M. Fitts, "The information capacity of the human motor system in controlling the amplitude of movement," J. Exp. Psychol., vol.47, no.6, pp.381-391, Jun.1954.
    [92]R. V. Dubey, S. E. Everett, N. Pernalete, and K. A. Manocha, "Teleoperation assistance through variable velocity mapping," IEEE Trans. Robot. Autom., vol.17, no.5, pp. 761-766, Oct.2001.
    [93]L. M. Mu-noz, A. Casals, J. Amat, M. Puig-Vidal, and J. Samitier, "Improved AFM scanning methodology with adaptation to the target shape," in Proc. IEEE Int. Conf. Robot. Autom., Barcelona, Spain, Apr.2005, pp.1529-1534.
    [94]Kofman, Jonathan, Xianghai Wu, TimothyLuu, and Siddharth Verma.2005. Teleoperation of a robot manipulator using a vision-based human-robot interface. IEEE Transactions on Industrial Electronics 52(5):1206-1219.
    [95]R. B. McGhee, "The factored quaternion algorithm for orientationestimation from m easured Earth g ravity and m agnetic field," MOVESInst., Naval Postgraduate School, Monterey, C A,2004, Tech. Memo. [Online]. Available: http://www.users.muohio.edu/bachmaer/Papers/Factored%20 Quaternion.pdf
    [96]E. R. Bachmann, X. Yun, D. McKinney, R. B. McGhee, andM. J. Zyda, "Design and implementation o f MARG sensors for3-DOF orientation m easurement o f r igid bodies," in Proc. IEEEInt. Conf. Robot. Autom., Taipei, Taiwan, R.O.C., May 2003, vol.1,pp.1171-1178
    [97]J. B. Ku ipers, Quaternions and Rotation Sequences. Princeton, NJ:Princeton Univ. Press,1999.
    [98]Seong-Hoon Peter Won, Farid Golnaraghi, and Wael William Melek. A Fastening Tool Tracking System Using an IMU and a Position Sensor With Kalman Filters and a Fuzzy Expert System. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, VOL.56, NO.5, MAY 2009.1782-1792.
    [99]Seong-hoon Peter Won, William Melek and Farid Golnaraghi. Fastening tool tracking system using a
    [100]Kalman filter and particle filter combination. MEASUREMENT SCIENCE ANDTECHNOLOGY.2011.
    [101]Seong-hoon Peter Won, Wael William Melek. A Kalman/Particle Filter-Based Position and Orientation Estimation Method Using a Position Sensor/Inertial Measurement Unit Hybrid System. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, VOL. 57, NO.5, MAY 2010.1787-1798.
    [102]Seong-hoon Peter Won, Wael William Melek, Farid Golnaraghi. A Kalman/Particle Filter-Based Position and Orientation Estimation Method Using a Position Sensor/Inertial Measurement Unit Hybrid System. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, VOL.57(5),2010.1787-1798.
    [103]Xiaoping Yun, E ric R. Bachmann, Robert B. McGhee. A Simplified Quaternion-Based Algorithm for Orientation Estimation From Earth Gravity and Magnetic Field Measurements. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, VOL.57, NO.3, MARCH 2008
    [104]D. H. Titterton and J. L. Weston, Strapdown Inertial Navigation Technology. London, U.K.:Peregrinus,1997.
    [105]J. C. K. Chou, "Quaternion kinematic and dynamic differential equations," IEEE Trans. Robot. Autom., vol.8, no.1, pp.53-64, Feb.1992.
    [106]James Diebel, "Representing attitude:Euler angles, Unit Quaternions, and Rotation Vectors," Matrix, Citeseer,2006.
    [107]S. P. Won, W. W. Melek, and F. Golnaraghi, "A fastening tool trackingsystem using an IMU and a position sensor with Kalman filters and a fuzzyexpert system,"IEEE Trans. Ind. Electron., vol.56, no.5, pp.1782-1792,May 2009.
    [108]C. Yuan and M. J. Druzdzel, "Theoretical analysis and practical insightson importance sampling in Bayesian networks," Int. J. Approx. Reason.,vol.46, no.2, pp.320-333, Oct.2007.
    [109]S. Thrun, W. Burgard, and D. Fox, Probabilistic Robotics. Cambridge,MA:MIT Press, 2005.
    [110]B.-T. Zhang, "A Bayesian framework for evolutionary computation," in Proc. Congr. Evol. Comput., Washington, DC, Jul.6-9,1999,pp.722-728.
    [111]S. Park, J. Hwang, K. Rou, and E. Kim, "A new particle filter inspiredby biological evolution:Genetic filter," Proc. World Acad. Sci., Eng.Technol., vol.21, pp.459-463, Jan.2007.
    [112]R. Fung and K. C. Chang, "Weighting and integrating evidence for stochastic simulation in Bayesian networks," in Proc.5th Conf. UncertaintyArtif. Intell., Windsor, ON, Canada, Aug.18-20,1989, pp.209-219.
    [113]K. Kanazawa, D. Koller, and S. J. Russell, "Stochastic simulation algorithms for dynamic probabilistic networks," in Proc.11th Annu. Conf.Uncertainty AI,1995, pp. 346-351.
    [114]方志刚,吴晓波,马卫娟.人机交互技术研究新进展.计算机工程与设计1998,19(1):59-65
    [115]董士海.人机交互的进展及面临的调整.计算机辅助设计与图形学学报,2004,16(1):1-13
    [116]徐光祐,陶霖密,史元春,等.普适计算模式下的人机交互.计算机学报,2007,30(7):1041-1053
    [117]马翠霞,任磊,滕东兴,等.云制造环境下的普适人机交互技术.计算机集成制造系统,2011,17(3):504-510
    [118]Kofman, Jonathan, Xianghai Wu, etal. Teleoperationof a robot manipulator using a vision-based human-robot interface. IEEE Transactionson Industrial Electronics,2005, vol.52(5):1206-1219
    [119]Hidayatullah, P. CAMSHIFT improvement on multi-hue object and multi-object tracking.2011 3rd European Workshop on Visual Information Processing (EUVIP).2011,143-148
    [120]Tavakoli, M, Cabrita, G, Faria, R. Cooperative multi-agent mapping of three-dimensional structures for pipeline inspection applications. IJRR,2012, vol.31(12): 1489-1503
    [121]Desaraju, VR, How, JP. Decentralized path planning for multi-agent teams with complex constraints. AUTONOMOUS ROBOTS,2012, vol.32(4):385-403
    [122]Yang, H. Jiang, B. Cocquempot, V. Zhang, HG. Stabilization of Switched Nonlinear Systems With All Unstable Modes:Application to Multi-Agent Systems. IEEE TRANSACTIONS ON AUTOMATIC CONTROL,2011, vol 52(9):2230-2235
    [123]张剑,孙立宁,富历新,等.一种用于锁定髓内钉的新型计算机辅助整形外科系统.机器人,2005,vo1.27(3):231-235
    [124]张斌,黄攀峰,刘正雄,等.基于虚拟夹具的交互式空间机器人遥操作实验.宇航学报,2011,vo1.32(2):446-450
    [125]黄剑斌,谢宗武,金明河,等.基于碰撞检测的自适应阻抗控制机械臂系统(英文).中国航空学报,2009:105-111
    [126]张福海,付宜利,王树国.一种笛卡儿空间的自由漂浮空间机器人路径规划方法.机器人,2009,vo1.31(2):187-192
    [127]朱庆保.动态复杂环境下的机器人路径规划蚂蚁预测算法.计算机学报,2005,vo1.28(11):1898-1905
    [128]Vazquez I, Rosell J. Contact tracking in configuration space for haptic rendering purposes [C]//6th IEEE international Symposium on Assembly and Task Planning:Form Nano to Macro Assembly and Manufacturing. Piscataway. NJ, USA:IEEE,2005:218-223.
    [129]刘成良,张凯,Lee J.双机器人协调作业下碰撞算法及仿真研究[J].机器人,2003,25(2):167-171.
    [130]Liu C L, Zhang K, Lee J. Research on collision algorithm for dual-robot under coordinative operation and simulation[J]. Robot,2003,25(2):167-171.