摘要
人工智能科学研究的进展和通讯技术的进步为多移动机器人系统的深入研究和广泛应用奠定了牢固的技术基础。随着人类要求机器人完成任务难度的提高,多移动机器人系统的应用范围越来越广泛。许多任务由多个机器人协同完成要优于采用单个机器人。多移动机器人系统不仅能够有效地利用机器人之间的相对定位及信息共享机制,提高系统效率和任务完成的质量,而且可以完成单一机器人无法完成的时间和空间并行的多任务。
然而,多个机器人之间如果没有一个良好的协作机制,不仅会由于机器人之间的重复工作和彼此干扰而导致系统整体性能下降,而且会由于冲突加剧和发生死锁现象而产生机器人安全隐患甚至使系统发生瘫痪而无法完成预定任务。因此多移动机器人协作方法研究是多移动机器人系统研究的核心问题。本文重点研究了基于心理学概念的多移动机器人协作方法和基于生物启发策略的多移动机器人协作方法。并对多移动机器人紧耦合任务和松耦合任务分别进行了强化学习方法的研究。
分析和比较了各种单体机器人控制结构,在此基础上提出了一种面向多移动机器人协作的基于目标型行为有限状态机的单体机器人控制结构。分析和比较了各种多机器人群体控制结构的特点,在此基础上提出了一种基于群智能方法的分布式群体控制结构。为了更好地说明任务概念和为基于任务的多移动机器人协作研究奠定基础,提出了一种MTB多移动机器人任务层次结构。
受蚂蚁等社会性昆虫营养交哺现象的启发,提出了一种基于交哺行为的Mission级任务一致性保持方法,使多移动机器人系统可以自主地实现任务的一致性保持,为通信范围有限或者通信信息需要保密的敌对环境下的系统任务命令的有效传播提供了一种鲁棒和可靠的群智能方法。在模拟蚂蚁等社会性生物采用信息素进行信息交流的隐式通信方式的基础上,提出了一种基于排斥信息素型蚁群算法(PR-ACA)的多移动机器人自主任务分配方法。进行了未知非结构化环境下的多移动机器人协作搜集仿真实验。仿真结果表明,采用该方法可以实现多移动机器人搜集任务的自主分配,有效减少机器人的空间冲突,尤其在机器人数量较多的情况下,更能显示出该方法的优势。
提出了一种基于心理状态参数的多移动机器人协作行为决策方法。机器人根据对自身内外环境及队友状态的估计产生心理状态参数。利用神经网络建立心理状态参数与机器人协作倾向阈值之间的映射关系。在遇到需要产生协作行为的场合根据这些阈值来快速产生反应。实验结果表明所提方法既可以保证机器人根据环境做出合理的判断,又可以保证机器人反应的快速性。针对目前应用于多移动机器人协作的拍卖方法很少考虑机器人参与拍卖的时机是否适当这一问题,在拍卖方法中引入了心理学的焦虑概念,提出了基于焦虑/拍卖的多机器人协作方法(AACM)。实验结果表明,与单纯的拍卖方法相比,该方法能够提高多移动机器人协作搜集任务的执行效率。
针对紧耦合任务的特点,应用强化学习方法进行了多移动机器人编队导航任务的研究。高层采用“条件——行为对”强化学习机制解决了多移动机器人长障碍物的绕行方向选择问题。中层采用一种角色交叉包含式控制结构作为编队保持机制。底层采用“动作——状态对”强化学习机制进行避碰规则的学习。通过多移动机器人编队导航仿真实验证明了所提三层控制方法对于解决多机器人编队导航任务的有效性和高效性。针对松耦合任务的特点,作为所提面向多移动机器人协作的单体机器人控制结构的进一步研究,提出了一种带“共享区”的基于目标型行为的强化学习算法,研究了通过强化学习机制获得基于目标型行为有限状态机的方法,通过多机器人搜集仿真实验证明了该方法的可行性。
最后,建立了面向多移动机器人协作方法性能验证的多移动机器人实验系统。通过实验对所提的多移动机器人协作方法进行了验证。实验结果证明了所提多移动机器人协作方法的有效性和高效性。
The development of the artificial intelligtnce science and the communication technique lays the firm foundation for further research and extensive application of multiple mobie robots system. As robots are charged with increasingly difficult tasks, the application domain of multiple mobile robots system expands. Many tasks can be better achieved by a team of robots than by a single robot. Multiple mobie robots system not only can effectively utilize the relative localization technique and information sharing mechanism to advance the system efficiency and the quality of accomplishing missions, but also can accomplish the spatial parallelism tasks which can not be realized by a single robot.
However, if there is not a good cooperation mechanism among multiple robots, the whole system performance will decrease because of repeat work and mutual interference. The whole system will have safety hidden danger and even break down and can not accomplish the scheduled mission. So the research of multiple mobile robots cooperation method is the key problem of multiple mobile robots system research. The multiple mobile robots cooperation method based on psychology concept and the multiple mobile robots cooperation method based on biological inspired strategies are emphatically analyzed. At the same time, the RL method for loosely-coupled task and tightly-coupled task are respectively studied. Various single robot control structures are analyzed and compared. On the basis of this, a kind of single robot control structure named Target Type Behavior FSM was presented. Various group architectures are analyzed and compared. On the basis of this, a kind of distributed structure based on swarm intelligent method was presented. To fully describe the task conception and to lay a foundation for task based multi-robot cooperation methods research, a kind of task hierarchical structure called MTB was presented.
Simulating the trophallaxis behavior of the social insects such as bees and ants, a kind of multi-robot systems mission consistency maintenance method was presented. It provided a robust and reliable swarm intelligence method for the effective communication of multiple mobile robots mission especially in limited communication range environment and security environment. The paper presented a multi-robot systems mission consistency maintenance method based on trophallaxis. A multiple mobile robots task allocation method based on a kind of Ant Colony Algorithm (ACA) named Repulsion Pheromone Ant Colony Algorithm (PR-ACA) was presented. Under the unknown unstructured environment, multi-robot cooperative foraging experiment was performed. Experiment results showed that the method presented in the paper could make multiple robots perform task allocation autonomously and effectively, and could decrease spatial confliction among robots, especially when the group was large.
A multiple mobile robots cooperation behavior decision method based on psychological state parameters was presented. Robots gave birth to psychological state parameters based on the estimations of environment, teammates and themselves. The mapping relationship between psychological state parameters and cooperation tendency threshold values were set up with neural network. Robots could make decision on the basis of these threshold values on cooperation occasions. Experiment results showed that the multi-robot cooperation method could ensure both the rationality and the speediness of robots’decision-making. Few had been thought about the application occasion problem of the auction method for the cooperative multi-robot foraging. To solve the problem, anxiety conception was introduced. A new algorithm named Anxiety and Auction Cooperation Method (AACM), combined anxiety concepton with auction method, was presented. Experiment results showed that, compared with the only auction method, the method pesented in the paper could improve the efficiency of performing multiple mobile robots cooperation foraging.
The paper studied multiple mobile robots formation and navigations according to the respective characteristics of tightly-coupled tasks. The high level used station-behavior pair reinforcement learning to learn the circumambulating direction according to the obstacles. A Role-Cross-Subsumption control structure was presented to be the middle layer of the three layers control structure. The low level used action-station pair reinforcement learning to learn the regulations for preventing collisions. Multiple mobile robots formation and navigations stimulation experiments validated the effectiveness and high efficiency of the method. As the further research of the single robot control structure for multiple mobile robots cooperation in the paper, a kind of Target Type Behavior RL with share section was presented. The paper studied the method to obtain Target Type Behavior FSM with RL. Stimulation experiments validated the feasibility of the method.
Finally, a hardware experiment system for validating multiple mobile robots cooperation methods was built. The experimental results validated the system efficiency of multiple mobile robots cooperation methods presented in the paper.
引文
1 M. Dorigo, L .M. Gambardella, M. Middendorf, et al. Guest Editorial: Special Section on Ant Colony Optimization. IEEE Transactions on Evolutionary Computation. 2002, 6 (4):317~319
2 T. Balch, M. Hybinette. Social Potentials for Scalable Multi-robot Formations. Proceedings of IEEE International Conference on Robotics and Automation. San Francisco, California, USA, 2000:73~80
3 L. E. Parker, B. Ben and R. Chris. Indoor Target Intercept Using an Acoustic Sensor Network and Dual Wavefront Path Planning. Proceedings of IEEE International Conference on Intelligent Robots and Systems. Las Vegas, Nevada, USA, 2003:1~6
4 R. M. De, J.Campbell, P.Pillai, et al. Distributed Watchpoints: Debugging Large Multi-Robot Systems. Proceedings of IEEE International Conference on Robotics and Automation. Roma, Italy, 2007:3723~3729
5 B. Gerkey, M. J. Matatic. Push-Watcher: An Approach to Fault-Tolerant Tightly-Coupled Robot Coordination. Proceedings of nternational Conference on Robotics and Automation. Washington, DC, USA, 2002: 464~469
6 D. Goldberg, V. Cicirello, M. Dias, et al. A Distributed Layered Architecture for Mobile Robot Coordination: Application to Space Exploration. Proceedings of 3rd International NASA Workshop on planning and Scheduling for space. Houston, Texas, USA, 2002:1~8
7 G. Thomas, A. H. Howard, A. B. Williams, et al.Multirobot Task Allocation in Lunar Mission Construction Scenarios. Proceedings of IEEE International Conference on Systems, Man, Cybernetics. Hawaii, USA, 2005:518~523
8 H. Hanna. Decentralized Approach for Multi-robot Task Allocation Problem with Uncertain Task Execution. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. Edmonton, Alberta, Canada, 2005:535~540
9 M. J. Mataric, Sukhatme. Multi-robot Task Allocation in Uncertain Environments. Autonomous Robots.2003, 14(2/3): 255~263
10 R. Cassinis, G. Bianco, A. Cavagnini, et al. Strategies for Navigation of Robot Swarms to Be Used in Landmines Detection. Proceedings of The ThirdEuropean Workshop on Advanced Mobile Robots.Zurich, Switzerland, 1999: 211~218
11 K. Konolige, et al. Centibots:Large Scale Robot Teams. Proceedings of the NRL Workshop on Multi-Robot Systems. Washington, DC,USA, 2003:1~10
12 V. A. Ziparo, A. Kleiner, B. Nebel,et al. RFID-Based Exploration for Large Robot Teams. Proceedings of IEEE International Conference on Robotics and Automation. Roma, Italy, 2007:4606~4613
13 N. D. Duffy, J.T. Herd. A Societal Architecture for Robotic Applications. Computing& Control Engineering Journal. 1991, 2 (6):269~274
14 J. M. Hereford. A Distributed Particle Swarm Optimization Algorithm for Swarm Robotic Applications. Proceedings of IEEE Congress on Evolutionary Computation. Vancouver, DC, Canada, 2006 :1678 ~1685
15 B. Webb. What does Robotics Offer Animal Behavior? Animal Behavior . 2000, 60(5): 545~558
16 T. Balch, F. Dellaert and A. Feldman, et al. How Multirobot Systems Research will Accelerate Our Understanding of Social Animal Behavior. Proceedings of the IEEE. 2006, 94(7):1445~1463
17 Y. Kawauchi, T. Fukuda. Numerical Analysis and Basic Algorithm of Self-organization of Cellular Robotics“CEBOT”. Proceedings of International Conference on Industrial Electronics, Control and Instrumentation. Irvine, California, USA, 1991:967~972
18 C. R. Kube, E. Bonabeau. Cooperative Transport by Ants and Robots. Robotics and Autonomous Systems. 2000, 30(1-2): 85~101
19 L.E. Parker, B. Kannan, X. Q. Fu, et al. Heterogeneous Mobile Sensor Net Deployment Using Robot Herding and Line-of-sight Formations. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. Las Vegas, Nevada, USA, 2003:2488~2493
20 M. James, Y. Daniel. Dynamic Task Assignment in Robot Swarms. Proceedings of Robotics: Science and Systems. Cambridge, USA , 2005: 1~8
21王越超,谈大龙.协作机器人学的研究现状与发展.机器人.1998, 20(1): 69~75
22谭民,王硕,曹志强.多机器人系统.清华大学出版社. 2005:251~263
23陈卫东,李振海,席裕庚.分布式多自主机器人系统冲突及其消解策略的实例研究.系统仿真学报. 2002, 14(10) :1288~1292
24 E. M. Russell. Swarm Intelligence and Stigmergy: Robotic Implementation of Foraging Behavior. Masteral Dissertation. University of Maryland. Maryland ,USA.2003: 36~67
25 D. Goldberg. Evaluating the Dynamics of Agent-environment Interaction. Doctoral Dissertation, University of Southern California.Caifornia, USA. 2001: 10 ~111
26 Y. U. Cao, A. S. Fukunaga, A. Kahng. Cooperative Mobile Robotics: Antecedents and Directions. Autonomous Robots. 1997, 4(1): 7~27
27 L. E. Parker, D. Jung, T. Huntsberger, et al. Opportunistic Adaptation in Space-based Robot Colonies: Application to site preparation. Proceedings of World Automation Congress. Maui, Hawaii, USA, 2000:1~6
28 A. Howard, M.J. Mataric and G. S. Sukhatme. An Incremental Deployment Algorithm for Mobile Robot Teams. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and System. Lausanne, Switzerland, 2002:2849~2854
29 W. Burgard, M. Moors, C. Stachniss, et al. Coordinated Multi-robot Exploration Robotics. IEEE Transactions on Robotics and Automation. 2005, 21(3):376~386
30 C. Jones, M. J. Mataric. Automatic Synthesis of Communication-based Coordinated Multi-robot Systems. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. Sendai, Japan, 2004:381~387
31 W. H. Sheng, Q. Y. Yang, J. D.Tan,et al.Distributed Multi-robot Coordination in Area Exporation. Robotics and Autonomous Systems. 2006, 54(12):945~955
32 R. Regele, P. Levi. Cooperative Multi-Robot Path Planning by Heuristic Priority Adjustment. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. Beijing, China, 2006:5954 ~5959
33 J. Chen, L.R. Li. Path Planning Protocol for Collaborative Multi-robot Systems. Proceedings IEEE International Symposium on Computational Intelligence in Robotics and Automation. Espoo, Finland, 2005:721~726
34 K. Vikram, G. S. Andrew, M. James, et al. Spacecraft Formation Flying:Dynamics and Control. AIAA Journal of Guidance, Control and Dynamics. 2001, 23(3):561~564
35 L. E. Parker. Cooperative Robotics for Multi-Target Observation. Intelligent Automation and Soft Computing, special issue on Robotics Research at Oak Ridge National Laboratory. 1999, 5 (1):5~19
36 B.Werger, M.Mataric. Broadcast of Local Eligibility for Multi-target Observation. Proceedings of Distributed Autonomous Robotic System 4. New York, USA, 2001: 347~356
37 P. Pirjanian, M. Mataric. Multi-robot Target Acquisition Using Multiple Objective Behavior Coordination. Proceedings of IEEE International Conference on Robotics and Automation. San Francisco, California, USA, 2000:2696~2702
38 L. E. Parker. ALLIANCE: an Architecture for Fault Tolerant Multirobot Cooperation. IEEE Transactions on Robotics and Automation.1998, 14(2):220~ 240
39 V. Antidio, M. Ivan and O.Anibal. SET: an Angorithm for Distributed Multirobot Task Allocation with Dynamic Negotiation based on Task Subsets. Proceedings of IEEE International Conference on Robotics and Automation. Roma, Italy, 2007:3339~3344
40 C. Jones, M. J. Matatic. Synthesis and Analysis of Non-reactive Controllers for Multi-robot Sequential Task Domains. Proceedings of the International Symposium on Experimental Robotics. Singapore, 2004:1~10
41 O. Shehory, S. Kraus. Cooperative Goal-satisfaction without Communication in Large-scale Agent-systems. Proceedings of the 12th European Conference on Artificial Intelligence. Budapest, Hungary, 1996:544~548
42原魁,李园,房立新.多移动机器人系统研究发展近况.自动化学报. 2007, 33(8) : 785~794
43 O. Soysal, E. Sahin. Probabilistic Aggregation Strategies in Swarm Robotic Systems. Proceedings of IEEE Swarm Intelligence Symposium. Indianapolis, Indiana, USA, 2005:325~332
44 J. L. Deneubourg, G.Theraulax and R.Beckers. Swarm-made Architectures. Proceedings of the First European Conference on Artificial Life. Paris, France, 1992 : 123~133
45 A. Weitzenfeld, A.Vallesa and H. Flores. A Biologically-Inspired Wolf Pack Multiple Robot Hunting Model. Proceedings of IEEE 3rd Latin American Robotics Symposium. Santiago, Chile, 2006:120 ~127
46 S. Garnier, C. Jost, R.Jeanson, et al. Collective decision-making by a group of cockroach-like robots. Proceedings of IEEE Swarm Intelligence Symposium. Indianapolis, Indiana, 2005:233~240
47丁滢颖,何衍,蒋静坪.基于蚁群算法的多机器人协作策略.机器人. 2003, 25(5):414~418
48 E. Borzello, L.D .Merkle. Multi-agent cooperation using the ant algorithm with variable pheromone placement. The IEEE Congress on Evolutionary Computation. Edinburgh, UK, 2005:1232~1237
49高云园,韦巍.未知环境中基于免疫网络的多机器人自主协作.浙江大学学报(工学版). 2006, 40(5) : 733~737
50涂序彦.人工智能:回顾与展望.科学出版社, 2006:21~30
51 R. W. Picard. Affective Computing:challenges. International Journal of Human-Computer Studies 2003, 59(1-2):55~64.
52 A.Bechara. The Role of Emotion in Decision-making: Evidence from Neurological Patients with Orbitofrontal Damage. Brain and Cognition. 2004, 55:30~40
53 F. Terrence. A Survey of Socially Interactive Robots. Robotics and Autonomous Systems. 2003, 42(3-4): 143~166
54 M. Tauchi, Y. Sagawa, T. Tanaka, et al. Collaboration among a Group of Self-Autonomous Mobile Robots with Diversified Personalities. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. Sendai, Japan, 2004: 388~393
55 A. Gage. Multi-Robot Task Allocation Using Affect . Doctoral Dissertation, University of South Florida. South Florida, USA , 2004:38~51
56 Y. Y. Ding, Y. He, J. P. Jiang. Introducing 'Personality' into the Multi-robot Cooperation. Proceedings of the American Control Conference. Oregon, Portland, 2005:5003~5008
57 G. Murphy. Sensor Scheduling in Mobile Robots Using Incomplete Information via Min-Conflict with Happiness. IEEE Transactions on Systems, Man and Cybernetics. 2004, 34(1):454~467
58 C. S. Yu, L. Xu. An Emotion-based Approach to Decision Making and Self Learning in Autonomous Robot Control. Proceedings of the 5th world Congress on Intelligent Control and Automation. Hangzhou, China, 2004:2386~2390
59 F. Terrence, N. Illah, D. Kerstin. A Survey of Socially Interactive Robots. Robotics and Autonomous Systems. 2003, 42(3-4): 143~166
60 P. Stone, M. Veloso. Multiagent Systems: A Survey from a Machine Learning Perspective.Autonomous Robots. 2000, 8(3): 345~383
61 R. R. Murphy, C. L. Lisetti, R. Tardif, et al. Emotion-based Control of Cooperating Heterogeneous Mobile Robots.IEEE Transactions on Robotics and Automation. 2002, 18(5):744~757
62 S. J. Givigi, H. M. Schwartz. Evolutionary Swarm Intelligence Applied to Robotics. Proceedings of IEEE International Conference on Mechatronics and Automation. Niagara Fails, Ontario, Canada, 2005:1005~1010
63 J. M. VALIN. Auditory System for a Mobile Robot. Doctoral Dissertation. Universite de Sherbrooke, Sherbrooke, Quebec, Canada. 2005:11~37
64 M. B. Dias, R. Zlot, N. Kalra, et al. Market-based Multirobot Coordination: a Survey and Analysis. Proceedings of the IEEE . 2006,94(7) : 1257~1270
65 B. P. Gerkey, M. J. Mataric. Sold!: Auction Methods for Multirobot Coordination. IEEE Transactions on Robotics and Automation. 2002:758~768
66 L. Liu, Z. Zhiqiang. Combinatorial Bids based Multi-robot Task Allocation Method. Proceedings of the IEEE International Conference on Robotics and Automation. 2005:1145~1150
67 A.Viguria, I.Maza, A. Ollero. SET: An algorithm for distributed multirobot task allocation with dynamic negotiation based on task subsets. IEEE International Conference on Robotics and Automation. 2007:3339 ~3344
68 R. Zlot, A. Stentz, M.B. Dias, et al. Multi-robot Exploration Controlled by a Market Economy. Proceedings of IEEE International Conference on Robotics and Automation .Washington, DC, USA , 2002:3016~3023
69 B.P. Gerkey and M. J Mataric. Murdoch: publish/subscribe task allocation for heterogeneous agents. Proceedings of the International Conference on Autonomous Agents Barcelona, Spain: ACM, New York, NY, USA, 2000:203~204
70 S. C. Botelho and R. Alami. M+: a scheme for multi-robot cooperation through negotiated task allocation and achievement . Proceedings of IEEE International Conference on Robotics and Automation , 1999, 2: 1234~1239
71 A. Chella, M. Gentile and R. Sorbello. E-MIP : A New Mechanism for Dynamic Coalition Formation in a Robot Team. Proceedings of Fourth International Workshop on Robot Motion and Control. Puszczykowo, Poland, 2004 :103~108
72 V. Gazi. Swarm Aggregations Using Artificial Potentials and Sliding-mode Control Robotics. IEEE Transactions on Robotics and Automation. 2005, 21(6):1208~1214
73 D. Y. Chen, L. Zhan, X. Chen. Mobile Robot Path Planning Based on Behavior Information Potential Field in Unknown Environments. Proceedings of IEEE International Conference on Robotics and Biomimetics.Shenyang, China, 2004:683~687
74 T. Balch, M. Hybinette. Social Potentials for Scalable Multi-Robot Formation . Proceedings of IEEE International Conference on Robotics and Automation. San Francisco, California, USA, 2000: 73~80
75 Z. Dimitri, R. T. David. A Fluid Dynamics Approach to Multi-Robot Chemical Plume Tracing. Proceedings of Autonomous Agents and Multi-agent System. New York, USA, 2004:1474~1475
76 V. Gazi, K. M. Passino. Stability Analysis of Social Foraging Swarms. IEEE Transactions on Systems, Man and Cybernetics. 2004, 34(1):539 ~557
77 M Nandy, A Mahanti. An Improved Search Technique for Optimal Winner Determination in Combinatorial Auctions. Proceedings of the 37th Annual Hawaii International Conference on System Sciences. Los Alamitos, California, USA , 2004: 1~10
78 G. Brian , M. J. Mataric. A Formal Framework for the Study of Task Allocation in Multi-Robot Systems. International Journal of Robotics Research. 23(9), 2004: 939~954
79 A. Farinelli, L. Iocchi , D. Nardi ,etc. Assignment of dynamically perceived tasks by token passing in multirobot systems. Proceedings of the IEEE, 2006, 94(7):1271 ~1288
80 W. Shuli, W. Shuo, C. Zhiqiang,etc. Self-allocation of task in multi-robot system.The International Conference on Control and Automation. Xiamen, China: IEEE Press, 2002. 219 ~220
81 K. H. Low, W. K. Leow and M. H. J. Ang. Autonomic mobile sensor network with self-coordinated task allocation and execution.IEEE Transactions on Systems, Man and Cybernetics. 2006,36(3) :315 ~327
82 M. J. B. Krieger, J. B. Billeter. The call of duty: Self-organized task allocation in a population up to twelve mobile robots. Robotics and Autonomous Systems, 2000,30:65 ~84
83 D. Anubhav, D. Grosu. Combinatorial auction-based protocols for resource allocation in grids. Proceedings of 19th IEEE International Parallel and Distributed Processing Symposium. Denver, Colorado, USA, 2005:1 ~8
84 R. Brooks. A Robust Layered Control System for a Mobile Robot. IEEE Journal of Robotics and Automation. 1986, 2(1) :14 ~23
85 R. C. Arkin. Motor Schema-based Mobile Robot Navigation. The International Journal of Robotics Research. 1989, 8(4):92~112
86 J. L. Jones. Robot Programming–A Practical Guide to Behavior-Based Robotics. The McGraw-Hill Companies.Ins. Press. 2004:20~35
87 R. C. Arkin, T. Balch. Cooperative Multiagent Robotic Systems. Proceedings of Artificial Intelligence and Mobile Robots.Cambridge, Massachusetts, USA, 1998:1~16
88 J. H. Kim, V. Prahad. Multi-Agent Systems: a Survey from the Robot-soccer Perspective. International Journal Intelligent Automation and Soft Computing. 2000, 6(1):3~17
89 R. Rocha, J. Dias and A.Carvalho. Cooperative Multi-robot Systems: A Study of Vision-based 3-D Mapping Using Information Theory. Robotics and Autonomous Systems. 2005, 53(3-4):282~311
90 P. T. Eugster, P. A. Felber, Guerraoui R, et al. The Many Faces of Publish/Subscribe. ACM Computing Surveys.2003, 35(2): 114~131
91 L. Kristina, J. Chris, G. Aram, et al. Analysis of Dynamic Task Allocation in Multi-Robot Systems. International Journal of Robotics Research. 2006, 25(3): 225~242
92 A. Farinelli, L. Iocchi, D. Nardi, et al. Task Assignment with DynamicPerception and Constrained Tasks in a Multi-Robot System. Proceedings of the IEEE International Conference on Robotics and Automation .Orlando, Florida, USA, 2005:1523~1528
93 B. P. Gerkey. On Multi-robot Task Allocation. Doctoral Dissertation. University of Southern California, Caifornia, USA, 2003: 33~80
94 V. Lovekesh, J. A. Adams. Market-based Multi-robot Coalition Formation. Proceedings of the 8th International Symposium on Distributed Autonomous Robotic Systems. Paul, Minnesota, USA, 2006:1~10
95张健华,李文健,陈丽玲等.台湾乳白蚁行为多型的研究.昆虫学报. 2003, 46(3) :333~338
96 K. Masao, M. Chris. Robot Trophallaxis: Managing Energy Autonomy in Multiple Robots. Proceedings of Towards Autonomous Robotic Systems.Cochester, United Kingdom, 2004: 1~8
97 T. Schmickl, K. Crailsheim. Trophallaxis Among Swarm-robots: A Biologically Inspired Strategy for Swarm Robotics. Proceedings of the First IEEE International Conference on Biomedical Robotics and Biomechatronics. Pisa, Itay, 2006:377~382
98 P. Tanya. Cued in : Honey Bee Pheromones as Information Flow and Collective Decision-making. Apidologie.2004, 35:217~226
99 R. T. Vaughan, K. Sukhatme, G.S. Stoy, et al. Whistling in the Dark : Cooperative Trail Following in Uncertain Localization Space. Proceedings of the Fourth International Conference on Autonomous Agents. Barceona, Spain, 2000: 187~194
100 D. D. Zhang, G. M. Xie, J. Z. Yu, et al. Adaptive Task Assignment for Multiple Mobile Robots Via Swarm Intelligence Approach. Robotics and Autonomous Systems. 2007, 55(7):572~588
101 F. Dressler, G. Fuchs. Energy-aware Operation and Task Allocation of Autonomous Robots. Proceedings of the Fifth International Workshop on Robot Motion and Control. Dymaczewo, Poland, 2005:163~168
102 A. C. Vincent, F. S. Stephen.Wasp-like Agents for Distributed Factory Coordination.Autonomous Agents and Multi-Agent Sytems. 2004, 8:237~266
103张海俊,史忠植.动态合同网协议.计算机工程. 2004, 30(21) : 44~47
104 F. M. Schneider, M. J. Mataric. Territorial Multi-robot Task Division. IEEETransactions on Robotics and Automation. 1998, 14(5):815~822
105 B. Tucker. Behavioral Diversity in Learning Robot Teams. Doctoral Dissertation. Georgia Institute of Technology , Georgia ,USA.1998: 103~136
106 W. James.心理学原理.中国城市出版社,2003:20~35
107庄晓东.多移动机器人运动控制策略的强化学习研究.中国海洋大学博士论文. 2005:4~9
108 C. J. C. H. Warkins, P. Dayan. Q-learning. Machine Learning. 1992, 8(3):279 ~292
109王醒策.基于强化学习和群集智能方法的多机器人协作协调研究.哈尔滨工程大学博士论文. 2005: 41~78
110孟江华,朱纪洪,孙增圻.未知环境下基于传感器的移动机器人路径规划新方法.机器人.2005, (4) : 319~324
111 M. J. Mataric. Reinforcement Learning in the Multi-Robot Domain. Autonomous Robots. 1997, 4(1):73~83
112 A. G. Barto, S. Mahanevan . Recent Advances in Hierarchical Reinforcement Learning. Discrete Event Dynamic Sysems: Theory and Applications. 2003, 13(4): 41~77
113 R. S. Sutton, D. Precup and S. P. Singh. Between MDPs and Semi-MDPs:a Framework for Temporal Abstraction in Reinforcement Learning. Artificial Intelligence. 1999, 112(1): 181~211
114 K. Macek, I. Petrovic and N. Peric. A Reinforcement Learning Approach to Obstacle Avoidance of Mobile Robots. Proceedings of the 7th International Workshop on Advanced Motion Control. Maribor, Slovenia , 2002 : 462~466
115卢纯,石秉学,陈卢.一种可扩展BP在片学习神经网络芯片.电子学报. 2002, 30(9):1270~1273