多智能体模型、学习和协作研究与应用
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
关于Agent理论和多Agent系统的研究是近年来分布式人工智能领域的研究热点。论文从知识表示、模型建立、学习和协作等方面对Agent技术做了全面而深入的研究,在总结了前人研究成果的基础上做了有效的改进,提出了自己的创新点和应用成果。
     本文的主要研究内容和创新包括:
     1.在传统的理性Agent的BDI形式化逻辑模型中作者引入新的逻辑算子BEL、ASM、DES、GOAL和INT等,表达了信念、愿望和意图三者间的动态约束与相互激发关系,补充了正规模态逻辑的KD45公理,建立Agent从信念到动作选择的的意图模型,为研究Agent与环境交互的自主行为模式提供了理性化模型。
     2.Agent的推理能力被认为是衡量Agent智能性重要的指标。针对现有符号逻辑描述方法难以保证知识表达的完整性,推理过程陷于复杂的逻辑演绎的问题,作者引入了模糊因果关系的网络模型,基于模糊认知图理论构造Agent推理模型,用简单的数值计算代替复杂符号系统的表示和演绎推理过程,实现了复杂环境下的Agent智能决策。
     3.Agent的学习能力是体现智能性的基础。论文的研究在现有强化学习算法的基础上,采用模糊建模的方法对于Agent的内部模型和状态的表示方法进行改进,提出一种模糊强化学习算法,降低了Agent学习对于精确模型和知识的要求,提高了算法的实用性。
     4.对于Agent在协作技术方面的研究,针对传统合同网模型资源消耗大,协商过程长的缺点,在原有的合同网中定义各网元之间的关系权值,提出一种关系型合同网模型。通过对系统内的Agent进行面向任务的预分类,大大节省了通讯时间和资源占用,提高了系统的整体性能。另外,关系权值可以随着环境的变化而动态调整,具有较大的灵活性。
    
    加介次驴浙江大学博士论文
     亘卑国国典硬理单以国目口口.口典
     5.在工程应用研究方面,本文研究了Agent在系统优化和交通调度领域
     的应用技术并取得了一定的工程成果,同时对基于Ageni的决策支持
     系统做了探讨。
     论文分从不同角度和层次多Agent系统理论的关键技术做了全面的探讨,既
    继承了前人的研究成果,同时对基于Agent的思想和方法做了深入的发掘和创
    新,展望了Agent技术在人工智能领域的开拓性前景。
In the past few years, most of the research of DAI (Distributed Artificial Intelligence) focused on Agent and Multi-agent System theory. In this dissertation, detailed study was made on Agent technology from knowledge denotation, modeling, Agent learning to multi-agent cooperation. Improvements were made on the basis of early research, as well as new opinions and applications were proposed.
    This dissertation is composed of follows:
    a) Introducing new logic operator into the traditional Agent BDI model, including BEL, ASM, DES, GOAL and INT, in order to describe the dynamic restrictions and interactive triggering relations between BELIEF, DESIRE and INTENTION of Agent. A new intentional model was built in complementation of the KD45 regular modal logic axiom, which is the base of Agent self-control interaction with the outer environment.
    b) Deducing is an important property of Agent intelligence. Symbol logic method is unable to guarantee the complement of knowledge description, which leads to complicated deducing process. We introduce Fuzzy Cognitive Map into Agent modeling and deducing, substitute symbolic description and inference with simple mathematical computing, achieving Agent intelligent decision-making in complex environment.
    c) Learning ability is the base of Agent self-determination behavior. Reinforcement Learning is an applicable machine learning method of Agent state and knowledge. We combined RL and fuzzy logic together to make improvement on Agent inner model and state denotation method. This Fuzzy Reinforcement Learning Method decreases the requirement of modeling precision and makes the algorithm more applicable.
    d) On the research of Agent cooperation, on the basis of Contract Net Model,
    
    
    
    we define relationship weights between the network nodes. By means of pre-classification of the agents in a system, agents negotiation and task distribution are handled in less time and resource consumption, the whole system performance are greatly improved.
    e) Application of Agent technology are also studied in many fields such as system optimization, transportation schedule and decision support system, ect.
引文
[1] A Chavez, A Moukas, et al. Challenger: A Multiagent System for Distributed Resource Allocation. In Proceedings of the International Conference on Autonomous Agents. Marina Del Ray, California, 1997.
    [2] A S Hardadi. Communication and Cooperation in Agent Systems. Berlin: Springer, 1996.
    [3] B. Burmeister, A. Haddadi, Application of multi-agent systems in traffic and transportation, IEE proceeding of Software Engineering. Vol. 144, No. 1, February, 1997.
    [4] B Dunin-Keplicz, R Berbrugge. Collective Commitments. In: Durffe Fed. The Second Intrernational Conference on Multiagent Systems. Mento Park, California: AAAI Press, 1996, 56-63.
    [5] Bell J. Changing attitudes. In: Wooldridge M J, Jennings N Reds. Intelligent Agents, Proceedings of the ECAI'94 Workshop on Agent Theories, Architectures, and Languages. Berlin: Springer-Verlag KG, 1995:40-55.
    [6] Bicchieri Cristina, Ephrati Eithan, et al. Games Servers Play, A procedural Approach.
    [7] Bose R. CMS: An Intelligent Knowledge-based Tool for Organizational Procedure Modeling and Execution. Expert Systems with Application. 1995, 8.
    [8] Bratman M E, Israel D J, Pollack M E. Plans and Resource bounded Practical Reasoning. Computational Intelligence, 1988, 4: 349-355.
    [9] Bratman M E. Intentions, Plans, and Practical Reason. Cambridge, MA: Hardvard University Press, 1987.
    [10] Brian Logan, Georgios Theodoropoulos, The Sistributed Simulation of Multiagent Systems, Proceedings of the IEEE, Vol. 89, No. 2, Febrary 2001.
    [11] C Hewitt. Open Systems Semantics for Distributed Artificial Intelligence, Artificial Intelligence, 1991, 47:79-106.
    [12] C. J. Watkins, P. Dayan, "Technical Note: Q-learning", Machine Learning, Vol. 8, pp: 279-292,1992.
    
    
    [13] Cavedon L, Padgham L, Rao Aet al. Revisiting rationality for agents with intentions. In: Xin Yao ed. Proceedings of the 8th Australian Joint Conference on Artificial Intelligence. Singapore: World Scientific Publishing Co. Pte. Ltd., 1995:131-138.
    [14] Cohen E R, Levesque. H J. Intention is choice with commitment Artificial Intelligence, 1990, 42: 213-261.
    [15] C.Y. Miao, A. Gob, Y. Miao, Z.H. Yang. Agent that models, reasons and makes decisions. Knowledge-Based Systems. 15(2002): 203-211.
    [16] Danko A., Roozenmond, Using intelligent agents for pro-active, real-time urban intersection control, European Journal of Operational Research 131(2001) 293-301.
    [17] Dennett D C. The Intentional Stance. Cambridge, Mass: MIT Press, 1987.
    [18] Eugenio Oliveira, etc. A Multi-Agent Environment in Robotics. Journal of Robotic, 1991, 9:431-440.
    [19] Dongha P. Toward a formal model of commitment for resource bounded agents. In: Wooldridge M J, Jennings N R eds. Intelligent Agents, Proceedings of the ECAI'94 Workshop on Agent Theories, Architectures, and Languages. Berlin: Springer-Verlag KG 1995.86-101.
    [20] Dunin-Kepliez B, Verbrugge R. Collective Commitments. In: Durfee F ed. Proceedings of the 2nd International Conference on Multi-agent Systems. Menlo Park, CA: AAAI Press, 1996: 56-63.
    [21] E H Durfee, V Lesser. Negotiating Task Decomposition and Application Using Partial Global Planning, Distributed Artificial Intelligence Volume 2, pp: 229-244.
    [22] Foundation for Intelligent Physical Agents(FIPA), Home Page: http:// www. fipa.org/.
    [23] Gaspar G, Coelho H. Where do intentions come from? A framework for goals and intentions adoption, derivation and evolution. In: Ferreira CP, Mamede N Jeds. Progress in Artificial Intelligence, Proceedings of the 7th Portuguese Conference on Artificial Intelligence, EPIA'95. Berlin: Springer-Verlag KG, 1995:115-128.
    [24] Georgeff M P, Rao A S. The semantics of intention maintenance for rational agents. In: Mellish C Sed. Proceedings of the 14th International Joint Conference on Artificial Intelligence. SanMateo, CA: Morgan Kaufmann Publishers, Inc., 1995:
    
    704-710.
    [25] Gu. P. Maddox A. A Framework for Distributed Reinforcement Learning. Adaption and Learning in Multiagent Systems. Springer-Verlag Berlin. Germany. 1996: 97-102.
    [26] G Zotkin, J S Rosenscein. A domain Theory for Task Oriented Negotiation. In: IJCAI-93,416-422.
    [27] Haddadi A., Reasoning about Cooperation in Agent Systems: A Pragmatic Theory. University of Manchester Institute of Science and Technology, 1995.
    [28] Hobeika, A.G., Kim, Traffic flow prediction systems based on upstream traffic. In: 1994 Vehicle Navigation and Information Systems Conference Proceedings. IEEE.
    [29] Hristo Bojinov, Arancha Casal, et al. Multiagent Control of Self-reconfigurable Robot. Artificial Intelligence. 142(2002), 99-120.
    [30] J. Hu, Wellman, et al. Multiagent reinforcement learning: Theoretical framework and an algorithm In Shavlik, J. Proceedings of the fifteenth International Conference on Machine Learning. 1998.
    [31] J. Von Newman, "Theory of Self-Reproduceing Automata", University of Illinois Press, 1966.
    [32] J. M. Vidal, E. H. Durfee, Agents Learning about agents: A Framework and Analysis, AAAI-97 Workshop on Learning in Multiagent Systems, July 1997.
    [33] Josefa Z., Sascha Ossowski, Ana Garcia-Serrano, On Multiagent Co-ordination Architectures: A Traffic Management Case Study. Proceedings of the 34th Hawaii International Conference on System Sciences, 2001.
    [34] Jarke M. Knowledge sharing and negotiation support in multiperson decision support systems. Decision Support Systems. 1986, 2: 93-102.
    [35] J S Rosenschein, Rational Interaction Cooperation Among Intelligent Agents. Ph. D. Disertation, Stanford University 1986.
    [36] J. Vancza, A. Markus, An agent model for incentive-based production scheduling, Computers in Industry 43(2000) 173-187.
    [37] Junling Hu, Michael P. Weliman. Learning About Other Agents in a Dynamic Multiagent System, Journal of System Research 2(2001), pp: 67-79.
    
    
    [38] K Decker, V Lesser. Designing a Family of Coordination Algorithms. In: Proc of the First International Conference on Multiagent Systems. San Francisco. CA. June, 1995: 73-84.
    [39] K Fischer, J P Muller, et al. A model for Cooperative Transportation Scheduling. In Proceedings of the First International Conference on MultiAgent Systems. AAAI Press/MIT Press. San Francisco, California, 1995:109-116.
    [40] Koulouriotis, D.E., Diakoulakis, I.E., Emiris, D.M. A fuzzy cognitive map-based stock market model: synthesis, analysis and experimental results. Fuzzy Systems, 2001. The 10th IEEE International Conference on, Vol. 1, 2001:465-468
    [41] Kiss G., Reichgelt H. Towards a Semantics of Desires. In: Warner E. Demazeau Yeds. Decentralized A. I. Proceedings of the Third European Workshop on modeling, Autonomous Agents in a Multi-Agent world. 1992:115-127.
    [42] Konolige K, Pollack M F. A representationalist theory of intention. In: Bajcsy Red. Proceedings of the 13th International Joint Conferenceon Artificial Intelligence. SanMateo, CA: Morgan Kaufmann Publishers, Inc., 1993:390-395.
    [43] Kronberg, P., Davidson, E, MOVA and LHOVRA: traffic signal control for isolated intersection. Traffic Engineering+Control, 1993, April, pp. 195-200.
    [44] K Werkman. Using Negotiation and Coordination Systems. In Proc of IJCAI-91 Workshop on Information Systems, 1991.
    [45] Kwang-Hyun Cho, Jong-Tae Lim, Multiagent Supervisory Control for Antifault Propagation in Serial Production Systems, IEEE Transaction on Industrial Electronics, Vol. 48, No.2, Apri. 2001
    [46] Laichour, H., Maouche, S., Mandiau, R., Traffic control assistance in connection nodes: multi-agent applications in urban transport systems, Intelligent Data Acquisition and Advanced Computing Systems. 2001, pp: 133-137.
    [47] Linder Bvan, Hoek W vander, Meyer J. Formalising motivational attitudes of agents: on preferences, goals and commitments. In: Wooldridge M, Müller J P, Tambe Meds. Intelligent Agents Ⅱ: Agent Theories, Architectures, and Languages, Proceedings, 1995. Berlin: Springer-Verlag KG, 1996: 17-32.
    [48] Lim, G. Young, Kang, JeongJin, Hong, Yousik, The Optimization of Traffic Signal Light using Artificial Intelligence, 2001 IEEE International Fuzzy System
    
    Conference.
    [49] M Baldi, G.P. Picco, Evaluating the tradeoffs of mobile code design(Ed.), Proceedings of the 20th International Conference on Software Engineering, IEEE CS Press, April 1998, pp. 146-155.
    [50] Martin Anthony and Norman Biggs. Computational Learning Theory. Cambridge University Press, 1992.
    [51] Maes, P., Modeling Adaptive Autonomous Agents, J. of Artificial Life, Vol. 1, No.1, pp: 135-162, 1994.
    [52] Magdalena, Kacprzak. Formalization of Multiagent Reasoning. Proceedings of the International Conference on Parallel Computing in Electrical Engineering. 2002 IEEE.
    [53] Moreau, Luc. Distributed directory service and message routing for mobile agents, Science of Computer Programming. Vol. 39, March, 2001, pp. 249-272
    [54] Merz M., Liberman B., Lamersdorf W. Using mobile agent to support interorganizational workflow management. Applied Artificial Intelligence, 1997, 11: 551-572.
    [55] Michael Wooldridge, Nichola R. Jennings, David Kinny. A methodology for Agent-oriented Analysis and Design. In: AAAI-99.
    [56] Michael P. Wellman, Peter R. Wurman, Market-aware agents for a multiagent world, Robotics and Autonomous Systems 24(1998) 115-125.
    [57] M Geneserth, M Ginsburg, et al. Cooperation Without Communication. In: Reading in DAI. 1988: 220-226.
    [58] N R Jennings. Joint Intentions as a Model of Multiagent Cooperation, Ph.D. dissertation, University of London, 1992.
    [59] Nilson J N. Logic and Artificial Intelligence. Artificial Intelligence, 1991, 47(1): 31-56.
    [60] OMG Agent Special Interest Group, Home Page: http:// www.objs.com/isig/ agents.html/.
    [61] P. Gruer, V. Hilaire, A. Koukam, Multi-Agent Approach to Modeling and Simulation of Urban Transportation Systems Global Telecommunications Conference, Nov 1996. Volume: 1, 18-22.
    
    
    [62] P. J. Gmytrasiewicz, E. H. Durfee. A rigorous, operational formalization of recursive modeling. ICMAS-95, 1995:125-132.
    [63] P M Jones, C M Mitchell. Human-computer Cooperative Problem Solving: Theory, Design, and Evaluation of an Intelligent Associate System. IEEE Trans on Systems, Man and Cybernetics, 1995, 25(7): 1039-1053.
    [64] P Stone, M Veloso. Multiagent Systems: A Survey from the Machine Learning Perspective. IEEE Trans on Knowledge and Data Engineering. 1998: 67-77.
    [65] R. Axelrod, Structure of Decision: The Cognitive Maps of Political Elites, Princeton University Press, Princeton, NJ, 1976.
    [66] Rao A. S, Georgeff M. R The semantics of intention maintenance for rational agents. In: Mellish C S ed. Proceedings of the 14th International Joint Conference on Artificial Intelligence. San Mateo, CA: Morgan Kaufmann Publishers, 1995: 704-710.
    [67] Rao A S. Agent Speak(L): BDI agents speak out in a logical computable language. In: Velde Walter Vande, Perram John Weds. Agents Breaking Away, Proceedings of the 7th European Workshop on Modelling Autonomous Agents in a Multi-Agent World, MAAMAW'96. Berlin: Springer-Verlag KG, 1996: 42-55.
    [68] R G Smith. The Contract-Net Protocol: High Level Communication and Control in a Distributed Problem Solver, IEEE trans on Comp. 1980: 1104-1113.
    [69] Ron Sun, Maria Fasli. Interrelations between the BDI primitives: Towards heterogeneous agents. Cognitive Systems Research. 4(2003): 1-22.
    [70] Sarosh Talokdar, Rarnesh V. C. A Multi-agent Technique for Contingency Constrained Optimal Power Flows. IEEE Transactions of Power System, 1994, 9(2): 855-861.
    [71] Schlueter R. A., Liu Shu-zhen, Ben-Kilanik. Justification of the Voltage Stability Security Assessment and Diagnostic Procedure Using a Bifurcation Subsystem Method. IEEE Transaction of Power Systems, 2000, 15(3): 1105-1111.
    [72] S E Conry, K Kuwabara, et al. Multiagent Negotiation for Distributed Constraint Satisfaction, IEEE Trans on SMC, 1991, 21(6): 1462-1477.
    [73] S. Kripke. Semantical analysis of modal logic. Zeitschrift fur Mathematische Logik und Grudlagen der Mathematic, 9,1963.
    
    
    [74] Stefan Bussmann, Klaus Schild, DaimlerChrysler AG, Self-Organizing Manufacturing Control: An Industrial Application of Agent Technology, Research & Technology 3 Alt-Moabit 96A, 10559 Berlin, Germany.
    [75] Scher J M. Distributed decision support for management and organization. DSS-81, Truns, 1st Conf on DSS, 1981: 130-140.
    [76] Shoham Y. An overview of Agent-oriented programming. In: Bradshaw M ed. Software Agents. Menlo Park, CA. AAAI Press, 1997: 271-289.
    [77] Singh M. P. Multi-agent Systems: A Theoretical Framework for Intention, Know-how, and Communication. Berlin: Springer-Verlag, 1994.
    [78] Swanson F. R. Distributed decision support system: A perspective. Proc 23rd Annual Hawaii Conf on System Science. 1990, 3: 129-136.
    [79] T. Fukuda, "Concept of Cellular Robotic System(CEBOT) and Basic Strategies for Its Realization", Computers Electro. Eng. Vol. 18, 1992, pp: 11-39.
    [80] Takashi Kawakami, Masahiro Kinoshita, Yukinori Kakazu, A Study on Reinforcement Learning Mechanisms with Common Knowledge Field for Heterogeneous Agent Systems, IEEE 1999. pp: 469-474.
    [81] Thomus R C, Burns A. The case for distributed decision making systems. The Computer Journal. 1982, 25(1): 148-152.
    [82] Thiemo Krink, Cooperaion and Selfishness in Strategies for Resource Management, Spill Science & Technology Bulletin. Vol. 6, No.2, pp. 165-171, 2000.
    [83] Tomohiro YAMAGUCHI, MARUKAWA, Interactive Multiagent Reinforcement Learning with Motivation Rules, Department of Information Engineering, Nara National College of Technology.
    [84] Tsai R., Chen J. I. Design of a Distributed Problem Solving System for Short-Term Load Forecasting. In: Proceeding of the 35th Midwest Symposium on Circuits and Systems. 1992, 395-399.
    [85] Tung B, Jintae L. An agent-based framework for building decision support systems. Decision Support System, 1999, 25(2): 225-237.
    [86] V Manudela, S Peter. A Team of Robotic Soccer Agents Collaborating in an Adversarial Environment. In Proceedings of the First International Workshop on RoboCup. Nagoya, Japan, August 1997.
    
    
    [87] Vlach R, Lona J, Marek J, Navara D. MDBAS-A Prototype of a Multidatabase Management System Based on Mobile Agents. In: Proc of the 27th Annual Conference on Current Trends in Theory and Practice of Informatics, Mitovy, Czech Republic, Springer Verlag, 2000,440-449.
    [88] Witold Jacak, Stephan Dreiseltl, Conflict Management in Multiagent Robotic System: FSM and Fuzzy Logic Approach. IEEE International Joint Conference on Artificial Intelligence, 2001.
    [89] Wong S. K., Kalam A. Development of a Power Protection System Using an Agent Based Architecture. Proceedings of International Conference on Energy Management and Power Delivery. Vol. 1, 1995, 433-438.
    [90] Wooldridge M. This is MY WORLD: the logic of anagent-oriented DAI test bed. In: Wooldridge M J, Jennings N Reds. Intelligent Agents, Proceedings of the ECAI'94 Workshop on Agent Theories, Architectures, and Languages. Berlin: Springer-Verlag KG, 1995:160-178.
    [91] Wooldrige M. Time, Knowledge and Choice. In: Wooldridge M, et al., Intelligence Agent Ⅱ: Agent Theories, Architectures, and Languages. Springer Verlag Berlin Heidelberg: Germany,1996, 79-96.
    [92] Wooldridge M. Intelligent Agent. In: Gerhard Wed. MultiAgent Systems. Massachusetts: The MIT Press, 1999. 27-71.
    [93] Yuhong Yan, Torsten Kuphal, Jurgen Bode, Application of multiagent systems in project management, international journal of production economics, 68(2000) 185-197.
    [94] Y. Miao, Z. Q. Liu, On causal inference in fuzzy cognitive map, IEEE Transaction on Fuzzy Systems 8(1), 2000: 107-120.
    [95] Zeng D, Sycara K. Benefits of Learning in Negotiation. In: Proc. of the National Conf. on Artificial Intelligence. AAAI-1997:36-41
    [96] Zhi-Qiang Liu, Yuan Miao. Fuzzy cognitive map and its causal inferences. Fuzzy Systems Conference Proceedings, 1999, FUZZ-IEEE'99. 1999 IEEE International, Vol. 3, 1999:1540-1545.
    [97] Zhu Zhao-hui. Two-dimensional structure intention theory and non-monotonic reasoning [Ph.DThesis]. Nanjing University of Aeronautics and Astronautics, 1998.
    
    
    [98] 陈化普等,交通规划理论与方法,清华大学出版社,1998.
    [99] 陈仁际等.分布式对象技术在多机器人系统中的应用.机器人.1998,11(6).
    [100] 楚丰,游大海.使用Agent技术的能量管理系统的研究,电力系统及其自动化学报,2001,Vol.13,No.5,10-13.
    [101] 戴汝为,周登勇.智能控制与适应性,第三届全球智能控制大会.
    [102] 刘海龙,吴铁军.基于模糊认知图的多Agent协调模型.系统工程理论与实践.2002,2:48-54
    [103] 刘红进,袁斌等.多代理系统及其在电力系统中的应用,电力系统自动化,2002,Vol.26,No.5,20-25.
    [104] 贺仲雄等,n个局中人信息协商决策支持系统[J],系统工程与电子技术,1994,16(3):7-11.
    [105] 高阳,周志华等.基于Morkov的多Agent强化学习模型及算法研究.计算机研究与发展.2000,37(3):257—263.
    [106] 赫伯特·西蒙.现代决策理论的基石:有限理性说.杨砾,徐立译.北京:北京经济学院出版社,1989.
    [107] 苗原,张文生,李实,孙增圻等.基于模糊认知图的因果推理.模式识别与人工智能.1999年,Vol.12,No.2.142-151.
    [108] 沈静珠,过程系统优化(第二版),清华大学出版社
    [109] 彭立焱,陈柏鸿,钟毅芳,刘继红,大规模优化系统层次分解的一种方法,华中理工大学学报,Vol.28,No.6,Jun.2000.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700