摘要
大规模并行分布式仿真需要大量的资源和多个组织结构间的协作,网格能够实现跨组织机构的资源共享与协同问题求解,它为大规模并行分布式仿真的开展提供了有效的解决途径。当前网格技术正朝着面向服务架构方向发展,通过服务为网格用户提供各种功能,以确保网格功能模块的松耦合性和在异构环境中的互操作能力。为了支撑大规模并行分布式仿真的开展,可以在网格环境中提供一组标准的服务,通过构建面向并行分布式仿真服务网格来使能仿真相关资源的共享和协同仿真的开展。
首先给出了面向并行分布式仿真服务网格的使用想定,基于给出的使用想定进行了需求分析,确定了面向并行分布式仿真服务网格应该提供的若干关键服务和功能,主要包括HLA RTI服务、资源发现服务、仿真执行管理服务和仿真任务迁移等。接着,在研究了相关技术的基础上,确定面向并行分布式仿真服务网格的总体框架,明确了面向并行分布式仿真服务网格的层次结构,这些层次包括资源层、仿真基础服务层、仿真核心服务层、仿真门户层和用户层。
为了在面向并行分布式仿真服务网格环境中将HLA RTI作为基础仿真服务提供,需要实现HLA RTI的Web服务化。在分析了HLA和Web服务在军事领域和商业领域上下文互操作性异同的基础上,给出了HLA RTI Web服务化概念和基本方法,重点讨论了HLA RTI Web服务化需要解决的关键技术问题和可能的解决方案,关键技术问题有HLA RTI Web服务接口定义、消息编码方式、调用状态维护、部署模式、数据交换模式调和等,在解决了这些关键技术问题的基础上,提出了一种用于实现HLA RTI的Web服务化方法,并给出了基于Globus工具箱的实现。此外,讨论了联邦成员Web服务化的相关问题和方法。
面向并行分布式仿真服务网格需要通过资源发现服务使能服务网格中的资源发现。资源发现以资源描述为前提,提出了一种基于语义的资源描述方法,给出了相应的资源匹配方法。该资源描述方法通过建立相关领域的本体,在资源描述过程中使用本体定义的相关概念和属性,为资源描述引入了语义,改进了资源描述缺乏语义而导致的资源匹配准确性差和完备性不高等问题。在建立了基于语义的资源描述方法之后,给出了一种具有自组织能力的资源发现服务,通过自组织能力简化了服务网格的管理和使用、克服了集中式资源发现服务所固有的性能瓶颈和单一故障点问题。
服务质量保证是网格技术区别于其它分布式计算技术的重要标志之一,服务网格必须为并行分布式仿真系统在网格环境中的运行提供负载平衡机制,而仿真任务迁移是实现负载平衡的主要手段之一。在研究了一般性迁移问题的基础上,重点分析了基于HLA分布式仿真中联邦成员可以采取的迁移方法和协议,提出了一种基于移动代理的成员迁移机制,实现了并行分布式仿真系统在网格环境中的负载平衡,改进了并行分布式仿真在网格环境中的执行效率。
计算资源是服务网格中的一类重要资源,也是执行大规模并行分布式仿真最为需要的资源,面向并行分布式仿真服务网格必须为并行分布式仿真作业在这些大量计算资源上的执行提供支持。在研究了仿真作业管理与调度方法的基础上,为并行分布式仿真在服务网格环境中的执行设计了仿真执行管理服务,作为对仿真执行管理服务的支撑,设计了仿真基础执行服务,讨论了如何将本地计算资源封装为仿真基础执行服务。
在以上对面向并行分布式仿真服务网格总体框架和关键技术研究的基础上,设计并实现了原型系统,通过以XX对抗仿真系统为原型的仿真实例验证了面向并行分布式仿真服务网格关键技术研究工作的可行性,实现了仿真资源的共享,支撑了协同仿真的开展。
Large scale parallel and distributed simulations require a multitude of resources and collaboration between simulation participants. Grid can enable resource sharing and collaborative problem solving across multiple organizations, so it provides an efficient way for large scale parallel and distributed simulations. And currently, grid technology is developing towards Service Oriented Architecture, and provides varieties of functions to grid users through services in order to guarantee the loose coupling of functional modules of grid and their interoperability in heterogeneous environments. To support the fulfillment of large scale parallel and distributed simulations, it is possible to construct the service grid for parallel and distributed simulations by providing a set of standard services, ultimately to enable the sharing of simulation relevant resources and the achievement of collaborative simulations.
The dissertation firstly described the application scenario of the service grid for parallel and distributed simulations, and identified the key services and functions that the service grid must provide, through demand analysis. These key services and functions included High Level Architecture(HLA) Runtime Infrastructure(RTI) service, resource discovery service, simulation execution service, and simulation task migration. Then on the basis of the research on relevant technologies, the overall framework of the service grid for parallel and distributed simulations was determined. It clarified the hierarchy of the service grid, which was composed of resource level, simulation basic service level, simulation core service level, simulation portal level, as well as user level.
Service enabling of HLA RTI was indispensable to provide RTI service in the service grid. The difference of interoperability between HLA in military domain and Web service in commercial domain was analyzed. And afterwards, the concept of HLA RTI’s service enabling and its concrete methods were also given. As an emphasis, the key problem and possible solutions of service enabling of HLA RTI were discussed, in terms of the definition of Web Service interface for HLA RTI, message encoding and decoding, invoking status maintenance, RTI deploy pattern, etc. Based on the solutions of these problems, an approach to web enabling HLA RTI and its implementation based on Globus Toolkit were given. In addition, the problem of federates’web service enabling and its solutions were discussed.
The discovery service was indispensable for the service grid to enable resource discovery in grid environment. The resource description was prerequisite for the resource discovery. This dissertation proposed a semantics-based resource description method and corresponding resource matching methods. This method constructed relevant domain ontology for resource description at first, and then used the concepts and relations defined in this ontology to describe the resource; therefore the semantics were introduced for the resource description. As a result, inaccuracy and incompleteness that resulted from semantics shortage were fixed. After constructing the resource description, a discovery service with the ability of auto-organization was proposed. It facilitated management and usage of the service grid, and surmounted performance neck and single fault point that implicitly existed in centralized resource discovery systems.
Service quality assurance was one of the main characteristics that distinguished the Grid technology from other distributed computing technologies. The service grid needed to provide load balance mechanism for parallel and distributed simulation’s execution in grid environments. Simulation task migration was one of main measures to achieve load balance. The studies clarified general migration issue, emphasized on migration protocols and methods for HLA based simulations, and proposed a federate migration method based on mobile agent. And eventually, the load of HLA based simulations was balanced, and promoted the execution efficiency of parallel and distributed simulation in grid environment, through the said method.
Computing resources was one kind of most important resources in the service grid, and was also the most requisite for large scale parallel and distributed simulations. The service grid must support the job of large scale parallel and distributed simulations to run on these multitudes of computing resources. The management and scheduling algorithm of simulation jobs were researched. Based on the research, a simulation execution management service was designed as one important part of the service grid. As a supplement for the simulation execution management service, the simulation basic execution service was designed and further it is discussed how to encapsulate local computing resource as simulation basic execution service.
Based on the proposed overall framework and key technology, a prototype system was designed and implemented. And significantly, it was validated that the above-mentioned key technologies were feasible to fulfill the sharing of simulation resources and supporting the achievement of collaborative simulation, under a typical scenario of some simulations confront system.
引文
[1]邱晓刚,黄柯棣,黄健.先进分布仿真技术基础[M].长沙:国防科技大学机电工程与自动化学院仿真技术研究室, 2003.
[2]朱子玉,李三立,都志辉,等.基于网格的先进分布式仿真系统ADS-G[J].清华大学学报(自然科学版). 2006, 46(1): 82-85.
[3] Global Grid Forum Web Site[EB/OL]. http://www.gridforum.org.
[4] Globus Project Web Site[EB/OL]. http://www.globus.org.
[5] Foster I, Kishimoto H, Savva A, et al. The Open Grid Services Architecture, Version 1.5[EB/OL]. http://www.ogf.org/documents/GFD.80.pdf.
[6] Foster I, Kesselman C, Nick J M, et al. The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration[G]. Globus Project, 2002.
[7] Kuljis J, Paul R J. A Review of Web Based Simulation: Whither We Wander?[C].the 2000 Winter Simulation Conference, 2000.
[8]王江云,彭晓源,王行仁.基于网格技术的先进分布仿真协同环境[J].计算机工程. 2004, 30(8): 98-99.
[9]白涛,曾建潮,王猛.基于WEB的建模与仿真(M&S)系统研究[J].系统仿真学报. 2002, 14(2): 146-148.
[10]时向泉,姚益平.基于WEB的分布式仿真开发环境[J].系统仿真学报. 2000, 12(4): 380-382.
[11] Brutzman D, Zyda M, Pullen J M, et al. Extensible Modeling and Simulation Framework(XMSF): Challenges for Web-based Modeling and Simulation[EB/OL]. http://www.movesinstitute.org/xmsf/xmsf.html
[12] Morse K L, Blais C, Lutz B, et al. XMSF Profile SG Final Report[R]. Simulation Interoperability Standards Organization (SISO), 2005.
[13]何明,裘杭萍,刘晓明.基于XMSF的建模与仿真研究[J].系统仿真学报. 2005, 17(5): 1032-1036.
[14] Blais C, Brutzman D, Drake D, et al. Extensible Modeling and Simualtion Framework (XMSF) 2004 Project Summary Report[R]. Monterey, California: Naval Postgraduate School, 2005.
[15]韩超,郝建国,黄健,等.可扩展建模与仿真框架(XMSF)综述[J].计算机仿真. 2007, 24(1): 6-9.
[16]谭娟,李伯虎,柴旭东.可扩展建模与仿真框架-XMSF技术研究[J].系统仿真学报. 2006, 18(1): 96-101.
[17] Morse K L, Brunton R, Drake D. Web Enabling an RTI– an XMSF Profile[C].Proceedings of the 2003 European Simulation Interoperability Workshop, 2003.
[18] Morse K L, Drake D L, Brunton R P Z. Web Enabling HLA Compliant Simulations to Support Network Centric Applications[2006-7-20]. http://www.dodccrp.org/events/2004/CCRTS_San_Diego/CD/papers/172.pdf
[19] Banks T, Djaoui A, Parastatidis S, et al. Open Grid Service Infrastructure PrimerGlobal Grid Forum[EB/OL]. http://www.ggf.org/ogsi-wg
[20] Tirado-Ramos A, Zajac K, Zhao Z M, et al. Experimental grid access for dynamic discovery and data transfer in distributed interactive simulation systems[C]. COMPUTATIONAL SCIENCE - ICCS 2003, PT I, PROCEEDINGS. 2003, 2657: 284-292.
[21] Tirado-Ramos A, Gualandris A, Zwart S P. Performance of a parallel astrophysical N-body solver on pan-european computational grids[C]. ADVANCES IN GRID COMPUTING - EGC 2005. 2005, 3470: 237-244.
[22] Tirado-Ramos A, Sloot P M, Hoekstra A G, et al. An integrative approach to high-performance biomedical problem solving environments on the grid[J]. PARALLEL COMPUTING. 2004, 30(9-10): 1037-1055.
[23] Bubak M, Malawski M, Zajac K. Towards the CrossGrid architecture[C]. RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, PROCEEDINGS. 2002, 2474: 16-24.
[24] Bubak M, Malawski M, Zajac K. The CrossGrid architecture: Applications, tools, and Grid services[C]. GRID COMPUTING. 2004, 2970: 309-316.
[25] Zajac K, Bubak M, Malawski M, et al. Towards a grid management system for HLA-based interactive simulations[C]. SEVENTH IEEE INTERNATIONAL SYMPOSIUM ON DISTRIBUTED SIMULATION AND REAL-TIME APPLICATIONS, PROCEEDINGS. 2003: 4-11.
[26] Zajac K, Bubak M, Malawski M, et al. Execution and migration management of HLA-Based interactive Simulations on the grid[J]. PARALLEL PROCESSING AND APPLIED MATHEMATICS. 2003: 872-879.
[27] Zajac K, Tirado-Ramos A, Zhao Z M, et al. Grid Services for HLA-based Distributed Simulation Frameworks[C].GRID COMPUTING, 2004.
[28]燕雪峰,李凤霞,战守义,等.仿真网格资源共享池关键技术研究[J].计算机集成制造系统. 2005, 11(8): 1174-1178.
[29]燕雪峰,战守义,柴旭东,等.网格环境中的HLA仿真系统[C].全球制造高级论坛暨21世纪仿真技术研讨会.
[30]燕雪峰,战守义,柴旭东,等.虚拟样机网格及其资源动态管理技术研究[C]. 2003全国系统仿真学术年会.
[31]邸彦强,柴旭东,李伯虎,等. HLA/RTI网格化与以模型为中心的分布仿真互联模式研究[J].计算机集成制造系统. 2006, 12(4): 504-510.
[32]邸彦强,李伯虎,柴旭东,等.多学科虚拟样机协同建模与仿真平台及其关键技术研究[J].计算机集成制造系统. 2005, 11(7): 901-908.
[33]邸彦强,朱元昌,孟宪国,等.基于网格技术的多用户多任务模拟训练系统[J].系统仿真学报. 2008, 20(3): 643-647.
[34] Xie Y, Teo Y M, Cai W T, et al. Service provisioning for HLA-based distributed simulation on the grid[C]. WORKSHOP ON PRINCIPLES OF ADVANCED AND DISTRIBUTED SIMULATION. 2005: 282-291.
[35] Kim C H, Lee T D, Hwang S C, et al. Grid-based Parallel and Distributed Simulation Environment[C].PARALLEL COMPUTING TECHNOLOGIES, 2003.
[36] Komann M, Kauhaus C, Fey D. Calculation of Single-file Diffusion Using Grid-enabled Parallel Generic Cellular Automata Simulation[C].Recent Advances In Parallel Virtual Machine And Message Passing Interface, 2005.
[37] McCollum J M, Peterson G D, Cox C D, et al. Accelerating Gene Regulatory Network Modeling Using Grid-based Simulation[J]. Simulation-Transactions Of The Society For Modeling And Simulation International. 2004, 80(4-5): 231-241.
[38] Wu W, Shen L, Huo H T, et al. Research on Secure Multicast Technology in Grid-based Large-scale Distributed Simulation Applications[C].GRID AND COOPERATIVE COMPUTING GCC 2004 WORKSHOPS, 2004.
[39]张传富,查亚兵,刘云生,等.基于SGE的分布式仿真网格框架研究[J].系统仿真学报. 2006, 18(3): 618-622.
[40]刘云生,张童,张传富,等.异构分布式实时仿真系统的容错调度算法[J].软件学报. 2006, 17(10): 2040-2047.
[41] Foster I, Kesselman C. The Grid 2: Blueprint for a New Computing Infrastructure[M]. BEIJING: Publishing House of Electronics Industry, 2004.
[42] Foster I, Kesselman C, Tuecke S. The Anatomy of the Grid: Enabling Scalable Virtual Organizations[J]. International Journal of High Performance Computing Applications. 2001, 15(3): 200-222.
[43] Messina P, Brunett S, Davis D, et al. Synthetic Forces Express: A New Initiative in Scalable Computing for Military Simulation[EB/OL]. http://www.cacr.caltech.edu/sfexpress/165A.html
[44]卿杜政,熊新平,李伯虎,等.仿真网格的初步实践[J].现代防御技术. 2004, 32(4): 67-72.
[45]魏洪涛,李群,王维平.基于网格的离散事件仿真服务设计[J].系统仿真学报. 2005, 17(10): 2567-2570.
[46] Wu W, Zhou Z, Wang S F, et al. Aegis: a Simulation Grid Oriented to Large-scale Distributed Simulation[C].GRID AND COOPERATIVE COMPUTING GCC 2004, 2004.
[47] Wu W, Huang H, Zhou Z, et al. A genetic algorithm-based routing service for simulation grid[C].ADVANCES IN NATURAL COMPUTATION, 2005.
[48]高明,凌云翔,邱涤珊.面向指挥自动化效能评估的仿真网格系统[J].火力与指挥控制. 2004, 29(4): 29-32.
[49]李妮,彭晓源,徐丽娟,等.基于网格的HLA/RTI仿真系统互联与资源共享[J].系统仿真学报. 2006, 18(z2): 304-307.
[50]李妮,肖振,徐丽娟,等.基于网格技术的仿真系统互联与互操作[J].计算机工程. 2008, 34(1): 134-136.
[51]徐丽娟.基于HLA的仿真服务总线研究[C].哈尔滨: 20060801.
[52]徐丽娟,彭晓源.基于网格的RTI资源管理系统[J].系统仿真学报. 2005, 17(8): 2012-2014.
[53]魏洪涛.基于网格计算的仿真任务管理与调度方法研究[D].长沙:国防科技大学, 2005.
[54]魏洪涛,李群,王维平.基于网格的离散事件仿真服务设计[J].系统仿真学报. 2005, 17(10): 2567-2570.
[55]魏洪涛,石峰,李群,等.网格计算在军事仿真中的应用[J].系统仿真学报. 2005, 17(3): 746-750.
[56]刘鹏,王立华.走向军事网格时代[M].解放军出版社, 2004.
[57]郑志蕴.网格技术在现代军事中应用的研究[C].北京: 20050701.
[58] The Dod Cio. Department of Defense Global Information Grid Architectural Vision[EB/OL]. http://www.defenselink.mil/cio-nii/docs/GIGArchVision.pdf.
[59] Numrich S K, Hieb M, Tolk A. M&S in the GIG Environment: An Expanded View of Distributing Simulation[C].Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), 2004.
[60]邸彦强,柴旭东,李伯虎,等. HLA/RTI网格化与以模型为中心的分布仿真互联模式研究[J].计算机集成制造系统. 2006, 12(4): 504-510.
[61]邸彦强,李伯虎,柴旭东,等.多学科虚拟样机协同建模与仿真平台及其关键技术研究[J].计算机集成制造系统. 2005, 11(7): 901-908.
[62]侯宝存,柴旭东,李伯虎,等.面向多学科虚拟样机协同仿真的仿真网格技术研究[J].计算机集成制造系统. 2006, 12(12): 2004-2010.
[63]侯宝存,李伯虎,柴旭东,等.虚拟样机设计仿真环境中多领域工具集成的研究[J].系统仿真学报.2004, 16(2): 234-241.
[64]李伯虎,柴旭东,侯宝存,等.仿真网格Cosim-Grid的研究与应用[C]. 2006.
[65]李伯虎,柴旭东,朱文海,等.现代建模与仿真技术发展中的几个焦点[J].系统仿真学报. 2004, 16(9): 1871-1878.
[66]李伯虎,柴旭东,朱文海,等. SBA支撑环境技术的研究[J].系统仿真学报. 2004, 16(2): 181-185.
[67]李伯虎,王行仁,黄柯棣,等.综合仿真系统研究[J].系统仿真学报. 2000, 12(5): 429-434.
[68]杜强芳,杨明,王子才.建模与仿真资源库系统的初探[J].系统仿真学报. 2003, 15(2): 161-163.
[69]杨明,张冰,王子才.建模与仿真技术的发展趋势[J].系统仿真学报. 2004, 16(9): 1901-1904.
[70]杜强芳,杨明,王子才.建模与仿真资源库系统的初探[J].系统仿真学报. 2003, 15(2): 161-163.
[71]张传富,刘云生,张童,等.仿真网格原型系统的设计与实现[J].国防科技大学学报. 2005, 27(4): 75-80.
[72]张传富,查亚兵,刘云生,等.仿真网格中预防死锁的资源分配方法及其仿真分析[J].系统仿真学报. 2006, 18(9).
[73]张传富.仿真网格资源管理系统关键技术研究[D].长沙:国防科学技术大学, 2006.
[74]张传富,刘云生,张童,等.分布式仿真网格平台的关键技术研究[J].系统仿真学报. 2005, 17(10): 2552-2555,2559.
[75]张传富,查亚兵,刘云生,等.基于SGE的分布式仿真网格框架研究[J].系统仿真学报. 2006, 18(3): 618-622.
[76]凌云翔.基于HLA/RTI分布交互仿真系统的体系结构及其时间管理的研究与实现[D].长沙:国防科学技术大学, 1999.
[77]凌云翔,廖虎雄,史湘宁,等.仿真网格原型系统SimGrid-HLA的设计与实现[J].系统仿真学报. 2005, 17(12): 2953-2956.
[78]凌云翔,邱涤珊,史湘宁.基于HLA的仿真网格系统设计问题[J].系统仿真学报. 2006, 18(1): 88-90.
[79] Tan G Z, Li C X, Wu J K. A service-oriented framework for traffic information grid[J]. SCIENTIFIC APPLICATIONS OF GRID COMPUTING. 2004, 3458: 197-206.
[80] Zhang J, Yang D Y, Tong X H. Architecture of logistics information grid[C]. PROCEEDINGS OF THE CHINA ASSOCIATION FOR SCIENCE AND TECHNOLOGY, VOL 1, NO 1. 2004: 355-361.
[81] Paul R A. DoD towards software services[C]. WORDS 2005: 10TH IEEE INTERNATIONAL WORKSHOP ON OBJECT-ORIENTED REAL-TIME DEPENDABLE, PROCEEDINGS. 2005: 3-6.
[82] Yang G W, Shi S M, Wang D X, et al. DSI: Distributed service integration for service grid[J]. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY. 2003, 18(4): 474-483.
[83] Zeng B, Hu T, Li Z T. Grid-based resource management of naval weapon systems[J]. GRID AND COOPERATIVE COMPUTING, PT 2. 2004, 3033: 149-152.
[84] Fox G, Ho A, Pallickara S, et al. Grids for the GiG and real time simulations[C]. NINTH IEEE INTERNATIONAL SYMPOSIUM ON DISTRIBUTED SIMULATION AND REAL-TIME APPLICATIONS, PROCEEDINGS. 2005: 129-136.
[85] Capraro G, Wicks M, Berdan G, et al. Knowledge discovery for an autonomous intelligent radar system (AIRS)[C]. ICAI '05: PROCEEDINGS OF THE 2005 INTERNATIONAL CONFERENCE ON ARTIFICAL INTELLIGENCE, VOLS 1 AND 2. 2005: 136-142.
[86] Smirnov A, Pashkin M, Chilov N, et al. Knowledge logistics in information grid environment[J]. FUTURE GENERATION COMPUTER SYSTEMS. 2004, 20(1): 61-79.
[87] You G M, Liao H M, Sun Y Z. Mapping publishing and mapping adaptation in the middleware of railway information grid systemCJ]. NETWORK AND PARALLEL COMPUTING, PROCEEDINGS. 2004, 3222: 110-117.
[88] Isenor A W. Metadata requirements in a multi-layered networked environment[C]. MILCOM 2005 - 2005 IEEE MILITARY COMMUNICATIONS CONFERENCE, VOLS 1-5. 2005: 3212-3218.
[89] Hayes-Roth F. Model-based communication networks and VIRT: Orders of magnitude better for information superiority[C]. MILCOM 2006, VOLS 1-7. 2006: 3460-3466.
[90] Stevens R D, Robinson A J, Goble C A. myGrid: personalised bioinformatics on the information grid.[J]. Bioinformatics. 2003, 19 Suppl 1: i302-4.
[91] Gou H Y, Kong X S, Miao F. Research on government information-sharing model based on metadata[C]. ORIENT ACADMIC FORUM SPECIAL. 2004: 365-369.
[92] Wu J, Zhou R, Zhang P. Service oriented architecture (SOA) on Distributed Interactive Simulation[J]. SYSTEM SIMULATION AND SCIENTIFIC COMPUTING, VOLS 1 AND 2, PROCEEDINGS. 2005: 383-387.
[93] Li M L, Wu M Y, Li Y, et al. ShanghaiGrid: an Information Service Grid[J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE. 2006, 18(1): 111-135.
[94] Tang Y, Chen L, He K T, et al. SIG: A service-oriented application grid for spatial information sharing and integrating[C]. PDPTA '04: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS 1-3. 2004: 915-921.
[95] Wu C L, Wang J Q, Xue Y, et al. Study of task managing strategy in remote sensing information analysis and service grid node[C]. IGARSS 2005: IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOLS 1-8, PROCEEDINGS. 2005: 596-599.
[96] Xu Z W, Yang N, Liao H M. Vega information grid for collaborative computing[J]. COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN I. 2004, 3168: 1-10.
[97] Tiobe Programming Community Index For February 2009[EB/OL]. http://www.tiobe.com/index.php/content/paperinfo/tpci/index.html.
[98] USJFCom: Millennium Challenge 2002[EB/OL]. http://www.jfcom.mil/about/experiments/mc02.htm.
[99] Society I C. Standard for Modeling and Simulation (M&S) High Level Architecture (HLA) - Framework and Rules[S]. 2000.
[100] Society I C. Standard for Modeling and Simulation (M&S) High Level Architecture (HLA) Federate Interface Specification[S]. 2000.
[101] Society I C. Standard for Modeling and Simulation (M&S) High Level Architecture (HLA) - HLA Object Model Template (OMT) Specification[S]. 2000.
[102] Sohn M M. Advanced M&S framework based on autonomous web service in Korea: Intelligent-XMSF approach[J]. SYSTEMS MODELING AND SIMULATION: THEORY AND APPLICATIONS. 2005, 3398: 150-158.
[103] Halstenberg S, Stucky K U, Suss W. A grid environment for simulation and optimization and a first implementation of a biomedical application[C].ON THE MOVE TO MEANINGFUL INTERNET SYSTEMS 2004: OTM 2004 WORKSHOPS, 2004.
[104] Chernigovski S, Grott M, Glatzel W. A grid reconstruction procedure for the simulation of instabilities in luminous blue variables[J]. Monthly Notices Of The Royal Astronomical Society. 2004, 348(1): 192-200.
[105]刘海波.基于XMSF的一种新型RTI的设计与实现[C].珠海: 20070801.
[106]谭娟,李伯虎,柴旭东.可扩展建模与仿真框架-XMSF技术研究[J].系统仿真学报. 2006, 18(1): 96-101.
[107] Prti[EB/OL]. http://www.pitch.se/products/prti.
[108] M?k Rti[EB/OL]. http://www.mak.com/products/rti.php.
[109] Bh Rti[EB/OL]. http://www.hlarti.com/.
[110] Portico[EB/OL]. http://www.porticoproject.org/index.php?title=Main_Page.
[111] Sourceforge.net: Open Hla[EB/OL]. http://sourceforge.net/projects/ohla/.
[112] CERTI[EB/OL]http://savannah.nongnu.org/projects/certi.
[113] M?ller B, Morse K L, Mikelightner. HLA Evolved– A Summary of Major Technical Improvements[C].08f-siw-064, 2008.
[114] Foster I, Kishimoto H, Savva A, et al. The Open Grid Services Architecture, Version 1.0[EB/OL]. http://forge.gridforum.org/projects/ogsa-wg
[115] Foster I. What is the Grid? A three checkpoints list[J]. GridToday Daily News and Information for the Global Community. 2002.
[116] Berman F, Fox G C, Hey T. Grid Computing: Making the Global Infrastructure a Reality[M]. Huazhong Science and Technology University Press, 2004.
[117] Joseph J, Fellenstein C. Grid Computing[M]. Tsinghua University Press, 2005.
[118] Foster I, Gannon D, Kishimoto H. OGSA Tier 1 Use Case Draft Document[EB/OL]. http://www.ogf.org/documents/GFD.29.pdf.
[119] Kishimoto H, Treadwell J. Defining the Grid: A Roadmap for OGSA Standards v 1.0[EB/OL]. http://www.ogf.org/documents/GFD.53.pdf.
[120] Foster I, Maguire T, Snelling D. OGSA WSRF Basic Profile, Version 1.0[EB/OL]. http://www.ogf.org/documents/GFD.72.pdf.
[121] Cai W, Turner S, Zhao H. A Load Management System for Running HLA-based Distributed Simulations over the Grid[C].the 6th IEEE International Workshop on Distributed Simulation and Real-Time Applications, 2002.
[122] Li Y, Mascagni M. Analysis of Large-scale Grid-based Monte Carlo Applications[J]. International Journal Of High Performance Computing Applications. 2003, 17: 369-382.
[123]怀进鹏,胡春明,李建欣,等. CROWN:面向服务的网格中间件系统[J].中国科学E辑信息科学. 2006, 36(10): 1127-1155.
[124] Brunton R P Z, Morse K L, Drake D L, et al. Design Principles for a Grid-Based HLA Federation[C].04E-SIW, 2004.
[125] Perles A, Marti A, Rodriguez F, et al. Experiences on parallel replicated discrete-event simulation on a GRID[C].GRID AND COOPERATIVE COMPUTING, 2005.
[126] Tirado-Ramos A, Zajac K, Zhao Z M, et al. Experimental Grid Access for Dynamic Discovery and Data Transfer in Distributed Interactive Simulation Systems[C].COMPUTATIONAL SCIENCE - ICCS 2003, 2003.
[127] Xu K, Wang Y, Wu C. Formal verification technique for grid service chain model and its application[J]. Science in China Series F: Information Sciences. 2007, 14(1): 1-20.
[128] Woods C J, Ng M H, Johnston S, et al. Grid Computing and Bimolecular Simulation[J]. Philosophical Transactions Of The Royal Society Of London Series A-Mathematical Physical And Engineering Sciences.2005, 363(1833): 2017-2035.
[129] Zajac K, Tirado-Ramos A, Zhao Z M, et al. Grid services for HLA-based distributed simulation frameworks[J]. GRID COMPUTING. 2004, 2970: 147-154.
[130] Cao Y, Jin X L. Grid-based distributed simulation of an aero engine[J]. International Journal Of Advanced Manufacturing Technology. 2006, 27(7-8): 631-637.
[131] Krzhizhanovskaya V V, Sloot P, Gorbachev Y E. Grid-based Simulation of Industrial Thin-Film Production[J]. Simulation-Transactions Of The Society For Modeling And Simulation International. 2005, 81(1): 77-85.
[132]Mourino J C, Martin M J, Gonzalez P, et al. Grid-enabled Air Quality Simulation[C].GRID COMPUTING, 2003.
[133] Mustafee N, Alstad A, Larsen B, et al. Grid-enabling FIRST: speeding up simulation applications using WinGrid[C].Tenth IEEE International Symposium on Distributed Simulation and Real-Time Applications, 2006.
[134] Hulsemann F, Kipfer P, Rude U, et al. gridlib: Flexible and efficient grid management for simulation and visualization[C].COMPUTATIONAL SCIENCE-ICCS 2002, 2002.
[135] Leite M. Modeling and Simulation Applications On the Global Information Grid[C].2005 Spring Simulation Interoperability Workshop, 2005.
[136] Dong Y, Yang J, Wu Z. ODSG: An Architecture of Ontology-based Distributed Simulation on Grid[J].
[137] Li N, Xiao Z, Xu L, et al. Research and realization of collaborative M&S services in simulation grid[C].2006.
[138] Ledlie J, Shneidman J, Seltzer M, et al. Scooped, Again[J].
[139]黄继杰,李伯虎,柴旭东.网格环境下的Web-Enabled RTI研究[J].系统仿真学报. 2007, 19(18): 4189-4192.
[140] Chen X, Cai W, Turner S J, et al. SOAr-DSGrid: Service-Oriented Architecture for Distributed Simulation on the Grid[C].the 20th Workshop on Principles of Advanced and Distributed Simulation (PADS'06), 2006.
[141] Garcia J. Technical and Operational Constraints for Web Based M&S Services for the Global Information Grid[C].2005 Spring Simulation Interoperability Workshop, 2005.
[142] Foster I, Tuecke S. The Different Faces Of IT as Service[J]. Queueing Systems. 2005.
[143] Sotomayor B. The Globus Toolkit 4 Programmer's Tutorial[EB/OL]. Chicago, US: Department of Computer Science, University of Chicago, 2005.
[144] Berners-Lee T, Hendler J, Lassila O. The Semantic Web[2006-7-1]. http://www.sciam.com/article.cfm?articleID=00048144-10D2-1C70-84A9809EC588EF21&pageNumber=1&catID=2
[145] Talia D, Trunfio P. Toward a Synergy Between P2P and Grids[J]. IEEE Internet Computing. 2003.
[146] Yang J H, Wu Z H, Tang S L, et al. Virtual Battlefield Attack-Defense Countermeasure Simulation on the Grid[C].GRID AND COOPERATIVE COMPUTING GCC 2004 WORKSHOPS, 2004.
[147] Christensen E, Curbera F, Meredith G, et al. Web Services Description Language (WSDL) Version 1.2[S]. Consortium W W W, 2003.
[148]苏森,唐雪飞,开放系统中的互操作性[J],计算机应用,Vol. 17, No. 6,1997年11月.
[149] Michael D. Myjak, Duncan Clark and Tom Lake. RTI interoperability study group final report[R], 99F-SIW-001, Sep. 1999.
[150] Tolk A, Muguira J. The Levels of Conceptual Interoperability Model(LCIM)[C].Fall SimulationInteroperability Workshop, 2003.
[151]张和明,王宏伟,贾丽.基于Web服务和HLA的分布式建模与仿真环境[J].系统仿真学报. 2006, 18(S2): 343-346.
[152] Yang J H, Wu Z H, Tang S L, et al. Virtual Battlefield Attack-Defense Countermeasure Simulation on the Grid[C].GRID AND COOPERATIVE COMPUTING GCC 2004 WORKSHOPS, 2004.
[153] Morse K L, Brunton R, Drake D. Web Enabling an RTI– an XMSF Profile[C]. Proceedings of the 2003 European Simulation Interoperability Workshop.
[154] Web Services Description Language (wsdl) 1.1[EB/OL]. http://www.w3.org/TR/wsdl.
[155]周忠,刘钟书.分布交互仿真运行平台BH RTI的研究[J].计算机研究与发展. 2005, 42(S): 517-522.
[156]周昌首. HLA/RTI分布平台研究[D].西安:西安电子科技大学, 2002.
[157]姚益平,卢锡城,王怀民.层次式RTI服务器的设计与实现[J].计算机学报. 2003, 26(6): 716-721.
[158]姚益平,卢锡城. HLA/RTI时间管理的一种优化算法[J].电子学报. 2004, 32(2): 294-297.
[159]徐哲锋,钟海荣,金士尧. HLA/RTI功能扩展研究与实现[J].计算机仿真. 2006, 23(9): 144-148.
[160]唐见兵,李革,杨海刚. KD-RTI软件的测试研究[J].计算机工程. 2007, 33(3): 62-64.
[161] Zhang Y C, Sun G J, Yan H R, et al. Research on time advance mechanism of distributed interactive simulation based on HLA/RTI[J]. ISTM/2003: 5TH INTERNATIONAL SYMPOSIUM ON TEST AND MEASUREMENT, VOLS1-6, CONFERENCE PROCEEDINGS. 2003: 3269-3272.
[162] Yuan Z J, Cai W T, Low M Y. A framework for executing parallel simulation using RTI[J]. SEVENTH IEEE INTERNATIONAL SYMPOSIUM ON DISTRIBUTED SIMULATION AND REAL-TIME APPLICATIONS, PROCEEDINGS. 2003: 12-19.
[163] Xu Y B, Yu M Q, Wang X G. Research and development on AST-RTI[J]. SYSTEMS MODELING AND SIMULATION: THEORY AND APPLICATIONS. 2005, 3398: 361-366.
[164] Van H C, Pearce T. The SIP-RTI: An HLA RTI implementation supporting interoperability[J]. DS-RT 2006: TENTH IEEE INTERNATIONAL SYMPOSIUM ON DISTRIBUTED SIMULATION AND REAL-TIME APPLICATIONS, PROCEEDINGS. 2006: 227-234.
[165] Taylor S J, Sudra R. Modular HLA RTI services: The GRIDS approach[J]. SIXTH IEEE INTERNATIONAL WORKSHOP ON DISTRIBUTED SIMULATION AND REAL-TIME APPLICATIONS, PROCEEDINGS. 2002: 15-22.
[166] Shi X X, Zhong Q H. The introduction on High Level Architecture (HLA) and Run-time Infrastructure (RTI)[J]. SICE 2003 ANNUAL CONFERENCE, VOLS 1-3. 2003: 1136-1139.
[167] Perumalla K S, Park A, Fujimoto R M, et al. Scalable RTI-Based parallel simulation of networks[J]. SEVENTEENTH WORKSHOP ON PARALLEL AND DISTRIBUTED SIMULATION (PADS 2003), PROCEEDINGS. 2003: 97-104.
[168] Pan K, Turner S J, Cai W T, et al. A service oriented HLA RTI on the grid[J]. 2007 IEEE INTERNATIONAL CONFERENCE ON WEB SERVICES, PROCEEDINGS. 2007: 984-992.
[169] Lee T D, Jin J H, Jeong C S. Object-oriented design of RTI using design patterns[J]. OBJECT-ORIENTED INFORMATION SYSTEMS. 2003, 2817: 329-333.
[170] Huang J, Li B H, Chai X, et al. Web-HLA and Service-Enabled RTI in the Simulation Grid[J]. AsiaSim 2007. 2008: 195-204.
[171] Fujimoto R, McLean T, Perumalla K, et al. Design of high performance RTI software[J]. FOURTH IEEE INTERNATIONAL WORKSHOP ON DISTRIBUTED SIMULATION AND REAL-TIME APPLICATIONS (DS-RT 2000), PROCEEDINGS. 2000: 89-96.
[172] Pullen J M, Brunton R, Brutzman D, et al. Using Web Services to Integrate Heterogeneous Simulations in a Grid Environment[J]. Computational Science - ICCS 2004. 2004: 835-847.
[173] Zhang Y, Cai W T, Turner S J. A Parallel Object-oriented Manufacturing Simulation Language[J]. 15TH WORKSHOP ON PARALLEL AND DISTRIBUTED SIMULATION, PROCEEDINGS. 2001: 101-108.
[174] Mōller B, Lōf S. A Management Overview of the HLA Evolved Web Service API[C].Proceedings of 2006 Fall Simulation Interoperability Workshop, 2006.
[175] Mōller B, Lōf S. Mixing Service Oriented and High Level Architectures in Support of the GIG[C].Proceedings of the 2005 Spring Simulation Interoperability Workshop, 2005.
[176] Mōller B, Dahlin C, Karlsson M. Developing Web Centric Federates and Federations using the HLA Evolved Web Services API[C].Proceedings of 2007 Spring Simulation Interoperability Workshop, 2007.
[177] Mōller B, Dahlin C. A First Look at the HLA Evolved Web Service API[C]. Proceedings of the 2006 European Simulation Interoperability Workshop, 2006.
[178] Organization S I S. Base Object Model (BOM) Template Specification[S]. 2006.
[179] Organization S I S. Dynamic Link Compatible HLA API Standard for the HLA Interface Specification (IEEE 1516.1 Version)[S]. 2004.
[180] Organization S I S. Dynamic Link Compatible HLA API Standard for the HLA Interface Specification Version 1.3[S]. 2004.
[181] Organization S I S. Guide for Base Object Model(BOM) Use and Implementation[S]. 2006.
[182] Organization S I S. HLA-Evolved PDG - High Level Architecture-Evolved2007[17/10]. http://www.sisostds.org/index.php?tg=articles&idx=More&article=47&topics=25
[183] Lees M, Logan B, Theodoropoulos G K. Agents, games and HLA[J]. SIMULATION MODELLING PRACTICE AND THEORY. 2006, 14(6): 752-767.
[184] Rycerz K, Bubak M, Malawski M, et al. A framework for HLA-based interactive simulations on the grid[J]. SIMULATION-TRANSACTIONS OF THE SOCIETY FOR MODELING AND SIMULATION INTERNATIONAL. 2005, 81(1): 67-76.
[185] Rycerz K, Bubak M, Malawski M, et al. A Grid service for management of multiple HLA federate processes[J]. PARALLEL PROCESSING AND APPLIED MATHEMATICS. 2006, 3911: 699-706.
[186] Mochol M, Simperl E P. A high-level architecture of a metadata-based ontology matching framework[C]. SEVENTEENTH INTERNATIONAL CONFERENCE ON DATABASE AND EXPERT SYSTEMS APPLICATIONS, PROCEEDINGS. 2006: 354-358.
[187] Cetinkaya D, Oguztuzun H. A metamodiel for the HLA object model[C]. 20TH EUROPEAN CONFERENCE ON MODELLING AND SIMULATION ECMS 2006. 2006: 207-213.
[188] Ju R S, Han C, Qiu X, et al. A novel approach for architecting military knowledge discovery engine utilizing SVM[J]. DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS. 2006, 13S(3): 1127-1131.
[189] Adelantado M, Damioli C, Dedieu A. A reusable HLA federation for simulation of airport traffic assistance/automation systems[C]. IEEE 5TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, PROCEEDINGS. 2002: 886-891.
[190] Lee T D, Yoo S H, Jeong C S. HLA-based object-oriented modeling/simulation for military system[J]. SYSTEMS MODELING AND SIMULATION: THEORY AND APPLICATIONS. 2005, 3398: 122-130.
[191] Morse K L, Brunton R, Pullen J M, et al. An architecture for web services based interest management in real time distributed simulation[C]. EIGHTH IEEE INTERNATIONAL SYMPOSIUM ONDISTRIBUTED SIMULATION AND REAL-TIME APPLICATIONS, PROCEEDINGS. 2004: 108-115.
[192] Yuan Z, Cai W, Low M Y H, et al. Federate Migration in HLA-based Distributed Simulation[C].International Conference on Computational Science (ICCS2004), 2004.
[193] Cai W T, Yuan Z J, Low M Y, et al. Federate migration in HLA-based simulation[J]. FUTURE GENERATION COMPUTER SYSTEMS. 2005, 21(1): 87-95.
[194] Zong W B, Wang Y, Cai W T, et al. Grid services and service discovery for HLA-based distributed simulation[C]. EIGHTH IEEE INTERNATIONAL SYMPOSIUM ON DISTRIBUTED SIMULATION AND REAL-TIME APPLICATIONS, PROCEEDINGS. 2004: 116-124.
[195] Zajac K, Tirado-Ramos A, Zhao Z M, et al. Grid services for HLA-based distributed simulation frameworks[J]. GRID COMPUTING. 2004, 2970: 147-154.
[196] Krzhizhanovskaya V V, Sloot P M, Gorbachev Y E. Grid-based simulation of industrial thin-film production[J]. SIMULATION-TRANSACTIONS OF THE SOCIETY FOR MODELING AND SIMULATION INTERNATIONAL. 2005, 81(1): 77-85.
[197] Mochol M, Simperl E P. A high-level architecture of a metadata-based ontology matching framework[C]. SEVENTEENTH INTERNATIONAL CONFERENCE ON DATABASE AND EXPERT SYSTEMS APPLICATIONS, PROCEEDINGS. 2006: 354-358.
[198] Thiyagalingam J, Getov V, Panagiotidi S, et al. Domain-specific metadata for model validation and performance optimisation[J]. ACHIEVEMENTS IN EUROPEAN RESEARCH ON GRID SYSTEMS. 2008: 165-177.
[199] Lacy L, Gerber W. Potential Modeling and Simulaiton Applications of the Web Ontology Language - OWL[C].the 2004 Winter Simulation Conference, 2004.
[200] Cai W T, Wang S R, Jiang Q S. Address extraction: A graph matching and ontology-based approach to conceptual information retrieval[C]. PROCEEDINGS OF THE 2004 INTERNATINAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7. 2004: 1571-1576.
[201] Nadarajan G, Chen-Burger Y H. An ontology-based conceptual mapping framework for translating FBPML to the Web Services Ontology[C]. SIXTH IEEE INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID. 2006: 158-165.
[202] Nadarajan G, Chen-Burger Y H. An ontology-based conceptual mapping framework for translating FBPML to the Web Services Ontology[C]. SIXTH IEEE INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID. 2006: 158-165.
[203] Pahlevi S M, Kojima I. Ontology-based grid index service for advanced resource discovery and monitoring[J]. ADVANCES IN GRID COMPUTING - EGC 2005. 2005, 3470: 144-153.
[204]陶先平,吕建,马晓星,等.移动agent系统基准模型的研究[J].电子学报. 2002, 30(12A): 2119-2121.
[205]吕建,陶先平,马晓星,等.移动Agent技术的研究与应用[J].电子学报. 2005, 33(12A): 2413-2417.
[206] Zajac K, Tirado-Ramos A, Zhao Z, et al. Grid Services for HLA-Based Distributed Simulation Frameworks[J]. Grid Computing. 2004: 147-154.
[207] Zajac K, Bubak M, Malawski M, et al. Execution and Migration Management of HLA-Based Interactive Simulations on the Grid[J]. Parallel Processing and Applied Mathematics. 2004: 872-879.
[208] Tirado-Ramos A, Zajac K, Zhao Z, et al. Experimental Grid Access for Dynamic Discovery and Data Transfer in Distributed Interactive Simulation Systems[C]. Computational Science—ICCS 2003. 2003: 284-292.
[209] Bubak M, Malawski M, Zajac K. Grid Architecture for Interactive Applications[J]. Parallel Processing and Applied Mathematics. 2004: 812-820.
[210] Bubak M, Malawski M, Zajac K. The CrossGrid Architecture: Applications, Tools, and Grid Services[J]. Grid Computing. 2004: 309-316.
[211] Schuller B, Menday R, Streit A. A Versatile Execution Management System for Next-Generation UNICORE Grids[J]. Euro-Par 2006: Parallel Processing. 2007: 195-204.
[212] Stuer G, Sunderam V, Broeckhove J. Towards OGSA compatibility in alternative metacomputing frameworks[C]. COMPUTATIONAL SCIENCE - ICCS 2004, PT 1, PROCEEDINGS. 2004, 3036: 51-58.
[213] Lu T C, Hsu C H, Fu M C. HLA simulation using data compensation model[J]. SYSTEMS MODELING AND SIMULATION: THEORY AND APPLICATIONS. 2005, 3398: 367-375.
[214] Tan G, Persson A, Ayani R. HLA Federate Migration[C]. the 38th Annual Symposium on Simulation.
[215]刘云生,张传富,张童,等.分布式仿真系统socket迁移[J].系统仿真学报. 2006, 18(2): 370-372.
[216] Condor[EB/OL]. http://www.cs.wisc.edu/condor/.
[217] Sun Grid Engine[EB/OL]. http://www.sun.com/software/Gridware/.
[218] Portable Batch System[EB/OL]. http://www.openpbs.org/.
[219] Platform Computing[EB/OL]. http://www.platform.com.
[220]黄健. HLA仿真系统软件支撑框架及其关键技术研究[D].长沙:国防科技大学, 2000.
[221]邱晓刚,郝建国,龚建兴,等.联邦与成员开发实验材料[R].长沙:国防科技大学机电工程与自动化学院仿真技术研究室, 2003.