数据网格副本管理关键技术研究
|
摘要
信息技术的发展使政府、企业、教育科研、医疗卫生等各部门纷纷在Internet提供的信息服务平台上开展业务。由于Internet缺乏对数据共享和协同问题求解的有效支持,使上述应用领域中的很多信息系统存在资源部门割据、信息分散、数据难于查找、应用系统相互孤立、难以互联互通等问题。
数据网格(Data Grid)面向广域网异构环境,为用户建立分布、异构、海量数据的一体化访问、存储、传输、管理与服务架构,是实现广域网环境下数据共享和协同问题求解的有效途径。数据网格技术可以为政府、企业、教育科研、医疗卫生等领域中的大量数据提供有效管理和共享的途径。
面向上述应用领域的数据网格系统通常表现出如下特点:系统具有P2P结构;网络通信能力有限;各节点的存储能力有限等,我们将这种网络环境称之为“低端计算环境”。在数据网格系统中,复制技术被广泛采用以提高系统性能,缩短数据响应时间并降低网络带宽消耗,复制技术的引入带来了副本管理问题,而副本管理的效率直接影响了系统的性能。目前,副本管理问题是业界广泛关注的热点问题。为了提高运行在“低端计算环境”上的数据网格系统的性能,本文致力于研究适应低端计算环境的数据网格副本管理关键技术。
本文以系统性能、可用性和可扩展性为目标,针对低端数据网格系统的特点,开展低端数据网格系统中副本管理技术的研究。本文的主要贡献在于:
1.提出了NLPR数据网格复制模型,建立了数据网格系统中副本管理各类问题的统一描述,简化了副本管理问题的求解过程;提出了基于服务合成的副本管理服务框架SCRMSA,为面向不同应用领域的数据网格副本管理服务提供了一种开放、透明、灵活的实现方案;在此基础上,提出了数据网格系统管理模型DGRMSM,实现对数据网格副本的透明、可扩展、开放的管理。
2.提出了“存储联盟”的概念,并以此为基础提出了基于存储联盟的双层动态副本创建策略SADDRES,建立了存储联盟间利用缓存建立数据副本、存储联盟内根据用户访问历史合理分布数据的副本创建策略。
3.基于“存储联盟环”的结构,提出了层次式副本定位与选择机制SAHRLSM,主要包括副本目录SARRC、副本定位算法SAHRLM和副本选择算法SAHRSM,并实现了网格节点和存储联盟的动态性管理、副本目录的一致性维护等机制,具有负载均衡、可靠性高以及可扩展性好等优点。
4.为了实现对网格副本的一致性管理并屏蔽不同网格应用的差异,引入了副本一致性管理服务RCMS,为数据网格系统提供了分布、高效、灵活的副本一致性管理机制;基于低端数据网格系统的特点,提出了基于视图和版本的副本一致性管理策略VVRCOMS,该策略采用版本机制对副本进行管理,在保证用户视图一致性的前提下,具有较好的系统性能。
With the promotion of information technology, many business systems have been developed on the Internet in domains as diverse as government, business, and education. The combination of large dataset size, geographic distribution of user and resource, cooperative heterogeneous resource access and resource sharing on wide-area network results in stringent demands that are not satisfied by any traditional data management technology.Data Grid provides a mechanism for effective distributed resources sharing and transparent remote access to heterogeneous data on wide-area network. It can be applied to manage and share the large datasets effectively in domains such as government, business, and education.The Data Grid systems applied in domains mentioned above have the following characteristics: P2P topology, limited communication capability and limited storage capability. We call the computing environment with those characteristics "Low-end Computing Environment" and the Data Grid systems running on the Low-end Computing Environment "Low-end Data Grid". In distributed systems, data replication is a well-known and widely accepted technique to reduce data response time and network bandwidth consuming. However, the replication in Data Grid brings a series of replica management problems that affect the performance of Data Grid System greatly and replica management becomes a hot topic in Data Grid. The performance requirement of Low-end Data Grid is driving force for this thesis.The main contributions of the thesis in theoretical, technical and practical aspects are as follows:1. To give a uniform description of replication technology in Data Grid, the thesis presents a replication model NLPR on which replica management related mechanisms could be clearly described. A replica management service implementation skeleton-SCRMSA is proposed to provide a solution to open, transparent and flexible replica management services in different fields. Based on SCRMSA, the thesis puts forward a transparent, scalable and flexible data grid replica management system model DGRMSM.2. The thesis gives a new concept-Storage Alliance, based on which a dynamic replica creation strategy SADDRES is presented. SADDRES creates replicas by cache among Storage Alliances, and optimize the data distribution of a Storage Alliance according to users' access history.3. Replica location and selection mechanism is the key issue of data
management and access in Data Grid. To provide a load-balanced, high-performance, and high-scalable replica management, the thesis explores a hierarchical replica location and selection mechanism SAHRLSM. SAHRLSM includes SARRC replica catalog, SAHRLM replica location mechanism and SAHRSM replica selection mechanism. It also provides a series of methods to manage the dynamics of nodes, the dynamics of Storage Alliances and the consistency of SARRC replica catalog.4. It is a tough task to achieve the consistency of the replicas in deferent data grid applications. In the thesis, a replica consistency management service RCMS is introduced to provide distributed, high-efficient and flexible replica consistency management. Considering the characteristics of Low-end Data Grid, the thesis proposes a view and version based replica consistency management strategy VVRCOMS. VVRCOMS adopts version mechanism to manage the replicas and achieves high system performance by assuring the view consistency of users.5. In order to evaluate the mechanisms above, the Data Grid simulation tool-OptorSim is adopted. By extending OptorSim, we implement the replica management system StarRMS, which includes all mechanisms we proposed. The experimental results show that our replica management mechanisms are correct and effective. By adjusting environment variables of OptorSim, we test the performance of StarRMS in different computing environments. The results will be a valuable reference to the application of StarRMS in future.
数据网格(Data Grid)面向广域网异构环境,为用户建立分布、异构、海量数据的一体化访问、存储、传输、管理与服务架构,是实现广域网环境下数据共享和协同问题求解的有效途径。数据网格技术可以为政府、企业、教育科研、医疗卫生等领域中的大量数据提供有效管理和共享的途径。
面向上述应用领域的数据网格系统通常表现出如下特点:系统具有P2P结构;网络通信能力有限;各节点的存储能力有限等,我们将这种网络环境称之为“低端计算环境”。在数据网格系统中,复制技术被广泛采用以提高系统性能,缩短数据响应时间并降低网络带宽消耗,复制技术的引入带来了副本管理问题,而副本管理的效率直接影响了系统的性能。目前,副本管理问题是业界广泛关注的热点问题。为了提高运行在“低端计算环境”上的数据网格系统的性能,本文致力于研究适应低端计算环境的数据网格副本管理关键技术。
本文以系统性能、可用性和可扩展性为目标,针对低端数据网格系统的特点,开展低端数据网格系统中副本管理技术的研究。本文的主要贡献在于:
1.提出了NLPR数据网格复制模型,建立了数据网格系统中副本管理各类问题的统一描述,简化了副本管理问题的求解过程;提出了基于服务合成的副本管理服务框架SCRMSA,为面向不同应用领域的数据网格副本管理服务提供了一种开放、透明、灵活的实现方案;在此基础上,提出了数据网格系统管理模型DGRMSM,实现对数据网格副本的透明、可扩展、开放的管理。
2.提出了“存储联盟”的概念,并以此为基础提出了基于存储联盟的双层动态副本创建策略SADDRES,建立了存储联盟间利用缓存建立数据副本、存储联盟内根据用户访问历史合理分布数据的副本创建策略。
3.基于“存储联盟环”的结构,提出了层次式副本定位与选择机制SAHRLSM,主要包括副本目录SARRC、副本定位算法SAHRLM和副本选择算法SAHRSM,并实现了网格节点和存储联盟的动态性管理、副本目录的一致性维护等机制,具有负载均衡、可靠性高以及可扩展性好等优点。
4.为了实现对网格副本的一致性管理并屏蔽不同网格应用的差异,引入了副本一致性管理服务RCMS,为数据网格系统提供了分布、高效、灵活的副本一致性管理机制;基于低端数据网格系统的特点,提出了基于视图和版本的副本一致性管理策略VVRCOMS,该策略采用版本机制对副本进行管理,在保证用户视图一致性的前提下,具有较好的系统性能。
With the promotion of information technology, many business systems have been developed on the Internet in domains as diverse as government, business, and education. The combination of large dataset size, geographic distribution of user and resource, cooperative heterogeneous resource access and resource sharing on wide-area network results in stringent demands that are not satisfied by any traditional data management technology.Data Grid provides a mechanism for effective distributed resources sharing and transparent remote access to heterogeneous data on wide-area network. It can be applied to manage and share the large datasets effectively in domains such as government, business, and education.The Data Grid systems applied in domains mentioned above have the following characteristics: P2P topology, limited communication capability and limited storage capability. We call the computing environment with those characteristics "Low-end Computing Environment" and the Data Grid systems running on the Low-end Computing Environment "Low-end Data Grid". In distributed systems, data replication is a well-known and widely accepted technique to reduce data response time and network bandwidth consuming. However, the replication in Data Grid brings a series of replica management problems that affect the performance of Data Grid System greatly and replica management becomes a hot topic in Data Grid. The performance requirement of Low-end Data Grid is driving force for this thesis.The main contributions of the thesis in theoretical, technical and practical aspects are as follows:1. To give a uniform description of replication technology in Data Grid, the thesis presents a replication model NLPR on which replica management related mechanisms could be clearly described. A replica management service implementation skeleton-SCRMSA is proposed to provide a solution to open, transparent and flexible replica management services in different fields. Based on SCRMSA, the thesis puts forward a transparent, scalable and flexible data grid replica management system model DGRMSM.2. The thesis gives a new concept-Storage Alliance, based on which a dynamic replica creation strategy SADDRES is presented. SADDRES creates replicas by cache among Storage Alliances, and optimize the data distribution of a Storage Alliance according to users' access history.3. Replica location and selection mechanism is the key issue of data
management and access in Data Grid. To provide a load-balanced, high-performance, and high-scalable replica management, the thesis explores a hierarchical replica location and selection mechanism SAHRLSM. SAHRLSM includes SARRC replica catalog, SAHRLM replica location mechanism and SAHRSM replica selection mechanism. It also provides a series of methods to manage the dynamics of nodes, the dynamics of Storage Alliances and the consistency of SARRC replica catalog.4. It is a tough task to achieve the consistency of the replicas in deferent data grid applications. In the thesis, a replica consistency management service RCMS is introduced to provide distributed, high-efficient and flexible replica consistency management. Considering the characteristics of Low-end Data Grid, the thesis proposes a view and version based replica consistency management strategy VVRCOMS. VVRCOMS adopts version mechanism to manage the replicas and achieves high system performance by assuring the view consistency of users.5. In order to evaluate the mechanisms above, the Data Grid simulation tool-OptorSim is adopted. By extending OptorSim, we implement the replica management system StarRMS, which includes all mechanisms we proposed. The experimental results show that our replica management mechanisms are correct and effective. By adjusting environment variables of OptorSim, we test the performance of StarRMS in different computing environments. The results will be a valuable reference to the application of StarRMS in future.
引文
[1]. I. Foster, C. Kesse]man, et al. The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, San Francisco, Calif, 1999.
[2]. I. Foster. Internet Computing and the Emerging Grid. Nature Web Matters, 2000.
[3].钱德沛.网格技术与信息化建设.电子商务世界,2004.
[4]. I. Foster, C. ffesselman, S. Tuecke. The Anatomy of the Grid. The International Journal of High Performance Computing Applications, 15(3): 200-222, 2001.
[5]. A. Chervenak, I. Foster, C. Kesselman, C. Salisbury, S. Tuecke. The Data Grid: Towards and Architecture for the Distributed Management and Analysis of Large Scientific Data Sets. Journal of Network and Computer Applications, 23(3): 187-200, 2000.
[6]. W. Hoscheck, J. Jaen-Martinez, A. Samar, H. Stockinger. Data Management in an International Data Grid Project. 2000 International Workshop on Grid Computing (GRID 2000), Bangalore, India, 2000.
[7]. Reagan Moore. Using Data Grid Technology to Manage Distributed Data. http://lennier.gsfc.nasa.gov/seeds/W2_Moore.pdf.
[8]. H. Stockinger. Database replication in world-wide distributed data grids. Phd Thesis, University of Vienna, November 2001.
[9]. J N Gray, P Helland, D S P O' Nell. The dangers of replication and a solution. The 1996 ACM SIGMOD Int' l Conf on Management of Data, Montreal, Canada, 1996.
[10]. Silvano Muffles. Piranha: a CORBA tool for high availability. IEEE Computer, Tech Rep: TR-96-1185, 1996.
[11]. Canesha Beedubail, et al. Fault tolerant objects in distributed systems using hot replication. In: Proc. Of 15th Int'l Phoenix Conference on Computers and Communications, Phoenix, AZ, March 1996.
[12].钱方.分布计算环境中冗余服务管理机制的研究与实现.博士学位论文,国防科学技术大学研究生院,2000.
[13].周明辉.面向对象的容错中间件的研究与实现.博士学位论文,国防科学技术大学研究生院,2002.
[14]. Byun, S., Moon, S. Resilient data management for replicated mobile database systems. Data and Knowledge Engineering, 1999, 29(1):43-55.
[15].吴婷婷.移动数据库客户语义缓存的研究.博士学位论文,困防科学技术大学研究生院,2002.
[16]. Leanne Guy, Erwin Laure, Peter Kunszt, Heinz Stockinger, Kurt Stockinger. Replica management in data grids. Technical report, Global Grid Forum Informational Document, GGF5, Edinburgh, Scotland, July 2002.
[17]. A Replica Management Service for High-Performance Data Grids. The Globus Data Management Group, 29 January 2001, http://www.globus.org/datagrid/deliverables/ReplicaManagementService.pdf.
[18]. Craig E. Tull. Replica Management Architecture and Integration. http://www.ppdg.net/docs/Papers/PPDG-33.pdf.
[19]. Houda Lamehamedi, Boleslaw Szymanski, Zujun Shentu, E. Deelman. Data Replication Strategies in Grid Environments. Proc. 5th International Conference on Algorithms and Architecture for Parallel Processing, ICA3PP'2002, Bejing, China, October 2002, IEEE Computer Science Press, Los Alamitos, CA, 2002.
[20]. W. Allcock, J. Bester, J. Bresnahan, A. Chervenak, I. Foster, C. Kesselman, S. Meder, V. Nefedova, D. Quesnel, S. Tuecke. Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing, IEEE Mass Storage Conference, 2001.
[21]. A. Chervenak, C. Kesselman, S. Koranda, B. Moe, R. Schuler. Design and Implementation of a Data Replication Service Based on the Lightweight Data Replicator System, submitted to 14th IEEE International Symposium on High Performance Distributed Computing (HPDC-14), 2005.
[22]. Global Grid Forum. http://www.ggf.org/.
[23]. Globus Alliance. http://www.globus.org/.
[24].张晓鹏.数据网格中动态复制策略的研究.硕士学位论文,北京航空航天大学,2004.
[25].庞丽萍,陈勇,吴松,肖侬.数据网格环境下的一种动态备份模型,华中科技大学学报(自然科学版),2004 Vol.32 No.4 P.61-63.
[26]. European DataGrid Home Page. http://www.edg.org/.
[27]. GridPhyN Home Page. http://www.griphyn.org.
[28]. PPDG Home Page. http://www.ppdg.net.
[29]. Data Farm Home Page. http://datafarm.apgrid.org/.
[30]. M. Aderholz et al. Models of Networked Analysis at Regional Centres for LHC Experiments (MONARC) Phase 2 Report. Technical Report CERN/LCB 2000-001, CERN, 2000.
[31].LCG Grid Deployment Board. Resource Allocation and Planning Q2 2004. CERN Note, April 2004.
[32]. Globus Home Page. http://www.globus.org/.
[33]. http://www-unix. globus. org/toolkit/.
[34]. W. Allcock, J. Bester, J. Bresnahan, A. Chervenak, S. Tuecke. GridFTP: Protocol extensions to ftp for the grid. Tech. rep., Argonne National Laboratory, August 2001.
[35]. Bill Allcock, John Bresnahan, Raj Kettimuthu, Mike Link, Catalin Dumitrescu, Ioan Raicu, Ian Foster. The Globus Striped GridFTP Framework and Server. Submitted to the 2005 High Performance Distributed Computing Conference (HPDC 14).
[36]. EE, Ravi K. Madduri, Cynthia S. Hood, William E. Allcock. Reliable File Transfer in Grid Environments, LCN 2002: 737-738.
[37]. http://www. cern. ch/GDMP/.
[38]. Peter Kunszt, Erwin Laure, Heinz Stockinger, Kurt Stockinger. Advanced replica management with reptor. In: 5th International Conference on Parallel Processing and Applied Mathematics, Czestochowa, Poland, September 2003.
[39].Leanne Guy, Levi Lucio. EDG Replication Metadata Catalogue. http://web. pd. astro. it/wpl0/ edg-20/edg-rmc-userguide. pdf.
[40].SRB Home Page. http://www.npaci.edu/DICE/SRB/.
[41]. JLAB Home Page. http://lqcd.jlab.org/.
[42]. Ann Chervenak, Ewa Deelman, Ian Foster, Wolfgang Hoschek, Adriana Iamnitchi, Carl Kesselman, Peter Kunszt, Matei Ripeanu, Heinz Stockinger Kurt Stockinger, Brian Tierney. Giggle: A Framework for Constructing Scalable Replica Location Services. In Proc. of the Int'l. IEEE Supercomputing Conference (SC 2002), Baltimore, USA, November 2002.
[43]. Napster Home Page. http://www.napster.com/.
[44]. Frank Dabek, M. Frans Kaashoek, Davie Karger, Robert Morris, Ion Stoica. Wide-area cooperative storage with CFS. In Proceedings of ACM SOSP 2001.
[45]. Gnutella Home Page.http://gnutella.wego.com.
[46].I Stoica, R Morris, D Karger, et al. Chord: A scalable peer-to-peer
lookup service for Internet applications. In: Proc of ACM SIGCOMM 20011 New York, ACM Press, 2001. 160-177.
[47]. Deron Liang, S. C. Chon, S. M. Yuan. A fault-tolerant object service in OMG' s Object Management architecuture. Information and Software Technology, 1998, 39(14/15): 965-973.
[48]. Jurgen Nehmer, Friedmann Mathern. Framework for the organization of cooperative services in distributed client-service systems. Computer Communication, 1992, 15(4): 261-269.
[49]. Kavitha Ranganathan, Ian Foster. Design and Evaluation of Dynamic Replication Strategies for a High Performance Data Grid. International Conference on Computing in High Energy and Nuclear Physics, 2001.
[50]. William H. Bell, David G. Cameron, Luigi Capozza, A. Paul Millar, Kurt Stockinger, Floriano Zini. Towards an Economy-Based Optimisation of File Access and Replication on a Data Grid. In International workshop on Agent based Cluster and Grid Computing at International Symposium on Cluster Computing and Grid (CCGrid 2002), Berlin, Germany, May 2002. IEEE Computer Society Press.
[51]. Response from Globus Team to EDG WP2' s Proposed Design for a Distributed Replica Catalog. Mathematics and Computer Science Division, Argonne National Laboratory, http://grid-data-management. web. cern. ch/grid-data- anagement/docs/responsetoEDGReplica5.doc, CERN,September 2001.
[52].Freenet Home Page. http://Freenet.sourceforge.net.
[53]. Freehaven Home Page. http://www.freehaven.net/.
[54]. Ben Y. Zhao, John Kubiatowicz, Anthony D. Joseph. Tapestry: An Infrastructure for Fault-tolerant Wide-area Location and Routing. Technical Report No. UCB/CSD-01-1141, University of California Berkeley.
[55]. Antony Rowstron, Peter Druschel. Pastry: Scalable, decentralized object location and routing for large-scale peer-to-peer systems. IFIP/ACM International Conference on Distributed Systems Platforms, 2001.
[56]. A. L Chervenak, I. Foster, C. Kesselman, etal. Data management and transfer in high performance computational grid environments. Parallel Computing Journal , 2002 , 28 (5) : 749—771.
[57]. Hierarchical Distributed Replica Catalogues. EU DataGrid Project:
_____ Work Package 2, http://cern.ch/grid-data-management/.
[58]. Y. Hu. IBL for replica selection in data intensive Grid applications. Master's Thesis, Department of Computer Science, University of Chicago, 2003.
[59]. Sudharshan Vazhkudai, Jennifer M. Schopf. Using Disk Throughput Data in Predictions of End-to-End Grid Data Transfer. Proceedings of Grid 2002, Page 291-304, 2002.
[60]. Faerman, M., A. Su, R. Wolski, F. Berman. Adaptive Performance Prediction for Distributed Data-Intensive Applications. Proceedings of the 1999 ACM/IEEE conference on Supercomputing (CDROM), 1999.
[61]. Baru, C., R. Moore, A. Rajasekar, M. Wan. The SDSC Storage Resource Broker. Proceedings of IBM Centers for Advanced Studies Conference 1998.
[62]. Hector Garcia-Molina, Jeffrey D. Ullman, Jennifer Widom.数据库系统实现.北京:机械工业出版社,2001.
[63]. P. Bernstein, V. Hadzilacos, N. Goodman. Concurrency Control and Recovery in Database Systems. Addison.
[64]. Wesley, 1987. V. Hadzilacos, S. Toueg. Fault-tolerant broadcasts and related problems. In: S. Mullender, editor, Distributed Systems, chapter 5. adwe, second edition, 1993.
[65]. A. Schiper, A. Sandoz. Uniform reliable multicast in a virtually synchronous environment. In Proceedings of the 13th International Conference on Distributed Computing Systems (ICDCS-13), pages 561-568, Pittsburgh, Pennsylvania, USA, IEEE Computer Society Press, May 1993.
[66]. P. Birman. The process group approach to reliable distributed computing. Communications of the ACM, 36(12): 37-53, Dec. 1993.
[67]. Gianni Pucciani, et al. Replica Consistency Service in a Data Grid. In: Proceedings of the 9th International Workshop on Advanced Computing and Analysis Techniques in Physics Research, 2003.
[68]. S. Tuecke, K. Czajkowski, I. Foster, J. Frey, S. Graham, and C. Kesselman. Grid Service Specification. http://www.globus.org/research/papers.html#GSSpec.February 2002.
[69]. Web Service Overview. IBM WSTK V2.2 Documentation.
[70]. M. Endrei, J Ang, A Arsanjani, et al. Patterns: Service-oriented Architecture and Web Services, IBM Redbook, April 2004.
[71]. Benatallah, B., Dumas, M., Fauvet, M., Rabhi, F. Towards Patterns of Web Services Composition. In: Patterns and Skeletons for Parallel and Distributed Computing, UK, Springer Verlag, 2003. 265-296 .
[72].Shankar R. Ponnekanti, Armando Fox. Sword: A developer toolkit for building composite web services. In Proceedings of the llth International World Wide Web Conference, WWW 2002, Honolulu, Hawaii, May 7-11, 2002. ACM Press, 2002.
[73]. http://www. microsoft. com/biztalk/.
[74]. http://www. bea. com/framework. jsp?CNT=index. htm&FP=/content/produ cts/integrate.
[75].Fabio Casati, Ski Ilnicki, LiJie Jin, Vasudev Krishnamoorthy, Ming-Chien Shan. Adaptive and Dynamic Service Composition in eFlow. HP Technical Report, HPL-2000-39, March, 2000.
[76]. Joseph Bester, Ian Foster, Carl Kesselman, Jean Tedesco, Steven Tuecke. GASS: A Data Movement and Access Service for Wide Area Computing Systems. In: Proceedings of the Sixth Workshop on Input/Output in Parallel and Distributed Systems, ACM Press, Atlanta, 1999.
[77]. Kurt Stockinger, Heinz Stockinger, Lukasz Dutka, Renata Slota, Darin Nikolow, Jacek Kitowski. Access Cost Estimation for Unified Grid Storage Systems, International Workshop on Grid Computing (Grid2003), Phoenix, Arizona, November 2003, IEEE Computer Societe Press.
[78]. David Gordon Cameron. Replica Management and Optimisation for Data Grids. Phd thesis, Department of Physics and Astronomy University of Glasgow. 2005.
[79]. R. Wolski. Dynamically Forecasting Network Performance Using the Network Weather Service. Journal of Cluster Computing, 1998.
[80]. W. H. Bell, D. G. Cameron, L. Capozza, P. Millar, K. Stockinger, and F. Zini. OptorSim - A Grid Simulator for Studying Dynamic Data Replication Strategies. Int. Journal of High Performance Computing Applications, 17(4), 2003.
[81]. W. H. Bell, D. G. Cameron, L. Capozza, P. Millar, K. Stockinger, F. Zini. Simulation of Dynamic Grid Replication Strategies in OptorSim. In: 3rd Int'l IEEE Workshop on Grid Computing, 2002, Baltimore.
[82]. J. Kubiatowicz, D. Bindel, Y. Chen, S. Czerwinski, P. Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, W. Weimer, C.Weils, B. Zhao. OceanStore: An architecture for global-scale persistent storage. In: Proceeedings of the Ninth international Conference on Architectural
_ Support for Programming Languages and Operating Systems (ASPLOS 2000), Boston, MA, November 2000, pp. 190-201.
[83]. Sudharshan Vazhkudai, Steven Tuecke, Ian Foster. Replica Selection in the Globus Data Grid. http://www.globus.org/ research/papers. htm1#Data Grid.
[84].Karger, D. R., et al. Consistent Hashing and Random Trees: Distributed Caching Protocols for Relieving Hot Spots on the World Wide Web. In: Symposium on Theory of Computing. 1997: ACM.
[85].16. Karger, D.R., et al. Web Caching with Consistent Hashing. Computer Networks, 1999. 31(11-16): p. 1203-1213.
[86]. Raman, S. McCanne, S. A Model, Analysis, and Protocol Framework for Soft State based Communication. Computer Communication Review, 29 (4). 1999.
[87]. M Ripeanu, I Foster. A decentralized, adaptive replica location service. In: Proc of HPDC2111 Edinburgh, Scotland, IEEE Computer Society Press, 2002
[88]. L Zhang, S. Deering, D. Estrin, S. Shenker, D. Zappala. RSVP: A New Resource Reservation Protocol. IEEE Communications Magazine, 50th Anniversary Issue, May 2002, reprinted from IEEE Network, September 1993, Volume 7, Number 5.
[89].Malkin, G. RIP Version 2 - Carrying Additional Information. RFC 1723, IETF 1994.
[90]. K. Czajkowski, S. Fitzgerald, I. Foster, C. Kesselman. Grid Information Services for Distributed Resource Sharing. Proceedings of the Tenth IEEE International Symposium on High-Performance Distributed Computing (HPDC-10), IEEE Press, August 2001.
[91]. M. V. Ramakrishna. Practical performance of Bloom filters and parallel free-text searching, Communications of the ACM, vol. 32, pp. 1237-1239, 1989.
[92]. Bloom, B. Space/Time Trade-offs in Hash Coding with Allowable Errors. Communications of ACM, 13 (7). 422-426. 1970.
[93]. M. Wiesmann, F. Pedone, A. Schiper, B. Kemme, G. Alonso. Understanding Replication in Databases and Distributed Systems, Proceedings of the The 20th International Conference on Distributed Computing Systems (ICDCS 2000), p.464, April 10-13, 2000.
[94]. R. Guerraoui, A. Schiper. Software-based replication for fault tolerance. IEEE Computer, 30(4): 68-74, Apr. 1997.
[95]. F. B. Schneider. Implementing fault-tolerant services using the state machine approach: A tutorial. ACM Computing Surveys, 22(4) :299- 319, Dec. 1990.
[96]. D. Powell, M. Chereque, D. Drackley. Fault-tolerance in Delta-4. ACM Operating Systems Review, SIGOPS, 25(2): 122-125, Apr. 1991.
[97]. X. Defago, A. Schiper, N. Sergent. Semi-passive replication. In: Proceedings of the 17th IEEE Symposium on Reliable Distributed Systems (SRDS), pages 43-50, West Lafayette, IN, USA, Oct. 1998.
[98]. Dirk Dullmann, Wolfgang Hoschek, Javier Jaen-Martinez, Ben Segal. Models for Replica Synchronization and Consistency in a Data Grid. IEEE HPDC-10, 2001.
[99]. S. Jurk, M. Neiling. Client-side Dynamic Preprocessing of Transactions. ADBIS Conf., Dresden, Germany, 2003. 103-117.
[100]. K. J. Lin. Consistency Issues in Real-Time Database Systems. Proceedings of the 22nd Hawaii International Conference on Systems Sciences, 1989, pp. 654-661.
[101]. P. Crosby. EDGSim. http://www.hep.ucl.ac.uk/pac/EDGSim/.
[102]. H. Lamehamedi, Z. Shentu, B. Szymanski, E. Deelman. Simulation of Dynamic Data Replication Strategies in Data Grids. In Proc. 12th Heterogeneous Computing Workshop (HCW2003), Nice, France, April 2003. IEEE-CS Press.
[103]. R. Buyya, M. Murshed. GridSim: A Toolkit for the Modeling and Simulation of Distributed Resource Management and Scheduling for Grid Computing. The Journal of Concurrency and Computation: Practice and Experience, pages 1-32, May 2002. Wiley Press.
[2]. I. Foster. Internet Computing and the Emerging Grid. Nature Web Matters, 2000.
[3].钱德沛.网格技术与信息化建设.电子商务世界,2004.
[4]. I. Foster, C. ffesselman, S. Tuecke. The Anatomy of the Grid. The International Journal of High Performance Computing Applications, 15(3): 200-222, 2001.
[5]. A. Chervenak, I. Foster, C. Kesselman, C. Salisbury, S. Tuecke. The Data Grid: Towards and Architecture for the Distributed Management and Analysis of Large Scientific Data Sets. Journal of Network and Computer Applications, 23(3): 187-200, 2000.
[6]. W. Hoscheck, J. Jaen-Martinez, A. Samar, H. Stockinger. Data Management in an International Data Grid Project. 2000 International Workshop on Grid Computing (GRID 2000), Bangalore, India, 2000.
[7]. Reagan Moore. Using Data Grid Technology to Manage Distributed Data. http://lennier.gsfc.nasa.gov/seeds/W2_Moore.pdf.
[8]. H. Stockinger. Database replication in world-wide distributed data grids. Phd Thesis, University of Vienna, November 2001.
[9]. J N Gray, P Helland, D S P O' Nell. The dangers of replication and a solution. The 1996 ACM SIGMOD Int' l Conf on Management of Data, Montreal, Canada, 1996.
[10]. Silvano Muffles. Piranha: a CORBA tool for high availability. IEEE Computer, Tech Rep: TR-96-1185, 1996.
[11]. Canesha Beedubail, et al. Fault tolerant objects in distributed systems using hot replication. In: Proc. Of 15th Int'l Phoenix Conference on Computers and Communications, Phoenix, AZ, March 1996.
[12].钱方.分布计算环境中冗余服务管理机制的研究与实现.博士学位论文,国防科学技术大学研究生院,2000.
[13].周明辉.面向对象的容错中间件的研究与实现.博士学位论文,国防科学技术大学研究生院,2002.
[14]. Byun, S., Moon, S. Resilient data management for replicated mobile database systems. Data and Knowledge Engineering, 1999, 29(1):43-55.
[15].吴婷婷.移动数据库客户语义缓存的研究.博士学位论文,困防科学技术大学研究生院,2002.
[16]. Leanne Guy, Erwin Laure, Peter Kunszt, Heinz Stockinger, Kurt Stockinger. Replica management in data grids. Technical report, Global Grid Forum Informational Document, GGF5, Edinburgh, Scotland, July 2002.
[17]. A Replica Management Service for High-Performance Data Grids. The Globus Data Management Group, 29 January 2001, http://www.globus.org/datagrid/deliverables/ReplicaManagementService.pdf.
[18]. Craig E. Tull. Replica Management Architecture and Integration. http://www.ppdg.net/docs/Papers/PPDG-33.pdf.
[19]. Houda Lamehamedi, Boleslaw Szymanski, Zujun Shentu, E. Deelman. Data Replication Strategies in Grid Environments. Proc. 5th International Conference on Algorithms and Architecture for Parallel Processing, ICA3PP'2002, Bejing, China, October 2002, IEEE Computer Science Press, Los Alamitos, CA, 2002.
[20]. W. Allcock, J. Bester, J. Bresnahan, A. Chervenak, I. Foster, C. Kesselman, S. Meder, V. Nefedova, D. Quesnel, S. Tuecke. Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing, IEEE Mass Storage Conference, 2001.
[21]. A. Chervenak, C. Kesselman, S. Koranda, B. Moe, R. Schuler. Design and Implementation of a Data Replication Service Based on the Lightweight Data Replicator System, submitted to 14th IEEE International Symposium on High Performance Distributed Computing (HPDC-14), 2005.
[22]. Global Grid Forum. http://www.ggf.org/.
[23]. Globus Alliance. http://www.globus.org/.
[24].张晓鹏.数据网格中动态复制策略的研究.硕士学位论文,北京航空航天大学,2004.
[25].庞丽萍,陈勇,吴松,肖侬.数据网格环境下的一种动态备份模型,华中科技大学学报(自然科学版),2004 Vol.32 No.4 P.61-63.
[26]. European DataGrid Home Page. http://www.edg.org/.
[27]. GridPhyN Home Page. http://www.griphyn.org.
[28]. PPDG Home Page. http://www.ppdg.net.
[29]. Data Farm Home Page. http://datafarm.apgrid.org/.
[30]. M. Aderholz et al. Models of Networked Analysis at Regional Centres for LHC Experiments (MONARC) Phase 2 Report. Technical Report CERN/LCB 2000-001, CERN, 2000.
[31].LCG Grid Deployment Board. Resource Allocation and Planning Q2 2004. CERN Note, April 2004.
[32]. Globus Home Page. http://www.globus.org/.
[33]. http://www-unix. globus. org/toolkit/.
[34]. W. Allcock, J. Bester, J. Bresnahan, A. Chervenak, S. Tuecke. GridFTP: Protocol extensions to ftp for the grid. Tech. rep., Argonne National Laboratory, August 2001.
[35]. Bill Allcock, John Bresnahan, Raj Kettimuthu, Mike Link, Catalin Dumitrescu, Ioan Raicu, Ian Foster. The Globus Striped GridFTP Framework and Server. Submitted to the 2005 High Performance Distributed Computing Conference (HPDC 14).
[36]. EE, Ravi K. Madduri, Cynthia S. Hood, William E. Allcock. Reliable File Transfer in Grid Environments, LCN 2002: 737-738.
[37]. http://www. cern. ch/GDMP/.
[38]. Peter Kunszt, Erwin Laure, Heinz Stockinger, Kurt Stockinger. Advanced replica management with reptor. In: 5th International Conference on Parallel Processing and Applied Mathematics, Czestochowa, Poland, September 2003.
[39].Leanne Guy, Levi Lucio. EDG Replication Metadata Catalogue. http://web. pd. astro. it/wpl0/ edg-20/edg-rmc-userguide. pdf.
[40].SRB Home Page. http://www.npaci.edu/DICE/SRB/.
[41]. JLAB Home Page. http://lqcd.jlab.org/.
[42]. Ann Chervenak, Ewa Deelman, Ian Foster, Wolfgang Hoschek, Adriana Iamnitchi, Carl Kesselman, Peter Kunszt, Matei Ripeanu, Heinz Stockinger Kurt Stockinger, Brian Tierney. Giggle: A Framework for Constructing Scalable Replica Location Services. In Proc. of the Int'l. IEEE Supercomputing Conference (SC 2002), Baltimore, USA, November 2002.
[43]. Napster Home Page. http://www.napster.com/.
[44]. Frank Dabek, M. Frans Kaashoek, Davie Karger, Robert Morris, Ion Stoica. Wide-area cooperative storage with CFS. In Proceedings of ACM SOSP 2001.
[45]. Gnutella Home Page.http://gnutella.wego.com.
[46].I Stoica, R Morris, D Karger, et al. Chord: A scalable peer-to-peer
lookup service for Internet applications. In: Proc of ACM SIGCOMM 20011 New York, ACM Press, 2001. 160-177.
[47]. Deron Liang, S. C. Chon, S. M. Yuan. A fault-tolerant object service in OMG' s Object Management architecuture. Information and Software Technology, 1998, 39(14/15): 965-973.
[48]. Jurgen Nehmer, Friedmann Mathern. Framework for the organization of cooperative services in distributed client-service systems. Computer Communication, 1992, 15(4): 261-269.
[49]. Kavitha Ranganathan, Ian Foster. Design and Evaluation of Dynamic Replication Strategies for a High Performance Data Grid. International Conference on Computing in High Energy and Nuclear Physics, 2001.
[50]. William H. Bell, David G. Cameron, Luigi Capozza, A. Paul Millar, Kurt Stockinger, Floriano Zini. Towards an Economy-Based Optimisation of File Access and Replication on a Data Grid. In International workshop on Agent based Cluster and Grid Computing at International Symposium on Cluster Computing and Grid (CCGrid 2002), Berlin, Germany, May 2002. IEEE Computer Society Press.
[51]. Response from Globus Team to EDG WP2' s Proposed Design for a Distributed Replica Catalog. Mathematics and Computer Science Division, Argonne National Laboratory, http://grid-data-management. web. cern. ch/grid-data- anagement/docs/responsetoEDGReplica5.doc, CERN,September 2001.
[52].Freenet Home Page. http://Freenet.sourceforge.net.
[53]. Freehaven Home Page. http://www.freehaven.net/.
[54]. Ben Y. Zhao, John Kubiatowicz, Anthony D. Joseph. Tapestry: An Infrastructure for Fault-tolerant Wide-area Location and Routing. Technical Report No. UCB/CSD-01-1141, University of California Berkeley.
[55]. Antony Rowstron, Peter Druschel. Pastry: Scalable, decentralized object location and routing for large-scale peer-to-peer systems. IFIP/ACM International Conference on Distributed Systems Platforms, 2001.
[56]. A. L Chervenak, I. Foster, C. Kesselman, etal. Data management and transfer in high performance computational grid environments. Parallel Computing Journal , 2002 , 28 (5) : 749—771.
[57]. Hierarchical Distributed Replica Catalogues. EU DataGrid Project:
_____ Work Package 2, http://cern.ch/grid-data-management/.
[58]. Y. Hu. IBL for replica selection in data intensive Grid applications. Master's Thesis, Department of Computer Science, University of Chicago, 2003.
[59]. Sudharshan Vazhkudai, Jennifer M. Schopf. Using Disk Throughput Data in Predictions of End-to-End Grid Data Transfer. Proceedings of Grid 2002, Page 291-304, 2002.
[60]. Faerman, M., A. Su, R. Wolski, F. Berman. Adaptive Performance Prediction for Distributed Data-Intensive Applications. Proceedings of the 1999 ACM/IEEE conference on Supercomputing (CDROM), 1999.
[61]. Baru, C., R. Moore, A. Rajasekar, M. Wan. The SDSC Storage Resource Broker. Proceedings of IBM Centers for Advanced Studies Conference 1998.
[62]. Hector Garcia-Molina, Jeffrey D. Ullman, Jennifer Widom.数据库系统实现.北京:机械工业出版社,2001.
[63]. P. Bernstein, V. Hadzilacos, N. Goodman. Concurrency Control and Recovery in Database Systems. Addison.
[64]. Wesley, 1987. V. Hadzilacos, S. Toueg. Fault-tolerant broadcasts and related problems. In: S. Mullender, editor, Distributed Systems, chapter 5. adwe, second edition, 1993.
[65]. A. Schiper, A. Sandoz. Uniform reliable multicast in a virtually synchronous environment. In Proceedings of the 13th International Conference on Distributed Computing Systems (ICDCS-13), pages 561-568, Pittsburgh, Pennsylvania, USA, IEEE Computer Society Press, May 1993.
[66]. P. Birman. The process group approach to reliable distributed computing. Communications of the ACM, 36(12): 37-53, Dec. 1993.
[67]. Gianni Pucciani, et al. Replica Consistency Service in a Data Grid. In: Proceedings of the 9th International Workshop on Advanced Computing and Analysis Techniques in Physics Research, 2003.
[68]. S. Tuecke, K. Czajkowski, I. Foster, J. Frey, S. Graham, and C. Kesselman. Grid Service Specification. http://www.globus.org/research/papers.html#GSSpec.February 2002.
[69]. Web Service Overview. IBM WSTK V2.2 Documentation.
[70]. M. Endrei, J Ang, A Arsanjani, et al. Patterns: Service-oriented Architecture and Web Services, IBM Redbook, April 2004.
[71]. Benatallah, B., Dumas, M., Fauvet, M., Rabhi, F. Towards Patterns of Web Services Composition. In: Patterns and Skeletons for Parallel and Distributed Computing, UK, Springer Verlag, 2003. 265-296 .
[72].Shankar R. Ponnekanti, Armando Fox. Sword: A developer toolkit for building composite web services. In Proceedings of the llth International World Wide Web Conference, WWW 2002, Honolulu, Hawaii, May 7-11, 2002. ACM Press, 2002.
[73]. http://www. microsoft. com/biztalk/.
[74]. http://www. bea. com/framework. jsp?CNT=index. htm&FP=/content/produ cts/integrate.
[75].Fabio Casati, Ski Ilnicki, LiJie Jin, Vasudev Krishnamoorthy, Ming-Chien Shan. Adaptive and Dynamic Service Composition in eFlow. HP Technical Report, HPL-2000-39, March, 2000.
[76]. Joseph Bester, Ian Foster, Carl Kesselman, Jean Tedesco, Steven Tuecke. GASS: A Data Movement and Access Service for Wide Area Computing Systems. In: Proceedings of the Sixth Workshop on Input/Output in Parallel and Distributed Systems, ACM Press, Atlanta, 1999.
[77]. Kurt Stockinger, Heinz Stockinger, Lukasz Dutka, Renata Slota, Darin Nikolow, Jacek Kitowski. Access Cost Estimation for Unified Grid Storage Systems, International Workshop on Grid Computing (Grid2003), Phoenix, Arizona, November 2003, IEEE Computer Societe Press.
[78]. David Gordon Cameron. Replica Management and Optimisation for Data Grids. Phd thesis, Department of Physics and Astronomy University of Glasgow. 2005.
[79]. R. Wolski. Dynamically Forecasting Network Performance Using the Network Weather Service. Journal of Cluster Computing, 1998.
[80]. W. H. Bell, D. G. Cameron, L. Capozza, P. Millar, K. Stockinger, and F. Zini. OptorSim - A Grid Simulator for Studying Dynamic Data Replication Strategies. Int. Journal of High Performance Computing Applications, 17(4), 2003.
[81]. W. H. Bell, D. G. Cameron, L. Capozza, P. Millar, K. Stockinger, F. Zini. Simulation of Dynamic Grid Replication Strategies in OptorSim. In: 3rd Int'l IEEE Workshop on Grid Computing, 2002, Baltimore.
[82]. J. Kubiatowicz, D. Bindel, Y. Chen, S. Czerwinski, P. Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, W. Weimer, C.Weils, B. Zhao. OceanStore: An architecture for global-scale persistent storage. In: Proceeedings of the Ninth international Conference on Architectural
_ Support for Programming Languages and Operating Systems (ASPLOS 2000), Boston, MA, November 2000, pp. 190-201.
[83]. Sudharshan Vazhkudai, Steven Tuecke, Ian Foster. Replica Selection in the Globus Data Grid. http://www.globus.org/ research/papers. htm1#Data Grid.
[84].Karger, D. R., et al. Consistent Hashing and Random Trees: Distributed Caching Protocols for Relieving Hot Spots on the World Wide Web. In: Symposium on Theory of Computing. 1997: ACM.
[85].16. Karger, D.R., et al. Web Caching with Consistent Hashing. Computer Networks, 1999. 31(11-16): p. 1203-1213.
[86]. Raman, S. McCanne, S. A Model, Analysis, and Protocol Framework for Soft State based Communication. Computer Communication Review, 29 (4). 1999.
[87]. M Ripeanu, I Foster. A decentralized, adaptive replica location service. In: Proc of HPDC2111 Edinburgh, Scotland, IEEE Computer Society Press, 2002
[88]. L Zhang, S. Deering, D. Estrin, S. Shenker, D. Zappala. RSVP: A New Resource Reservation Protocol. IEEE Communications Magazine, 50th Anniversary Issue, May 2002, reprinted from IEEE Network, September 1993, Volume 7, Number 5.
[89].Malkin, G. RIP Version 2 - Carrying Additional Information. RFC 1723, IETF 1994.
[90]. K. Czajkowski, S. Fitzgerald, I. Foster, C. Kesselman. Grid Information Services for Distributed Resource Sharing. Proceedings of the Tenth IEEE International Symposium on High-Performance Distributed Computing (HPDC-10), IEEE Press, August 2001.
[91]. M. V. Ramakrishna. Practical performance of Bloom filters and parallel free-text searching, Communications of the ACM, vol. 32, pp. 1237-1239, 1989.
[92]. Bloom, B. Space/Time Trade-offs in Hash Coding with Allowable Errors. Communications of ACM, 13 (7). 422-426. 1970.
[93]. M. Wiesmann, F. Pedone, A. Schiper, B. Kemme, G. Alonso. Understanding Replication in Databases and Distributed Systems, Proceedings of the The 20th International Conference on Distributed Computing Systems (ICDCS 2000), p.464, April 10-13, 2000.
[94]. R. Guerraoui, A. Schiper. Software-based replication for fault tolerance. IEEE Computer, 30(4): 68-74, Apr. 1997.
[95]. F. B. Schneider. Implementing fault-tolerant services using the state machine approach: A tutorial. ACM Computing Surveys, 22(4) :299- 319, Dec. 1990.
[96]. D. Powell, M. Chereque, D. Drackley. Fault-tolerance in Delta-4. ACM Operating Systems Review, SIGOPS, 25(2): 122-125, Apr. 1991.
[97]. X. Defago, A. Schiper, N. Sergent. Semi-passive replication. In: Proceedings of the 17th IEEE Symposium on Reliable Distributed Systems (SRDS), pages 43-50, West Lafayette, IN, USA, Oct. 1998.
[98]. Dirk Dullmann, Wolfgang Hoschek, Javier Jaen-Martinez, Ben Segal. Models for Replica Synchronization and Consistency in a Data Grid. IEEE HPDC-10, 2001.
[99]. S. Jurk, M. Neiling. Client-side Dynamic Preprocessing of Transactions. ADBIS Conf., Dresden, Germany, 2003. 103-117.
[100]. K. J. Lin. Consistency Issues in Real-Time Database Systems. Proceedings of the 22nd Hawaii International Conference on Systems Sciences, 1989, pp. 654-661.
[101]. P. Crosby. EDGSim. http://www.hep.ucl.ac.uk/pac/EDGSim/.
[102]. H. Lamehamedi, Z. Shentu, B. Szymanski, E. Deelman. Simulation of Dynamic Data Replication Strategies in Data Grids. In Proc. 12th Heterogeneous Computing Workshop (HCW2003), Nice, France, April 2003. IEEE-CS Press.
[103]. R. Buyya, M. Murshed. GridSim: A Toolkit for the Modeling and Simulation of Distributed Resource Management and Scheduling for Grid Computing. The Journal of Concurrency and Computation: Practice and Experience, pages 1-32, May 2002. Wiley Press.