网格节点间数据同步复制机制的研究
|
摘要
为了实现网格节点间的数据同步复制,需要解决两个关键问题：副本定位和副本的一致性更新。论文研究了目前对副本定位问题的解决方案,进而提出了一种基于网格域的副本定位模型；将整个网格系统按照一定的原则划分为多个网格区域,为了能够对网格系统提供副本定位支持,论文设计了副本目录,副本目录由全局定位节点GLN,域定位节点DLN以及存储节点SN组成。在模型中,副本定位信息分散的存储在域定位节点DLN中,在对副本文件进行定位时,采用域内定位和域间定位向结合的方式,由近及远可以快速的得到副本文件的位置信息。为了解决由于副本文件更新,造成的副本文件间的不一致问题,论文采用版本控制机制,每一个逻辑文件以及对应的副本文件都有一个与之对应的版本号,使用版本号来控制副本间的一致性；论文还提出,为每一个逻辑文件都分配一个一致性更新管理服务CUMS,由一致性更新管理服务CUMS结合版本控制机制,完成副本文件的一致性更新；为了避免大量的一致性更新管理服务实例造成的性能瓶颈,论文将这些CUMS实例分散的存储在网格节点中。
论文最后结合专家信息网格的具体要求以及论文的研究成果,对专家信息网格的总体结构、副本目录以及副本的一致性更新进行了分析与设计。
In order to realize the data synchronization between grid nodes, we need to solve two important problems:replica location and replica consistency update. the paper analyzes the research of replica location recently firstly, and then we present a replica location model which is based on grid region. The entire grid system is divided into several grid regions which according with certain principles. In order to provide the function of replica location, we design the replica catalog in the paper, which is consistent of global location nodes(GLN), Domain location noeds(DLN), and storage nodes(SN). In the model, the information of replica location are stored in some distributed nodes in the grid. In order to locate the replica quickly, we search the information from near to far in the process of replica location. The replica file has a problem of inconsistency, when the update is occurred with a coincidently frequent. To solve this problem, in the paper proposed a version management for replicas consistency, each replica has a version. We also propose that each logical file is assigned a consistency update manager service(CUMS), the CUMS combined with version control mechanism can keep the consistency of replicas. In order to avoid the performance bottleneck because of the large number of replica consistency service instances, we have put those instances into some grid nodes distributed.
Finally, this paper analyzes and designs the architectural structure of expert information grid, replica catalog and the replica consistency according to the idiographic requirements of expert information grid and the research results of this paper.
论文最后结合专家信息网格的具体要求以及论文的研究成果,对专家信息网格的总体结构、副本目录以及副本的一致性更新进行了分析与设计。
In order to realize the data synchronization between grid nodes, we need to solve two important problems:replica location and replica consistency update. the paper analyzes the research of replica location recently firstly, and then we present a replica location model which is based on grid region. The entire grid system is divided into several grid regions which according with certain principles. In order to provide the function of replica location, we design the replica catalog in the paper, which is consistent of global location nodes(GLN), Domain location noeds(DLN), and storage nodes(SN). In the model, the information of replica location are stored in some distributed nodes in the grid. In order to locate the replica quickly, we search the information from near to far in the process of replica location. The replica file has a problem of inconsistency, when the update is occurred with a coincidently frequent. To solve this problem, in the paper proposed a version management for replicas consistency, each replica has a version. We also propose that each logical file is assigned a consistency update manager service(CUMS), the CUMS combined with version control mechanism can keep the consistency of replicas. In order to avoid the performance bottleneck because of the large number of replica consistency service instances, we have put those instances into some grid nodes distributed.
Finally, this paper analyzes and designs the architectural structure of expert information grid, replica catalog and the replica consistency according to the idiographic requirements of expert information grid and the research results of this paper.
引文
[1]黄斌,彭小宁,肖侬,刘波.数据网格环境中数据传输服务的研究与实现[J].计算机应用研究,2004：212-213
[2]何戈,徐志伟.数据网格技术研究[J].微电子学与计算机,2003,4：3-4
[3]桂小林.网格技术导论[M].北京：北京邮电大学出版社,2005：6-7
[4]L Foster. The Grid:A New Inflastructum for 21 st Century Science. PhysicsToday,2002,55(2),42-47
[5]J. M. Schopf, B. Nitzberg. Grids:Top Ten Questions. Scientific Programming, special issue on Grid Computing,2002,10(2),103-111
[6]郭兰图.网格环境下基于Replica的数据管理与传输模型的研究：[硕士学位论文].山东：中国石油大学(华东),2007：7
[7]桂小林.网格技术导论[M].北京：北京邮电大学出版社,2005：32
[8]裴伦鹏.基于GRID技术的分布式(仿真)计算平台的研究与设计：[硕士学位论文].北京：北方工业大学,2006：8-10
[9]都志辉,陈渝,刘鹏.网格计算[M].北京：清华大学出版社,2002：12-15
[10]徐扬,王宏,宋宇.网格计算包罗一切[J].中国计算机,2002
[11]网格技术同分布式计算的区别.http://hi. baidu. com/j2h3344/blog/item/63a55bcb9c89c58fc8176862.html
[12]余渝.基于教育资源共享网格的数据复制策略研究：[硕士学位论文].重庆：重庆大学,2007：7-10
[13]梁英.网格环境下基于负载平衡的数据移动服务研究：’[硕士学位论文].长沙：中南大学,2005：1-2
[14]都志辉,陈渝,刘鹏,王小鸽,杜江,周念生.以服务为中心的网格体系结构OGSA[J].计算机科学,2003,7：26-28
[15]赵秋云.高性能计算环境下的副本技术研究：[硕士学位论文].成都：成都理工大学,2009：3-4
[16]王晓斌,才书训.网格体系结构研究[J].计算机工程与设计,2008,26(12)：3281-3282
[17]王翠.网格副本管理方法的研究：[硕士学位论文].长春：长春工业大学,2007：1-3
[18]尹春梅.网格环境下数据复制一致性的安全授权研究：[硕士学位论文].天津：天津大学,2007：6-7
[19]王海军.网格复制应用研究：[硕士学位论文].上海：上海交通大学,2008：10-11
[20]李三立.网格计算[M].北京：清华大学出版社.2002：15-23
[21]globus官方网站http://www.globus.org
[22]Maozhen Li, Mark Baker. The Grid Core Technoligies[M]. USA:John Wiley & Sons,2005:36-40
[23]谭勇.网格体系结构研究[J].湖北民族学院学报(自然科学版),2007,22(4)：86-89
[24]王驰.数据网格副本策略研究：[硕士学位论文].上海：上海交通大学：5-6
[25]OGSA简介.http://baike. baidu. com/view/1151990. htm?fr=ala0_1
[26]郎博.基于OGSA的网格服务研究[J].计算机技术与发展,2006,16(4)：161-163
[27]吴帆,叶懋,陈贵海.广域网虚拟平台：网格计算和对等计算的融合[J].计算机科学,2005,32(5)：23-25
[28]网格体系结构概述.http://www.ibm.com/developerworks/cn/grid/gr-fann/index.html
[29]Dongsheng LI, Nong Xiao, Xicheng LU, Yijie WANG, Kai LU. Dynamic Self-Adaptive Replica Location Method in Data Grids[J]. Proceedings of the IEEE International Conference on Cluster Computing,2003
[30]杨寿保.数据网格环境下数据复制技术的研究：[硕士学位论文].合肥：中国科学技术大学,2006：6-7
[31]REN Xun-yi, WANG Ru-chuan, KONG Qing. Efficient Model for Replica Consistency Maintenance in Data Grids[J]. IEEE Computer Society,2008
[32]王福业.数据网格中分布式副本定位技术研究及实现：[硕士学位论文].北京：北京化工大学,2008：8-9
[33]李田来.基于GLOBUS的数据网格副本管理关键问题研究：[硕士学位论文].济南：山东师范大学,2008：12
[34]QingFan Gu, Bing Chen, Yuping Zhang. Dynamic Replica Placement and Location Strategies for Data Grid [J]. IEEE Computer Society,2008
[35]王铁军,周明天,郑方伟.基于分布式生成树的副本定位服务[J].计算机工程与应用.2007,43(30)：152-153
[36]Qiwei Zhang, Jiangming Yang and Ning Gu. Dynamic Replica Location Service Supporting Data Grid Systems [J]. IEEE Computer Society,2006
[37]邹立达,刘方爱,马艳.教育资源网格的副本定位策略研究[J].计算机工程与设计.2008,29(18)：4697-4699
[38]马元元.信息网格中基于服务的副本管理机制研究：[硕士学位论文].西安：西北师范大学,2007：30-31
[39]张春明.数据网格中副本一致性模型的研究：[硕士学位论文].山东：中国石油大学(华东),2008：34-36
[40]ChangZe Wu, Dong Tian, ZhongFu Wu Dynamic. Equilibrium Replica Location Algorithms in Data Grid[R]. The Third ChinaGrid Annual Conference, 2008:126-130
[41]高改梅,白尚旺,党伟超.一种分布式数据网格副本定位机制的研究[J].太远科技大学学报.2007,28(4)：262-265
[42]孙海燕.数据网格副本管理关键技术研究：[博士学位论文].长沙：国防科学技术大学,2005：56-57
[43]王剑.校园数据网格关键技术研究与设计：[硕士学位论文].西安：西北大学,2007：31-32
[44]Hai Jin, Chengwei Wang, Hanhua Chen.Boundary Chord:A Novel Peer-to-Peer Algorithm for Replica Location Mechanism in Grid Environment [J]. IEEE,2005
[45]Ann Chervenak, Ewa Deelman, Ian Foster, Leanne Guy, Wolfgang Hoschek. Giggle:A Framework for Constructing Scalable Replica Location Services[J]. Supercomputing, ACM/IEEE 2002 Conference,2002:58
[46]王茜,田荣阳.数据网格环境下的一种副本定位方法[J].计算机应用研究.2006,7：150-152
[47]Dongsheng Li, et al. Dynamic Self-adaptive Replica Location Method in Data Grid[C]. Proceedings of the IEEE International Conference on Cluster Computing,2003:442-445
[48]田荣阳.数据网格中的副本定位及选择服务：[硕士学位论文].重庆：重庆大学,2006：27-28
[49]张慧娜.数据网格中数据复制管理技术研究：[硕士学位论文].武汉：华中科技大学,2007：23-24
[50]户家富.数据网格中元信息管理与一致性维护研究：[硕士学位论文].长沙：国防科技大学,2005：37-38
[51]Andrea Domenici, Flavia Donno, Gianni Pucciani, Heinz Stockinger, Kurt Stockinger. Replica consistency in a Data Grid[J]. IX International Workshop on Advanced Computing and Analysis Techniques in Physics Research, Tsukuba, Japan, December 2003
[52]The EU Data Grid Project, http://www.eu-datagrid.org/
[53]Ruay-Shiung Chang and Jih-Sheng Chang. Adaptable Replica Consistency Service for Data Grids[J]. IEEE Computer Society,2006
[54]Chao-Tung Yang, Wen-Chi Tsai. A One-way File Replica Consistency Model in Data Grids[J]. IEEE Computer Society,2007
[55]D.Dullmann, W.Hoschek, J.Jaen-Martinez. Models for replica synchronization and consistency in a data grid[J]. IEEE Computer Society,2001
[56]Yuzhong Sun and Zhiwei Xu,"Grid Replication Coherence Protocol",The 18th International Parallel and Distributed Processing Symposium, Santa Fe,USA,April 2004
[57]祁鑫,张春明.数据网格下基于时间戳的副本一致性模型研究[J].计算机工程与应用,2008,46(4)：104-106
[58]武鑫.数据网格中的副本管理策略关键技术研究：[硕士学位论文].西安：西安工业大学,2009：13-14
[59]韩宝玲.数据网格中副本一致性维护及选择的研究与实现：[硕士学位论文].长沙：国防科学技术大学,2008：23-25
[60]Andrea Domenici, Flavia Donno, Gianni Pucciani, Heinz Stockinger. Relaxed Data Consistency with CONStanza[J]. IEEE Computer Society,2006
[2]何戈,徐志伟.数据网格技术研究[J].微电子学与计算机,2003,4：3-4
[3]桂小林.网格技术导论[M].北京：北京邮电大学出版社,2005：6-7
[4]L Foster. The Grid:A New Inflastructum for 21 st Century Science. PhysicsToday,2002,55(2),42-47
[5]J. M. Schopf, B. Nitzberg. Grids:Top Ten Questions. Scientific Programming, special issue on Grid Computing,2002,10(2),103-111
[6]郭兰图.网格环境下基于Replica的数据管理与传输模型的研究：[硕士学位论文].山东：中国石油大学(华东),2007：7
[7]桂小林.网格技术导论[M].北京：北京邮电大学出版社,2005：32
[8]裴伦鹏.基于GRID技术的分布式(仿真)计算平台的研究与设计：[硕士学位论文].北京：北方工业大学,2006：8-10
[9]都志辉,陈渝,刘鹏.网格计算[M].北京：清华大学出版社,2002：12-15
[10]徐扬,王宏,宋宇.网格计算包罗一切[J].中国计算机,2002
[11]网格技术同分布式计算的区别.http://hi. baidu. com/j2h3344/blog/item/63a55bcb9c89c58fc8176862.html
[12]余渝.基于教育资源共享网格的数据复制策略研究：[硕士学位论文].重庆：重庆大学,2007：7-10
[13]梁英.网格环境下基于负载平衡的数据移动服务研究：’[硕士学位论文].长沙：中南大学,2005：1-2
[14]都志辉,陈渝,刘鹏,王小鸽,杜江,周念生.以服务为中心的网格体系结构OGSA[J].计算机科学,2003,7：26-28
[15]赵秋云.高性能计算环境下的副本技术研究：[硕士学位论文].成都：成都理工大学,2009：3-4
[16]王晓斌,才书训.网格体系结构研究[J].计算机工程与设计,2008,26(12)：3281-3282
[17]王翠.网格副本管理方法的研究：[硕士学位论文].长春：长春工业大学,2007：1-3
[18]尹春梅.网格环境下数据复制一致性的安全授权研究：[硕士学位论文].天津：天津大学,2007：6-7
[19]王海军.网格复制应用研究：[硕士学位论文].上海：上海交通大学,2008：10-11
[20]李三立.网格计算[M].北京：清华大学出版社.2002：15-23
[21]globus官方网站http://www.globus.org
[22]Maozhen Li, Mark Baker. The Grid Core Technoligies[M]. USA:John Wiley & Sons,2005:36-40
[23]谭勇.网格体系结构研究[J].湖北民族学院学报(自然科学版),2007,22(4)：86-89
[24]王驰.数据网格副本策略研究：[硕士学位论文].上海：上海交通大学：5-6
[25]OGSA简介.http://baike. baidu. com/view/1151990. htm?fr=ala0_1
[26]郎博.基于OGSA的网格服务研究[J].计算机技术与发展,2006,16(4)：161-163
[27]吴帆,叶懋,陈贵海.广域网虚拟平台：网格计算和对等计算的融合[J].计算机科学,2005,32(5)：23-25
[28]网格体系结构概述.http://www.ibm.com/developerworks/cn/grid/gr-fann/index.html
[29]Dongsheng LI, Nong Xiao, Xicheng LU, Yijie WANG, Kai LU. Dynamic Self-Adaptive Replica Location Method in Data Grids[J]. Proceedings of the IEEE International Conference on Cluster Computing,2003
[30]杨寿保.数据网格环境下数据复制技术的研究：[硕士学位论文].合肥：中国科学技术大学,2006：6-7
[31]REN Xun-yi, WANG Ru-chuan, KONG Qing. Efficient Model for Replica Consistency Maintenance in Data Grids[J]. IEEE Computer Society,2008
[32]王福业.数据网格中分布式副本定位技术研究及实现：[硕士学位论文].北京：北京化工大学,2008：8-9
[33]李田来.基于GLOBUS的数据网格副本管理关键问题研究：[硕士学位论文].济南：山东师范大学,2008：12
[34]QingFan Gu, Bing Chen, Yuping Zhang. Dynamic Replica Placement and Location Strategies for Data Grid [J]. IEEE Computer Society,2008
[35]王铁军,周明天,郑方伟.基于分布式生成树的副本定位服务[J].计算机工程与应用.2007,43(30)：152-153
[36]Qiwei Zhang, Jiangming Yang and Ning Gu. Dynamic Replica Location Service Supporting Data Grid Systems [J]. IEEE Computer Society,2006
[37]邹立达,刘方爱,马艳.教育资源网格的副本定位策略研究[J].计算机工程与设计.2008,29(18)：4697-4699
[38]马元元.信息网格中基于服务的副本管理机制研究：[硕士学位论文].西安：西北师范大学,2007：30-31
[39]张春明.数据网格中副本一致性模型的研究：[硕士学位论文].山东：中国石油大学(华东),2008：34-36
[40]ChangZe Wu, Dong Tian, ZhongFu Wu Dynamic. Equilibrium Replica Location Algorithms in Data Grid[R]. The Third ChinaGrid Annual Conference, 2008:126-130
[41]高改梅,白尚旺,党伟超.一种分布式数据网格副本定位机制的研究[J].太远科技大学学报.2007,28(4)：262-265
[42]孙海燕.数据网格副本管理关键技术研究：[博士学位论文].长沙：国防科学技术大学,2005：56-57
[43]王剑.校园数据网格关键技术研究与设计：[硕士学位论文].西安：西北大学,2007：31-32
[44]Hai Jin, Chengwei Wang, Hanhua Chen.Boundary Chord:A Novel Peer-to-Peer Algorithm for Replica Location Mechanism in Grid Environment [J]. IEEE,2005
[45]Ann Chervenak, Ewa Deelman, Ian Foster, Leanne Guy, Wolfgang Hoschek. Giggle:A Framework for Constructing Scalable Replica Location Services[J]. Supercomputing, ACM/IEEE 2002 Conference,2002:58
[46]王茜,田荣阳.数据网格环境下的一种副本定位方法[J].计算机应用研究.2006,7：150-152
[47]Dongsheng Li, et al. Dynamic Self-adaptive Replica Location Method in Data Grid[C]. Proceedings of the IEEE International Conference on Cluster Computing,2003:442-445
[48]田荣阳.数据网格中的副本定位及选择服务：[硕士学位论文].重庆：重庆大学,2006：27-28
[49]张慧娜.数据网格中数据复制管理技术研究：[硕士学位论文].武汉：华中科技大学,2007：23-24
[50]户家富.数据网格中元信息管理与一致性维护研究：[硕士学位论文].长沙：国防科技大学,2005：37-38
[51]Andrea Domenici, Flavia Donno, Gianni Pucciani, Heinz Stockinger, Kurt Stockinger. Replica consistency in a Data Grid[J]. IX International Workshop on Advanced Computing and Analysis Techniques in Physics Research, Tsukuba, Japan, December 2003
[52]The EU Data Grid Project, http://www.eu-datagrid.org/
[53]Ruay-Shiung Chang and Jih-Sheng Chang. Adaptable Replica Consistency Service for Data Grids[J]. IEEE Computer Society,2006
[54]Chao-Tung Yang, Wen-Chi Tsai. A One-way File Replica Consistency Model in Data Grids[J]. IEEE Computer Society,2007
[55]D.Dullmann, W.Hoschek, J.Jaen-Martinez. Models for replica synchronization and consistency in a data grid[J]. IEEE Computer Society,2001
[56]Yuzhong Sun and Zhiwei Xu,"Grid Replication Coherence Protocol",The 18th International Parallel and Distributed Processing Symposium, Santa Fe,USA,April 2004
[57]祁鑫,张春明.数据网格下基于时间戳的副本一致性模型研究[J].计算机工程与应用,2008,46(4)：104-106
[58]武鑫.数据网格中的副本管理策略关键技术研究：[硕士学位论文].西安：西安工业大学,2009：13-14
[59]韩宝玲.数据网格中副本一致性维护及选择的研究与实现：[硕士学位论文].长沙：国防科学技术大学,2008：23-25
[60]Andrea Domenici, Flavia Donno, Gianni Pucciani, Heinz Stockinger. Relaxed Data Consistency with CONStanza[J]. IEEE Computer Society,2006