网格通信相关技术研究
摘要
网格作为建立在互联网之上的新一代技术,在国内外的学术界和工业界都引起了广泛的关注。不同于传统的分布式计算,网格将网络、通信、计算和信息结合起来形成一个虚拟平台为用户提供一体化信息和应用服务。
本文结合近年来国内外对网格技术的研究成果,对网格的概念、网格的体系结构及网格的应用进行了论述,并结合现有的网络技术,对网格通信中存在的问题进行了分析总结,其中包括网格通信的协议、网格带宽管理、网格环境下的高速网络性能分析和基于策略的网格管理。最后,本文从网格QoS特性、网格QoS保证机制、基于QoS的网格体系结构及网格参数等四个方面着手,对网格QoS进行了理论上的研究,并通过实验对两种网格QoS支持体系GARA和G-QoSM进行了分析比较。
As a new generation of technology based on the Internet,the grid is widely paid attention to within academia and industry circles both domestically and internationally. Distinguished from conventional distributed computing,the grid combines networking, communication, computation and information to provide a virtual platform for users with an integrated information and application services.
Based on the researches on domestic and international grid technology in recent years, the concept, architecture, and the application of the grid are discussed in current paper. Combined with existing network technology, several grid communicating issues, such as the grid protocols, grid bandwidth management, analysis of high-speed network performance in grid environment and policy-based gird management are analyzed and summarized. Finally, some in-depth studies on theories are done based on the characteristics of grid QoS,the guarantee mechanism of grid QoS,QoS-based grid architecture and grid parameters, and the simulation experiments are designed to analyze and compare the two kinds of grid QoS supporting system, GARA and G-QoSM .
本文结合近年来国内外对网格技术的研究成果,对网格的概念、网格的体系结构及网格的应用进行了论述,并结合现有的网络技术,对网格通信中存在的问题进行了分析总结,其中包括网格通信的协议、网格带宽管理、网格环境下的高速网络性能分析和基于策略的网格管理。最后,本文从网格QoS特性、网格QoS保证机制、基于QoS的网格体系结构及网格参数等四个方面着手,对网格QoS进行了理论上的研究,并通过实验对两种网格QoS支持体系GARA和G-QoSM进行了分析比较。
As a new generation of technology based on the Internet,the grid is widely paid attention to within academia and industry circles both domestically and internationally. Distinguished from conventional distributed computing,the grid combines networking, communication, computation and information to provide a virtual platform for users with an integrated information and application services.
Based on the researches on domestic and international grid technology in recent years, the concept, architecture, and the application of the grid are discussed in current paper. Combined with existing network technology, several grid communicating issues, such as the grid protocols, grid bandwidth management, analysis of high-speed network performance in grid environment and policy-based gird management are analyzed and summarized. Finally, some in-depth studies on theories are done based on the characteristics of grid QoS,the guarantee mechanism of grid QoS,QoS-based grid architecture and grid parameters, and the simulation experiments are designed to analyze and compare the two kinds of grid QoS supporting system, GARA and G-QoSM .
引文
[1] I.Foster and C.Kesselman.The Grid:Blueprint for a Future Computing Infrastucture.Morgan Kaufmann Publishers.1999
[2] Ian Foster.What is the Grid?A Three Point Checklist.July 20,2002
[3]徐志伟,冯百明,李伟.网格计算技术.电子工业出版社.2004,5
[4] Hai Jin.“ChinaGrid : Making Grid Computing a Reality”,Digital Libraries:International Collaboration and Cross-Fertilization - Lecture Notes in Computer Science.Vol.3334,Springer-Verlag, December 2004, pp.13-24
[5] German D-Grid Initiative.https://www.d-grid.de/
[6] TeraGrid.http://www.teragrid.org
[7] EGEE.Enabling Grids for e-Science.http:// eu-egee.org/
[8] NAREGI Japanese national grid project.http:// www.naregi.org/index_e.html
[9] UK e-Science Programme.http://www.rcuk.ac.uk/escience/
[10] I Foster,C Kesselman,S Tuecke.The Anatomy of the Grid:Enabling Scalable Virtual Organizations.International Journal Supercomputer Applications.2001,15(3),pp.200～222
[11] S Tuecke,K Czajkowski,I Foster,et al.Open Grid Services Infrastructure(OGSI)V1.0. http://forge.gridforum.org/projects/ggf-editor/document/draft-ogsi-service-1/en/1 ,2003,4,5
[12] Jay Unger,Matt Haynos.A visual tour of Open Grid Services Architecture--Examine the component structure of OGSA. http://www-900.ibm.com/developerWorks/cn/grid/gr-visual/index_eng.shtml ,October 2003
[13]都志辉,陈渝,刘鹏.网格计算.清华大学.2002
[14] OGSA结构描述.http://www.globus.org/ogsa
[15] Grid High Performance Networking Research Group.Networking Issues for Grid Infrastructure.http://www.gridforum.org
[16] Martin C. Brown,网格中的带宽管理,http://www.ibm.com/developerworks/cn/grid/gr-band/
[17] Anshul Kothari,Subhash Suri,Yunhong Zhou.Bandwidth-Constrained Allocation in Grid Computing.Algorithmica (2008) 52: 487–501
[18] http://www.globus.org/
[19] F.Berman,R.Wolski.The AppLeS Project:A Status Report. Proceedings of the 8th NEC Research Symposium.Berlin,Germany,May 1997
[20] http://apples.ucsd.edu/pubs/
[21] Andrew S,Grimshaw and Wm.A.Wulf and the Legion team.The Legion Vision of a Worldwide Virtual Computer Communications of the ACM,40 (1),January 1997
[22] http://www.cs.virginia.edu/~legion/
[23] Rajkumar Buyya, David Abramson, and Jonathan Giddy.Nimrod/G:an architecture for a resource management and scheduling system in a global computational grid.In Proceedings of the Fourth International Conference on High Performance Computing in Asia-Pacific Region. Beijing,China,2000
[24] http://www.csse.monash.edu.au/~davida/nimrod/nimrodg.htm
[25] http://www.cs.wisc.edu/condor/
[26] A Hierarchy of Network Performance Characteristics for Grid Applications and Services,http://www.ogf.org/
[27] N.Damianou.A Policy Framework for Management of Distributed Systems.Ph.D. Thesis, University of London,February 2002
[28] Jean-Christophe Martin.Policy-Based networks.Sun BluePrints? OnLine - October 1999
[29] B. Sundaram and B.M.Chapman.“Xml-based policy framework for usage policy management in grids ,”in Grid’02 3rd International workshop on Grid Computing.2002
[30] The IETF Policy Framework Working Group: Charter available at the URL.http://www.ietf.org/html.charters/policy-charter.html
[31] Distributed Management Task Force Policy Working Group.Charter available at URL.http://www.dmtf.org/about/working/sla.php
[32] K. Yang, et al.“Policy-based active grid management architure,”10th IEEE International Conference on Networks.2002
[33] D. C. Verma et al.“A policy service for grid computing,”in Grid Computing - GRID 2002.Third International Workshop.Nov. 2002, pp. 243–255
[34] Ricardo Neisse, Lisandro Z. Granville, Maria Janilce B. Almeida and Liane Margarida R. Tarouco.On Translating Grid Requirements to Network Configurations through Policy-Based Management.Proceedings of the Fifth IEEE/ACM International Workshop on Grid Computing
[35] Lars-Olof Burchard, Hans-Ulrich Heiss.Performance Issues of Bandwidth Reservations for Grid Computing.Proceedings of the 15th Symposium on ComputerArchitecture and High Performance Computing
[36] http://qbone.internet2.edu/bb/bboutline2.html
[37] Loris Marchal, Pascale Vicat-Blanc Primet, Yves Robert and Jingdi Zeng.Optimal Bandwidth Sharing in Grid Environments
[38] http://www.globus.org/grid_software/data/gridftp.php
[39] W. Feng , P. Tinnakornsrisuphap.The Failure of TCP in High-Performance Computational Grids
[40]任勇毛,唐海娜,李俊,钱华林.高速网络TCP改进协议NS2仿真性能比较.计算机工程,2009,Vol.35,No.2
[41]王猛,刘伯栋,孟小波.高速拥塞控制端算法的仿真与分析.Radio Engineering.2008,Vol.38,No.9
[42]杨薇.高带宽延迟网络中的拥塞控制.网络安全与技术应用.2009.2
[43] Mohammad A. Talaat, Magdi A. Koutb, and Hoda S. Sorour.Congestion Control for Internet Media Traffic.World Academy of Science, Engineering and Technology.2008
[44] G. Bochmann and A. Hafid.“Some Principles for Quality of Service Management”Technical report.Universite de Montreal, 1996
[45] W. Allcock, J. Bester, J. Bresnahan, A. Chervenak,I. Foster, C. Kesselman, S. Meder,V. Nefedova, D. Quesnel, and S. Tuecke.Data Management and Transfer in High-Performance Computational Grid Environments.Parallel Computing (2001)
[46] Cannataro M,Talia D,Trunfio P.The Knowledge Grid:Towards an Architecture for Knowledge Discovery on the Grid.Communications of the ACM,2003,46( 1):89 -93
[47] Foster I, Kesselman C,Jefrey M Nick et al. Grids services for distributed system integration[J],Computer,2002,35(6):37-46
[48] Foster I, Roy A, Sander V, Winkler L.End-to-End Quality of Service for High-End Applications. Computer communications, 2003
[49]梁泉,张宏正,梁开健,杨扬.网格环境下的服务质量(QoS)研究.计算机科学.2006,Vol.33,No.7
[50] Chatterjee BSS, Sydir MDJJ, Lawrence TF. Taxonomy for QoS specifications. In: Proc. of the 3rd Int’l Workshop on Object-Oriented Real-Time Dependable Systems (WORDS’97). Newreport Beach, 1997. 100?107
[51]伍之昂,罗军舟,宋爱波.基于QoS的网格资源管理.Journal of Software.Vol.17, No.11, November 2006, pp.2264?2276
[52] Al-Ali R,Rana O,et al.A Model for Quality of Service Provision in Service OrientedAchitectures.International Journal of Grid and Utility Computing.2004
[53]曾万聃.网格环境中服务质量保证相关问题的研究.计算机科学.2006,2,1
[54] Hong-Linh Truong, Robert Samborski, Thomas Fahringer.Towards a Framework for Monitoring and Analyzing QoS Metrics of Grid Services.Proceedings of the Second IEEE International Conference on e-Science and Grid Computing
[55] Edward Wu,Stenhoff.Service Level Agreement in the Data Center.Sun Professional Services Sun BluePrints? OnLine - April 2002
[56] A. Sahai, S. Graupner, V. Machiraju and A. Moorsel.“Specifying and Monitoring Guarantees in Commercial Grids through SLA”.In Proceedings of the 3rd IEEE/ACMCCGrid 2003.2003
[57] K. Czajkowski, I. Foster, C. Kesselman, V. Sander and S. Tuecke.“SNAP: A Protocol for Negotiating Service Level Agreements and Coordinating Resource Management in Distributed Systems”, in Proceedings of the 8th Workshop on Job Scheduling Strategies for Parallel Processing, 2002
[58] K. Keahey and K. Motawi.“The Taming of the Grid: Virtual Application Service”.Argonne National Laboratory Technical Memorandum No. 262, May 2003
[59] L. Burchard, M. Hovestadt, O. Kao, A. Keller and B. Linnert.“The Virtual Resource Manager: An Architecture for SLA-aware Resource Management”, in Proceedings of IEEE CCGrid 2004, Chicago, US, 2004 (to appear)
[60]王小志,罗军舟,朱烨,宋爱波.一种基于QoS的网格资源分配管理模型.第十四届中国计算机学会网络与数据通信学术会议
[61] Ian Foster,Carl Kesselman,Craig Lee,Bob Lindell,Klara Nahrstedt,Alain Roy.A Distributed Resource Management Architecture that Supports Advance Reservations and Co-Allocation
[62] R. Al-Ali, O. Rana, D. Walker, S. Jha, and S. Sohail. G-QoSM: Grid service discovery using QoS properties.Computing and Informatics Journal, Special Issue on Grid Computing, 21(4):363–382, 2002
[63] R.Al-Ali, A.ShaikhAli, O.Rana, and D.Walker.Supporting QoS-based discovery in service-oriented grids.In Proceedings of IEEE Heterogeneous Computing Workshop (HCW’03), Nice, France, 2003
[2] Ian Foster.What is the Grid?A Three Point Checklist.July 20,2002
[3]徐志伟,冯百明,李伟.网格计算技术.电子工业出版社.2004,5
[4] Hai Jin.“ChinaGrid : Making Grid Computing a Reality”,Digital Libraries:International Collaboration and Cross-Fertilization - Lecture Notes in Computer Science.Vol.3334,Springer-Verlag, December 2004, pp.13-24
[5] German D-Grid Initiative.https://www.d-grid.de/
[6] TeraGrid.http://www.teragrid.org
[7] EGEE.Enabling Grids for e-Science.http:// eu-egee.org/
[8] NAREGI Japanese national grid project.http:// www.naregi.org/index_e.html
[9] UK e-Science Programme.http://www.rcuk.ac.uk/escience/
[10] I Foster,C Kesselman,S Tuecke.The Anatomy of the Grid:Enabling Scalable Virtual Organizations.International Journal Supercomputer Applications.2001,15(3),pp.200～222
[11] S Tuecke,K Czajkowski,I Foster,et al.Open Grid Services Infrastructure(OGSI)V1.0. http://forge.gridforum.org/projects/ggf-editor/document/draft-ogsi-service-1/en/1 ,2003,4,5
[12] Jay Unger,Matt Haynos.A visual tour of Open Grid Services Architecture--Examine the component structure of OGSA. http://www-900.ibm.com/developerWorks/cn/grid/gr-visual/index_eng.shtml ,October 2003
[13]都志辉,陈渝,刘鹏.网格计算.清华大学.2002
[14] OGSA结构描述.http://www.globus.org/ogsa
[15] Grid High Performance Networking Research Group.Networking Issues for Grid Infrastructure.http://www.gridforum.org
[16] Martin C. Brown,网格中的带宽管理,http://www.ibm.com/developerworks/cn/grid/gr-band/
[17] Anshul Kothari,Subhash Suri,Yunhong Zhou.Bandwidth-Constrained Allocation in Grid Computing.Algorithmica (2008) 52: 487–501
[18] http://www.globus.org/
[19] F.Berman,R.Wolski.The AppLeS Project:A Status Report. Proceedings of the 8th NEC Research Symposium.Berlin,Germany,May 1997
[20] http://apples.ucsd.edu/pubs/
[21] Andrew S,Grimshaw and Wm.A.Wulf and the Legion team.The Legion Vision of a Worldwide Virtual Computer Communications of the ACM,40 (1),January 1997
[22] http://www.cs.virginia.edu/~legion/
[23] Rajkumar Buyya, David Abramson, and Jonathan Giddy.Nimrod/G:an architecture for a resource management and scheduling system in a global computational grid.In Proceedings of the Fourth International Conference on High Performance Computing in Asia-Pacific Region. Beijing,China,2000
[24] http://www.csse.monash.edu.au/~davida/nimrod/nimrodg.htm
[25] http://www.cs.wisc.edu/condor/
[26] A Hierarchy of Network Performance Characteristics for Grid Applications and Services,http://www.ogf.org/
[27] N.Damianou.A Policy Framework for Management of Distributed Systems.Ph.D. Thesis, University of London,February 2002
[28] Jean-Christophe Martin.Policy-Based networks.Sun BluePrints? OnLine - October 1999
[29] B. Sundaram and B.M.Chapman.“Xml-based policy framework for usage policy management in grids ,”in Grid’02 3rd International workshop on Grid Computing.2002
[30] The IETF Policy Framework Working Group: Charter available at the URL.http://www.ietf.org/html.charters/policy-charter.html
[31] Distributed Management Task Force Policy Working Group.Charter available at URL.http://www.dmtf.org/about/working/sla.php
[32] K. Yang, et al.“Policy-based active grid management architure,”10th IEEE International Conference on Networks.2002
[33] D. C. Verma et al.“A policy service for grid computing,”in Grid Computing - GRID 2002.Third International Workshop.Nov. 2002, pp. 243–255
[34] Ricardo Neisse, Lisandro Z. Granville, Maria Janilce B. Almeida and Liane Margarida R. Tarouco.On Translating Grid Requirements to Network Configurations through Policy-Based Management.Proceedings of the Fifth IEEE/ACM International Workshop on Grid Computing
[35] Lars-Olof Burchard, Hans-Ulrich Heiss.Performance Issues of Bandwidth Reservations for Grid Computing.Proceedings of the 15th Symposium on ComputerArchitecture and High Performance Computing
[36] http://qbone.internet2.edu/bb/bboutline2.html
[37] Loris Marchal, Pascale Vicat-Blanc Primet, Yves Robert and Jingdi Zeng.Optimal Bandwidth Sharing in Grid Environments
[38] http://www.globus.org/grid_software/data/gridftp.php
[39] W. Feng , P. Tinnakornsrisuphap.The Failure of TCP in High-Performance Computational Grids
[40]任勇毛,唐海娜,李俊,钱华林.高速网络TCP改进协议NS2仿真性能比较.计算机工程,2009,Vol.35,No.2
[41]王猛,刘伯栋,孟小波.高速拥塞控制端算法的仿真与分析.Radio Engineering.2008,Vol.38,No.9
[42]杨薇.高带宽延迟网络中的拥塞控制.网络安全与技术应用.2009.2
[43] Mohammad A. Talaat, Magdi A. Koutb, and Hoda S. Sorour.Congestion Control for Internet Media Traffic.World Academy of Science, Engineering and Technology.2008
[44] G. Bochmann and A. Hafid.“Some Principles for Quality of Service Management”Technical report.Universite de Montreal, 1996
[45] W. Allcock, J. Bester, J. Bresnahan, A. Chervenak,I. Foster, C. Kesselman, S. Meder,V. Nefedova, D. Quesnel, and S. Tuecke.Data Management and Transfer in High-Performance Computational Grid Environments.Parallel Computing (2001)
[46] Cannataro M,Talia D,Trunfio P.The Knowledge Grid:Towards an Architecture for Knowledge Discovery on the Grid.Communications of the ACM,2003,46( 1):89 -93
[47] Foster I, Kesselman C,Jefrey M Nick et al. Grids services for distributed system integration[J],Computer,2002,35(6):37-46
[48] Foster I, Roy A, Sander V, Winkler L.End-to-End Quality of Service for High-End Applications. Computer communications, 2003
[49]梁泉,张宏正,梁开健,杨扬.网格环境下的服务质量(QoS)研究.计算机科学.2006,Vol.33,No.7
[50] Chatterjee BSS, Sydir MDJJ, Lawrence TF. Taxonomy for QoS specifications. In: Proc. of the 3rd Int’l Workshop on Object-Oriented Real-Time Dependable Systems (WORDS’97). Newreport Beach, 1997. 100?107
[51]伍之昂,罗军舟,宋爱波.基于QoS的网格资源管理.Journal of Software.Vol.17, No.11, November 2006, pp.2264?2276
[52] Al-Ali R,Rana O,et al.A Model for Quality of Service Provision in Service OrientedAchitectures.International Journal of Grid and Utility Computing.2004
[53]曾万聃.网格环境中服务质量保证相关问题的研究.计算机科学.2006,2,1
[54] Hong-Linh Truong, Robert Samborski, Thomas Fahringer.Towards a Framework for Monitoring and Analyzing QoS Metrics of Grid Services.Proceedings of the Second IEEE International Conference on e-Science and Grid Computing
[55] Edward Wu,Stenhoff.Service Level Agreement in the Data Center.Sun Professional Services Sun BluePrints? OnLine - April 2002
[56] A. Sahai, S. Graupner, V. Machiraju and A. Moorsel.“Specifying and Monitoring Guarantees in Commercial Grids through SLA”.In Proceedings of the 3rd IEEE/ACMCCGrid 2003.2003
[57] K. Czajkowski, I. Foster, C. Kesselman, V. Sander and S. Tuecke.“SNAP: A Protocol for Negotiating Service Level Agreements and Coordinating Resource Management in Distributed Systems”, in Proceedings of the 8th Workshop on Job Scheduling Strategies for Parallel Processing, 2002
[58] K. Keahey and K. Motawi.“The Taming of the Grid: Virtual Application Service”.Argonne National Laboratory Technical Memorandum No. 262, May 2003
[59] L. Burchard, M. Hovestadt, O. Kao, A. Keller and B. Linnert.“The Virtual Resource Manager: An Architecture for SLA-aware Resource Management”, in Proceedings of IEEE CCGrid 2004, Chicago, US, 2004 (to appear)
[60]王小志,罗军舟,朱烨,宋爱波.一种基于QoS的网格资源分配管理模型.第十四届中国计算机学会网络与数据通信学术会议
[61] Ian Foster,Carl Kesselman,Craig Lee,Bob Lindell,Klara Nahrstedt,Alain Roy.A Distributed Resource Management Architecture that Supports Advance Reservations and Co-Allocation
[62] R. Al-Ali, O. Rana, D. Walker, S. Jha, and S. Sohail. G-QoSM: Grid service discovery using QoS properties.Computing and Informatics Journal, Special Issue on Grid Computing, 21(4):363–382, 2002
[63] R.Al-Ali, A.ShaikhAli, O.Rana, and D.Walker.Supporting QoS-based discovery in service-oriented grids.In Proceedings of IEEE Heterogeneous Computing Workshop (HCW’03), Nice, France, 2003