基于OGSA的网格计算资源的管理和调度
|
摘要
网格计算是继Internet和Web技术之后,第三个信息技术浪潮,最终将改变分布式资源的共享和服务方式。开放网格服务体系结构OGSA是目前网格最新的体系结构,该体系结构基于Web Service框架提出了一种网格服务结构的思想。OGSA服务功能主要包括动态服务创建、服务发现、生命周期管理、注册通知等。
论文对网格技术的研究基于胜利油田物探研究院重点科技攻关项目——《计算机网格技术在地震处理解释中的应用研究》。该项目利用网格技术,以OGSA构架为基础、GT3(Globus Toolkits 3)为网格平台,构建一个网格计算资源管理和调度原型系统平台。
论文首先对网格的概念和网格计算中网格服务的实现进行了介绍。然后对两种网格体系结构进行比较,并详细分析了网格的OGSA体系结构。论文重点介绍基于OGSA的网格计算资源的管理和调度系统原型平台的功能概念设计和具体实现,验证了跨平台的网格服务调用。
该原型系统架构在机群管理软件和网格中间件的基础之上,以资源请求代理的方式进行工作,完成网格中间件与机群管理系统之间资源与作业的连接。系统利用网格技术实现计算资源的管理和调度,完成统一资源信息管理、统一用户管理、统一作业管理和安全认证,初步解决了网格系统中存在的计算机异构、资源信息动态变化等关键问题,为高层软件和网格应用提供了透明的支持。
该系统可以在Internet范围内提供一体化的高性能计算环境和信息服务。Internet上任何一台计算机都可以加入该系统访问和使用计算资源服务。本研究项目已由胜利油田物探研究院组织审查,并通过验收!
最后,本论文总结了工作中尚存的不足,并分析了进一步的工作展望。
Grid Computing is the third wave of information technology after Internet andWeb technology. It will change the mode of sharing distributed resources and servicesfinally. The Open Grid Service Architecture (OGSA) is current version of the Gridarchitecture. Based on the mechanism of Web Service, OGSA advanced an idea ofGrid Services, whose interfaces address discovery, dynamic service creation, lifetimemanagement, notification and registry.
The study of Grid technology in this thesis is based on an important project ingeophysical research institute of ShengLi Petroleum —《The Application andResearch of Grid Technique in Seismic Data Processing and Interpretation》.Based onOGSA and GT3 (Globus Toolkit 3), this research proposed a settlement scheme of anapplication system about the management of computing grid resources.
At first the thesis briefly introduced the definition of the grid and the realizationtechnique of the grid service in the grid computing. Then, contrasted the differentarchitectural structures on grid and analyzed the application value of OGSA. Wedepicted design and implementation of the system in detail, and then certificated theproblem of the service call from different platform.
Based on cluster software and Grid Middleware, first, the system works as anagent to connect them to work together. Then, utilizing the service date of the GridService, the system completes the management of computational resource and realizesthe unified management of resource, users and tasks. Last, the system also solves safecertification problem and so on.
This system offers high capability computing condition in Internet. Anycomputer can access the computer resource service anytime. The research has beenconfirmed by the geophysical research institute of ShengLi Petroleum .
Finally, summarized the deficiency of our work, and pointed out the perspectiveof Grid Computing.
论文对网格技术的研究基于胜利油田物探研究院重点科技攻关项目——《计算机网格技术在地震处理解释中的应用研究》。该项目利用网格技术,以OGSA构架为基础、GT3(Globus Toolkits 3)为网格平台,构建一个网格计算资源管理和调度原型系统平台。
论文首先对网格的概念和网格计算中网格服务的实现进行了介绍。然后对两种网格体系结构进行比较,并详细分析了网格的OGSA体系结构。论文重点介绍基于OGSA的网格计算资源的管理和调度系统原型平台的功能概念设计和具体实现,验证了跨平台的网格服务调用。
该原型系统架构在机群管理软件和网格中间件的基础之上,以资源请求代理的方式进行工作,完成网格中间件与机群管理系统之间资源与作业的连接。系统利用网格技术实现计算资源的管理和调度,完成统一资源信息管理、统一用户管理、统一作业管理和安全认证,初步解决了网格系统中存在的计算机异构、资源信息动态变化等关键问题,为高层软件和网格应用提供了透明的支持。
该系统可以在Internet范围内提供一体化的高性能计算环境和信息服务。Internet上任何一台计算机都可以加入该系统访问和使用计算资源服务。本研究项目已由胜利油田物探研究院组织审查,并通过验收!
最后,本论文总结了工作中尚存的不足,并分析了进一步的工作展望。
Grid Computing is the third wave of information technology after Internet andWeb technology. It will change the mode of sharing distributed resources and servicesfinally. The Open Grid Service Architecture (OGSA) is current version of the Gridarchitecture. Based on the mechanism of Web Service, OGSA advanced an idea ofGrid Services, whose interfaces address discovery, dynamic service creation, lifetimemanagement, notification and registry.
The study of Grid technology in this thesis is based on an important project ingeophysical research institute of ShengLi Petroleum —《The Application andResearch of Grid Technique in Seismic Data Processing and Interpretation》.Based onOGSA and GT3 (Globus Toolkit 3), this research proposed a settlement scheme of anapplication system about the management of computing grid resources.
At first the thesis briefly introduced the definition of the grid and the realizationtechnique of the grid service in the grid computing. Then, contrasted the differentarchitectural structures on grid and analyzed the application value of OGSA. Wedepicted design and implementation of the system in detail, and then certificated theproblem of the service call from different platform.
Based on cluster software and Grid Middleware, first, the system works as anagent to connect them to work together. Then, utilizing the service date of the GridService, the system completes the management of computational resource and realizesthe unified management of resource, users and tasks. Last, the system also solves safecertification problem and so on.
This system offers high capability computing condition in Internet. Anycomputer can access the computer resource service anytime. The research has beenconfirmed by the geophysical research institute of ShengLi Petroleum .
Finally, summarized the deficiency of our work, and pointed out the perspectiveof Grid Computing.
引文
[1] Ian Foster. Internet Computing and the Emerging Grid, http://www.nature.com/nature/webmatters/grid/grid.html,Dec 7 2000
[2]OGSA 规范, http://www.gridformun.org/ogsi-wg/drafts/GS-draft03 2002-07-17.pdf
[3]刘鹏,网格发展趋势,消华大学计算机系高性能所网格研究组, http://www.gridhome.com/grid/paperppt/GridTrend.pdf, 2003.03.02
[4] Ian Foster, Carl Kesselman,The Grid:Blueprint for a New Computing Infrastructure, Morgan Kaufmann,San Fransisco, CA, http://www.gridforum.org/,1999
[5] Global Grid Forum, http://www.globalgridforum.com/
[6]刘鹏,网格概念的界定,清华大学计算机系高性能所网格研究组, http://www.gridhome.com/grid/paperppt/GridConcept.pdf, 2003.03.02
[7]都志辉,陈渝,刘鹏,网格计算,2002,清华大学出版社出版,pp: 17-130
[8]徐志伟,李晓林,游赣梅,织女星信息网格的体系结构研究,计算机研究与发展,2002,第 39 卷第 8 期
[9]网格体系结构工作组,http://www.globalgridforum.com/5_ARCH/ GPA.htm, http://grid.lbl.gov/GPA/ExampleArchitectures.ppt
[10]Ian Foster, Carl Kessetman, A Distributed Resource Management Architecture that Supports Advance Reservations and Co-Allocation, Intl Workshop on Quality of Service,1999
[11]楼国宪,基于 OGSA 的类比生成服务的研究,浙江大学,硕士研究生论文, 2003,pp: 24 一 5
[12] Ian Foster, Carl Kesselman, Jeffrey M. Nick, Steven Tuecke, The Physiology of the Grid. An Open Grid Services Architecture for Distributed Systems Integration, Open Grid Service Infrastructure WG,Global Grid Forum, http://www.globus.org/research/papers/ogsa.pdf, Jun 22 2002,pp. 18-24
[l3]都志辉,陈渝,刘鹏等,以服务为中心的网格体系结构 OGSA,清华大学计 算 机 系 , http://hpclab.cs.tsinghua.edu.cn/~duzh/project/ogsa/ogsaintro.pdf, 2002.9.2
[14] Ian Foster, Carl Kesselman, Steven Tuecke,The Anatomy of the Grid,余浩,清华大学计算机系,2003,pp:4 一 12
[15]黄飏,李伟,徐志伟,国家高性能计算环境中的资源目录管理, http://www.gridhome.com/grid/paperppt/gct/rdmncg01.pdf, 2001.2
[16]李伟,谈恩华,Globus 项目进展和技术水平分析, http://www.gridhome.com/grid/paperppt//gct/psg2001.pdf, 2001.2.12
[17] Luis Ferreira. Bart Jacob, Scan Sievin, Globus Toolkit 3.0 Quick Start, IBM.com/redbooks,Aug 2003,pp: 5-97
[18]佚名,网格的机理:一个应用于分布式系统整合的开放式 Grid 服务体系结构, http://www.gridhome.com/grid/paperppt/GirdPhysiology,pdf, 2003
[19]柴晓路,梁字奇,Web Services 技术、架构和应用,电子工业出版社,2003, pp: 346 一 25
[20] OGSA Specification, http://www.gridforum.org/ogsi-wg/drafts/GS_ Spec_draft03_2002_07_17.pdf
[21]曾柏毅,李勇,OGSA 的 Registry Server 在小规模下的实现, http://hpclab.cs.tsinghua.edu,cn/~duzh/project/ogsa/zl-rs.doc, 2002.10.29
[22]Peng Liu, Yao Shi, Francis C.M.Lau,Cho-Li Wang,SanLiLi,Grid Demo Proposal: AntiSpamGrid, IEEE International Conference on Cluster Computing, Hong Kong,Dec 1-4 2003
[23] 刘鹏,《提出一种实用的网格实现方式-网格计算池模型》,2004
[24] 张月卓,GT3 体系结构介绍, http://www.gridhome.com/grid/papaerppt/GT3Arch.ppt,2003
[25] Borja Sotomayor, The Globus Toolkit 3 Progranunces Tutorial(Version 0.2), http:///www.casa-sotomayor.net/gt3-tutorial/, Jun 25 2003,pp. 23-97
[26] Liang-Jie Zhang,开发网格计算应用程序, htip://www-106.ibm.com/developerworks/grid/library/ws-grid/, 2003
[27] Ian Foster, Carl Kesselman, Grid Services far Distributed System Integration,肖贺,2003.3.2, pp: 4-11
[28] Ian Foster, Carl Kesselman, Globus: A Metacomputing Infrastructure Toolkit, International Journal of SupercomputerApplications, 11(2): 115-128, http://www.globus.org, 1997
[29] 刘鹏,网格应用研究现状,清华大学计算机系高性能所网格研究组, http://www.chinagrid.net/grid/paperppt/GridApplications.pdf
[30] Graham et al., Building Web Services with Java, Making Sense of XML, SOAP, WSDL, and UDDI, Sams Technical Publishing, Indianapolis, Ind., 2001
[31]刘鹏,《我国网格研究现状》,2003
[32]都志辉,《OGSA 研究设想》,2002
[33] OGSA 结构描述,http://rvww.gridforum.org/ogsi-wg/drafts,
[34]I.Foster,C.Kesselman,S.Tuecke.”The Anatomy of the Grid:Enabling Scalable Virtual Organizations” .International J.Supercomputer Applications,15(3),2001.
[35] 胡立栓,《Globus Toolkits 3 Installing on RedHat9.0——配置实验室环境下的 Gloubs 系统》,中国地质大学(北京) http://www.gridhome.com/dvnews/show.aspx?id=86&cid=17
[36] 宋莉,胡立栓,肖沣,项彩虹,《基于 OGSA 的计算资源调度的一种实现》,通信学报,第 26 卷第 1A 期 2005 年 1 月 P163-166
[2]OGSA 规范, http://www.gridformun.org/ogsi-wg/drafts/GS-draft03 2002-07-17.pdf
[3]刘鹏,网格发展趋势,消华大学计算机系高性能所网格研究组, http://www.gridhome.com/grid/paperppt/GridTrend.pdf, 2003.03.02
[4] Ian Foster, Carl Kesselman,The Grid:Blueprint for a New Computing Infrastructure, Morgan Kaufmann,San Fransisco, CA, http://www.gridforum.org/,1999
[5] Global Grid Forum, http://www.globalgridforum.com/
[6]刘鹏,网格概念的界定,清华大学计算机系高性能所网格研究组, http://www.gridhome.com/grid/paperppt/GridConcept.pdf, 2003.03.02
[7]都志辉,陈渝,刘鹏,网格计算,2002,清华大学出版社出版,pp: 17-130
[8]徐志伟,李晓林,游赣梅,织女星信息网格的体系结构研究,计算机研究与发展,2002,第 39 卷第 8 期
[9]网格体系结构工作组,http://www.globalgridforum.com/5_ARCH/ GPA.htm, http://grid.lbl.gov/GPA/ExampleArchitectures.ppt
[10]Ian Foster, Carl Kessetman, A Distributed Resource Management Architecture that Supports Advance Reservations and Co-Allocation, Intl Workshop on Quality of Service,1999
[11]楼国宪,基于 OGSA 的类比生成服务的研究,浙江大学,硕士研究生论文, 2003,pp: 24 一 5
[12] Ian Foster, Carl Kesselman, Jeffrey M. Nick, Steven Tuecke, The Physiology of the Grid. An Open Grid Services Architecture for Distributed Systems Integration, Open Grid Service Infrastructure WG,Global Grid Forum, http://www.globus.org/research/papers/ogsa.pdf, Jun 22 2002,pp. 18-24
[l3]都志辉,陈渝,刘鹏等,以服务为中心的网格体系结构 OGSA,清华大学计 算 机 系 , http://hpclab.cs.tsinghua.edu.cn/~duzh/project/ogsa/ogsaintro.pdf, 2002.9.2
[14] Ian Foster, Carl Kesselman, Steven Tuecke,The Anatomy of the Grid,余浩,清华大学计算机系,2003,pp:4 一 12
[15]黄飏,李伟,徐志伟,国家高性能计算环境中的资源目录管理, http://www.gridhome.com/grid/paperppt/gct/rdmncg01.pdf, 2001.2
[16]李伟,谈恩华,Globus 项目进展和技术水平分析, http://www.gridhome.com/grid/paperppt//gct/psg2001.pdf, 2001.2.12
[17] Luis Ferreira. Bart Jacob, Scan Sievin, Globus Toolkit 3.0 Quick Start, IBM.com/redbooks,Aug 2003,pp: 5-97
[18]佚名,网格的机理:一个应用于分布式系统整合的开放式 Grid 服务体系结构, http://www.gridhome.com/grid/paperppt/GirdPhysiology,pdf, 2003
[19]柴晓路,梁字奇,Web Services 技术、架构和应用,电子工业出版社,2003, pp: 346 一 25
[20] OGSA Specification, http://www.gridforum.org/ogsi-wg/drafts/GS_ Spec_draft03_2002_07_17.pdf
[21]曾柏毅,李勇,OGSA 的 Registry Server 在小规模下的实现, http://hpclab.cs.tsinghua.edu,cn/~duzh/project/ogsa/zl-rs.doc, 2002.10.29
[22]Peng Liu, Yao Shi, Francis C.M.Lau,Cho-Li Wang,SanLiLi,Grid Demo Proposal: AntiSpamGrid, IEEE International Conference on Cluster Computing, Hong Kong,Dec 1-4 2003
[23] 刘鹏,《提出一种实用的网格实现方式-网格计算池模型》,2004
[24] 张月卓,GT3 体系结构介绍, http://www.gridhome.com/grid/papaerppt/GT3Arch.ppt,2003
[25] Borja Sotomayor, The Globus Toolkit 3 Progranunces Tutorial(Version 0.2), http:///www.casa-sotomayor.net/gt3-tutorial/, Jun 25 2003,pp. 23-97
[26] Liang-Jie Zhang,开发网格计算应用程序, htip://www-106.ibm.com/developerworks/grid/library/ws-grid/, 2003
[27] Ian Foster, Carl Kesselman, Grid Services far Distributed System Integration,肖贺,2003.3.2, pp: 4-11
[28] Ian Foster, Carl Kesselman, Globus: A Metacomputing Infrastructure Toolkit, International Journal of SupercomputerApplications, 11(2): 115-128, http://www.globus.org, 1997
[29] 刘鹏,网格应用研究现状,清华大学计算机系高性能所网格研究组, http://www.chinagrid.net/grid/paperppt/GridApplications.pdf
[30] Graham et al., Building Web Services with Java, Making Sense of XML, SOAP, WSDL, and UDDI, Sams Technical Publishing, Indianapolis, Ind., 2001
[31]刘鹏,《我国网格研究现状》,2003
[32]都志辉,《OGSA 研究设想》,2002
[33] OGSA 结构描述,http://rvww.gridforum.org/ogsi-wg/drafts,
[34]I.Foster,C.Kesselman,S.Tuecke.”The Anatomy of the Grid:Enabling Scalable Virtual Organizations” .International J.Supercomputer Applications,15(3),2001.
[35] 胡立栓,《Globus Toolkits 3 Installing on RedHat9.0——配置实验室环境下的 Gloubs 系统》,中国地质大学(北京) http://www.gridhome.com/dvnews/show.aspx?id=86&cid=17
[36] 宋莉,胡立栓,肖沣,项彩虹,《基于 OGSA 的计算资源调度的一种实现》,通信学报,第 26 卷第 1A 期 2005 年 1 月 P163-166