校园计算网格分布式中间件的研究与实现
|
摘要
随着网格技术的发展,以整合计算资源为目标的计算网格在国内外迅速发展。本文以建设成都理工大学校园计算网格为目标,结合现有技术和成都理工大学校园计算网格UCGRID 2.0的技术框架,提出了基于分布式中间件的校园计算网格框架,制定了计算网格分布式中间件协议,研究和开发了校园计算网格分布式中间件CGDM(Computing Grid Distribute Middleware),并且在校园计算网格分布式中间件上开发了跨越多个异构资源网格的成都理工大学校园计算网格应用平台。
本文的重点研究对象是校园计算网格分布式中间件,中间件以成都理工大学校园计算网格UCGRID 2.0中间件为核心,实现了计算网格中间件的分布式特性和统一门户接口。在CGDM的设计过程中,首先研究提出了以计算网格分布式中间件为核心的计算网格框架体系,然后根据目标需求提出了计算网格分布式中间件协议和统一门户接口规范,实现了计算网格分布式中间件通信组件和计算网格统一门户接口。通信组件由消息预处理器、对象封装器、协议处理引擎和消息封装器组成。消息预处理器实现对协议消息的分析;对象封装器根据消息与处理器的分析结果按计算网格中间件对象池规范封装、管理对象;协议处理引擎按计算网格中间件插件规范实现,负责处理协议请求业务逻辑;消息封装器负责将计算网格对象映射为协议参数对象。在通信组件的实现中充分利用了JAVA反射机制,实现了动态解析协议处理对象的内部结构,使协议通信组件的消息处理具有较高的灵活性和延展性。计算网格门户统一接口按计算网格业务逻辑单元封装为业务逻辑组件,并按统一接口标准封装,既能为上层提供跨平台、跨编程语言的统一接口,又能为上层重组、开发新的业务逻辑,实现服务聚合和其它应用程序的整合,为计算网格应用提供快速二次开发接口。
Accompanying development of grid computing technology, the computing gird is rapidly developing in domestic and foreign. This paper takes building ChengDu University of Technology(CDUT) University Computing Grid(UCGRID) as a goal, combining new technology with the framework of UCGRID 2.0, design a new computing grid framework based on the computing grid distribute middleware, formulation of computing grid distribute middleware protocol, develop the computing grid distributed middleware. Finally realized the CDUT UCGRID Application Platform based on the computing grid distributed middleware.
In this paper, the key research object is the computing grid distributed middleware (CGDM). The CGDM takes UCGRID 2.0's middleware as core, realize the distribution feature of the computing grid middleware and uniform interface of grid portal. In the developing of computing grid distributed middleware, as first, design the framework of computing grid based on the CGDM, then design computing grid distributed middleware protocol and the standard of uniform interface of grid portal. Finally, realize the computing grid distribute middleware communication component and uniform interface of CGDM. The communication component has four modules: the message pre-process module, the object encapsulation module, the protocol process engine module and the message encapsulation module. The message pre-process module analyzes the protocol message; The object encapsulation module encapsulates the operation data into object. The protocol process engine module handles business logic; the message encapsulation transforms the computing grid object to protocol message object.
本文的重点研究对象是校园计算网格分布式中间件,中间件以成都理工大学校园计算网格UCGRID 2.0中间件为核心,实现了计算网格中间件的分布式特性和统一门户接口。在CGDM的设计过程中,首先研究提出了以计算网格分布式中间件为核心的计算网格框架体系,然后根据目标需求提出了计算网格分布式中间件协议和统一门户接口规范,实现了计算网格分布式中间件通信组件和计算网格统一门户接口。通信组件由消息预处理器、对象封装器、协议处理引擎和消息封装器组成。消息预处理器实现对协议消息的分析;对象封装器根据消息与处理器的分析结果按计算网格中间件对象池规范封装、管理对象;协议处理引擎按计算网格中间件插件规范实现,负责处理协议请求业务逻辑;消息封装器负责将计算网格对象映射为协议参数对象。在通信组件的实现中充分利用了JAVA反射机制,实现了动态解析协议处理对象的内部结构,使协议通信组件的消息处理具有较高的灵活性和延展性。计算网格门户统一接口按计算网格业务逻辑单元封装为业务逻辑组件,并按统一接口标准封装,既能为上层提供跨平台、跨编程语言的统一接口,又能为上层重组、开发新的业务逻辑,实现服务聚合和其它应用程序的整合,为计算网格应用提供快速二次开发接口。
Accompanying development of grid computing technology, the computing gird is rapidly developing in domestic and foreign. This paper takes building ChengDu University of Technology(CDUT) University Computing Grid(UCGRID) as a goal, combining new technology with the framework of UCGRID 2.0, design a new computing grid framework based on the computing grid distribute middleware, formulation of computing grid distribute middleware protocol, develop the computing grid distributed middleware. Finally realized the CDUT UCGRID Application Platform based on the computing grid distributed middleware.
In this paper, the key research object is the computing grid distributed middleware (CGDM). The CGDM takes UCGRID 2.0's middleware as core, realize the distribution feature of the computing grid middleware and uniform interface of grid portal. In the developing of computing grid distributed middleware, as first, design the framework of computing grid based on the CGDM, then design computing grid distributed middleware protocol and the standard of uniform interface of grid portal. Finally, realize the computing grid distribute middleware communication component and uniform interface of CGDM. The communication component has four modules: the message pre-process module, the object encapsulation module, the protocol process engine module and the message encapsulation module. The message pre-process module analyzes the protocol message; The object encapsulation module encapsulates the operation data into object. The protocol process engine module handles business logic; the message encapsulation transforms the computing grid object to protocol message object.
引文
[1]http://www-128.ibm.com/developerworks/cn/grid/gr-gt4/
[2]http://xfire.codehaus.org
[3]http://www.globus.org/
[4]罗省贤,何大可.基于MPI的网络并行计算环境及应用[M].成都:西南交通大学出版社,2001.
[5]Bruce Eckel著Java编程思想[M]北京:机械工业出版社,1999
[6]Borja Sotomayor.The Globus Toolkit 4 Programmer's Tutorial Univeristy of Chicago Department of Computer Science
[7]Bil Lewis,Daniel J.Berg著 深入学习:Java多线程编程[M]北京:电子工业出版社,2000
[8]www.digimmersion.com Flex Application Design for Cairngorm.
[9]James W.Cooper编.Java设计模式[M].北京:机械工业出版社,2000.
[10]Rod Johnson等著.Spring框架高级编程[M].北京:机械工业出版社,2006
[11]DSL Forum CPE WAN Management Protocol.
[12]Robetr C.Martin著.UML:Java程序员指南:双语版[M].北京:清华大学出版社,2004.
[13]Joseph Schmuller著.UML基础、案例与应用[M].北京:人民邮电出版社,2004.
[14]樊富有.校园计算网格模型研究及UCGrid管理系统的实现(硕士学位论文)[D].成都
[15]段林涛.校园计算网格建设与管理研究(硕士学位论文)[D].成都
[16]范胜波.校园计算网格中间件的研究与应用(硕士学位论文)[D].成都
[17]Didier Martin等著.XML高级编程.北京:机械工业出版社,2001.1.
[18]Tom Myers,Alexander Nakhimovsky著.Java XML编程指南[M].北京:电子工业出版社,2001.4.
[19]Simon Brown,Sam Dalton,Dan Jepp等著.JSP编程指南[M].北京:电子工业出版社,2004.
[20]Vivek Chopra,Jon Eaves,Rupert Jones等著.JSP高级程序设计[M].北京:人民邮电出版社,2006
[21]http://gridengine.sunsource.net/
[22]http://www.sun.com/software/gridware/
[23]http://www-128.ibm.com/developerworks/cn/grid/gr-wsgram/index.html
[24]http://www-128.ibm.com/developerworks/cn/grid/gr-mdsgt4/
[25]http://www-128.ibm.com/developerworks/cn/grid/gr-gt4mds/index.htmi?ca=dwcn-newsle tter-grid#main
[26]http://www.globus.org/mail_archive/discuss/2005/07/msgOOO90.html
[27]http://www.dcs.shef.ac.uk/support/sge-doc/
[28]http://www-128.ibm.com/developerworks/cn/views/grid/tutorials.jsp
[29]http://jakarta.apache.org/commons/pool/
[30]http://www.yesky.com/imagesnew/software/spring/index.html
[31]徐志伟,冯百明,李伟编著.网格计算技术[M].北京:电子工业出版社,2004
[32]福斯特编著.网格计算:第二版[M].北京:电子工业出版社,2004
[33]Bil Lewis,Daniel J.Berg著深入学习Java多线程编程[M]北京:电子工业出版社,2000
[34]张龙祥.UML与系统分析设计[M]北京:人民邮电出版社2001
[35]Bruce E.Wampler著Java与UML面向对象程序设计[M]北京:人民邮电出版社,2002
[36]I.Foster,C.Kesselman,etc.The Grid:Blueprint for a New Computing Infrastructure USA:Morgan Kaufmann Publishers,1999
[37]Borja Sotomayor.The Globus Toolkit 4 Programmer's Tutorial Univeristy of Chicago Department of Computer Science,
[38]IBM red Books:Enabling Applications for Grid Computing with Globus
[39]Jarek Gawor,Sam Meder.GT4 WS Java Core Design.May 24,2004
[40]网格基础知识介绍.http://www-900.ibm.com/cn/support/faqhtmlfaq/2690004C23000.h tm.
[41]mcs.anl.gov.MDS4 and Project Deplyments.July 28,2005
[42]Ben Clifford.Globus Monitoring and Discovery.The Globus Alliance
[43]Jennifer M.Schopf.Distributed Monitoring and Information Services for the Grid.Argonne National Laboratory.Sept 30,2005
[44](美)Maozhen Li,(美)Mark Baker著 网格计算核心技术[M].北京:清华大学出版社,2006
[45]Bogdan Lobodzinski,Krzysztof Wilk,Pawel Plaszczak.Globus Toolkit 4-Sun Grid Engine 6.0(update 3)Interface:description.Gridwise Technologies,March/April 2005
[46]Hans Bergsten.JavaServer Pages[M].O'Reilly.2003
[47]陈刚编著.Eclipse从入门到精通.北京:清华大学出版社,2006
[48]Java CoG Kit.http://www-unix.globus.org/cog/java
[49]Terry Sloan.GridFTP Report.http://www.epcc.ed.ac.uk/sungrid/PUB/D1_5_3-GridFT P.pdf.
[50]http://www.casa-sotomayor.net/gt4-tutorial/
[2]http://xfire.codehaus.org
[3]http://www.globus.org/
[4]罗省贤,何大可.基于MPI的网络并行计算环境及应用[M].成都:西南交通大学出版社,2001.
[5]Bruce Eckel著Java编程思想[M]北京:机械工业出版社,1999
[6]Borja Sotomayor.The Globus Toolkit 4 Programmer's Tutorial Univeristy of Chicago Department of Computer Science
[7]Bil Lewis,Daniel J.Berg著 深入学习:Java多线程编程[M]北京:电子工业出版社,2000
[8]www.digimmersion.com Flex Application Design for Cairngorm.
[9]James W.Cooper编.Java设计模式[M].北京:机械工业出版社,2000.
[10]Rod Johnson等著.Spring框架高级编程[M].北京:机械工业出版社,2006
[11]DSL Forum CPE WAN Management Protocol.
[12]Robetr C.Martin著.UML:Java程序员指南:双语版[M].北京:清华大学出版社,2004.
[13]Joseph Schmuller著.UML基础、案例与应用[M].北京:人民邮电出版社,2004.
[14]樊富有.校园计算网格模型研究及UCGrid管理系统的实现(硕士学位论文)[D].成都
[15]段林涛.校园计算网格建设与管理研究(硕士学位论文)[D].成都
[16]范胜波.校园计算网格中间件的研究与应用(硕士学位论文)[D].成都
[17]Didier Martin等著.XML高级编程.北京:机械工业出版社,2001.1.
[18]Tom Myers,Alexander Nakhimovsky著.Java XML编程指南[M].北京:电子工业出版社,2001.4.
[19]Simon Brown,Sam Dalton,Dan Jepp等著.JSP编程指南[M].北京:电子工业出版社,2004.
[20]Vivek Chopra,Jon Eaves,Rupert Jones等著.JSP高级程序设计[M].北京:人民邮电出版社,2006
[21]http://gridengine.sunsource.net/
[22]http://www.sun.com/software/gridware/
[23]http://www-128.ibm.com/developerworks/cn/grid/gr-wsgram/index.html
[24]http://www-128.ibm.com/developerworks/cn/grid/gr-mdsgt4/
[25]http://www-128.ibm.com/developerworks/cn/grid/gr-gt4mds/index.htmi?ca=dwcn-newsle tter-grid#main
[26]http://www.globus.org/mail_archive/discuss/2005/07/msgOOO90.html
[27]http://www.dcs.shef.ac.uk/support/sge-doc/
[28]http://www-128.ibm.com/developerworks/cn/views/grid/tutorials.jsp
[29]http://jakarta.apache.org/commons/pool/
[30]http://www.yesky.com/imagesnew/software/spring/index.html
[31]徐志伟,冯百明,李伟编著.网格计算技术[M].北京:电子工业出版社,2004
[32]福斯特编著.网格计算:第二版[M].北京:电子工业出版社,2004
[33]Bil Lewis,Daniel J.Berg著深入学习Java多线程编程[M]北京:电子工业出版社,2000
[34]张龙祥.UML与系统分析设计[M]北京:人民邮电出版社2001
[35]Bruce E.Wampler著Java与UML面向对象程序设计[M]北京:人民邮电出版社,2002
[36]I.Foster,C.Kesselman,etc.The Grid:Blueprint for a New Computing Infrastructure USA:Morgan Kaufmann Publishers,1999
[37]Borja Sotomayor.The Globus Toolkit 4 Programmer's Tutorial Univeristy of Chicago Department of Computer Science,
[38]IBM red Books:Enabling Applications for Grid Computing with Globus
[39]Jarek Gawor,Sam Meder.GT4 WS Java Core Design.May 24,2004
[40]网格基础知识介绍.http://www-900.ibm.com/cn/support/faqhtmlfaq/2690004C23000.h tm.
[41]mcs.anl.gov.MDS4 and Project Deplyments.July 28,2005
[42]Ben Clifford.Globus Monitoring and Discovery.The Globus Alliance
[43]Jennifer M.Schopf.Distributed Monitoring and Information Services for the Grid.Argonne National Laboratory.Sept 30,2005
[44](美)Maozhen Li,(美)Mark Baker著 网格计算核心技术[M].北京:清华大学出版社,2006
[45]Bogdan Lobodzinski,Krzysztof Wilk,Pawel Plaszczak.Globus Toolkit 4-Sun Grid Engine 6.0(update 3)Interface:description.Gridwise Technologies,March/April 2005
[46]Hans Bergsten.JavaServer Pages[M].O'Reilly.2003
[47]陈刚编著.Eclipse从入门到精通.北京:清华大学出版社,2006
[48]Java CoG Kit.http://www-unix.globus.org/cog/java
[49]Terry Sloan.GridFTP Report.http://www.epcc.ed.ac.uk/sungrid/PUB/D1_5_3-GridFT P.pdf.
[50]http://www.casa-sotomayor.net/gt4-tutorial/