校园计算网格中间件的研究及应用
|
摘要
近些年来，计算网格技术在国内外的迅速发展，对计算资源的共享利用产生了巨大的推动作用。本文以建设成都理工大学校园计算网格为目标，在结合现有技术和成功案例的基础上设计了成都理工大学校园计算网格框架，为了能够快速地设计和实现一个具体校园计算网格平台，研究和开发了校园计算网格中间件，并且在校园计算网格中间件上开发了成都理工大学校园计算网格应用平台。
本文的重点研究对象是校园计算网格中间件，中间件从应用层面封装了计算网格的操作，搭建了计算网格应用与Globus Toolkit之间的桥梁。在校园计算网格中间件的设计开发过程中，提出并实现了计算网格对象、计算网格对象池、计算网格插件等一系的数据管理和业务逻辑实现的概念和规范。计算网格对象、计算网格对象池用于数据管理，使得数据的操作具有统一的模式，此外按不同的数据域创建不同的计算网格对象以及对象池，又可达到数据在一定域内的独立性。计算网格插件是完成计算网格操作的引擎，按一定的功能分块，分别实现不同的计算网格插件，不仅使得每个插件的功能相对简单和独立，而且计算网格插件可“插拔”的特性将大大地提高适应新增和扩展计算网格业务功能的能力。另外，在校园计算网格中间件的安全认证体系以及资源组织管理方面，利用“计算网格社区”这一思想进行了初步的探索和实现。
The computing grid technology is rapidly developing in domestic and foreign, and is of a huge impetus function for the computing resources sharing. This paper takes building ChengDu University of Technology (CDUT) University Computing Grid (UCGrid) as a goal. First, based on the current computing grid technology and the success case research, design the CDUT University Computing Grid framework. Second, in order to achieve the goal of the fast design and develops a concrete university computing grid platform, design and develop a middleware of university computing grid. Finally develop the CDUT UCGrid Application Platform on the middleware of UCGrid.
In this paper, the key research object is the middleware of UCGrid which has encapsulated UCGrid operations and built a bridge between the UCGrid application and Globus Toolkit. In the UCGrid middleware design process, the UCGrid object, the UCGrid object pool, the UCGrid plug-in and so on has be proposed and implemented. The UCGrid object, the UCGrid object pool uses in the data management, enables the data the operation to have the same pattern, simultaneously create the different UCGrid object and pool found the different data field so that the UCGrid data has the localization independence. The UCGrid plug-in is the engine of the UCGrid operation. Separately realizes the different UCGrid plug-in according to the certain function piecemeal. The result is not only that make each plug-in function to be independent, but also that the UCGrid plug-in "insert and pull" characteristic enhances the ability to increase and expand UCGrid function. Moreover, as the aspect in the university grid middleware security authentication system as well as the resources organization, "computing grid community" theory has carried on the preliminary exploration and the realization.
本文的重点研究对象是校园计算网格中间件，中间件从应用层面封装了计算网格的操作，搭建了计算网格应用与Globus Toolkit之间的桥梁。在校园计算网格中间件的设计开发过程中，提出并实现了计算网格对象、计算网格对象池、计算网格插件等一系的数据管理和业务逻辑实现的概念和规范。计算网格对象、计算网格对象池用于数据管理，使得数据的操作具有统一的模式，此外按不同的数据域创建不同的计算网格对象以及对象池，又可达到数据在一定域内的独立性。计算网格插件是完成计算网格操作的引擎，按一定的功能分块，分别实现不同的计算网格插件，不仅使得每个插件的功能相对简单和独立，而且计算网格插件可“插拔”的特性将大大地提高适应新增和扩展计算网格业务功能的能力。另外，在校园计算网格中间件的安全认证体系以及资源组织管理方面，利用“计算网格社区”这一思想进行了初步的探索和实现。
The computing grid technology is rapidly developing in domestic and foreign, and is of a huge impetus function for the computing resources sharing. This paper takes building ChengDu University of Technology (CDUT) University Computing Grid (UCGrid) as a goal. First, based on the current computing grid technology and the success case research, design the CDUT University Computing Grid framework. Second, in order to achieve the goal of the fast design and develops a concrete university computing grid platform, design and develop a middleware of university computing grid. Finally develop the CDUT UCGrid Application Platform on the middleware of UCGrid.
In this paper, the key research object is the middleware of UCGrid which has encapsulated UCGrid operations and built a bridge between the UCGrid application and Globus Toolkit. In the UCGrid middleware design process, the UCGrid object, the UCGrid object pool, the UCGrid plug-in and so on has be proposed and implemented. The UCGrid object, the UCGrid object pool uses in the data management, enables the data the operation to have the same pattern, simultaneously create the different UCGrid object and pool found the different data field so that the UCGrid data has the localization independence. The UCGrid plug-in is the engine of the UCGrid operation. Separately realizes the different UCGrid plug-in according to the certain function piecemeal. The result is not only that make each plug-in function to be independent, but also that the UCGrid plug-in "insert and pull" characteristic enhances the ability to increase and expand UCGrid function. Moreover, as the aspect in the university grid middleware security authentication system as well as the resources organization, "computing grid community" theory has carried on the preliminary exploration and the realization.
引文
[1] 都志辉，陈渝，刘鹏．网格计算[M]北京：清华大学出版社，2002
[2] http://www.globus.org/
[3] 中国网格信息中转站．http://www.chinagrid.net
[4] 罗省贤，何大可．基于MPI的网络并行计算环境及应用[M]．成都：西南交通大学出版社，2001．
[5] Bruce Eckel著Java编程思想[M]北京：机械工业出版社，1999
[6] Borja Sotomayor. The Globus Toolkit 4 Programmer's Tutorial Univeristy of Chicago Department of Computer Science
[7] Bil Lewis，Daniel J．Berg著 深入学习：Java多线程编程[M]北京：电子工业出版社．2000
[8] IBM red Books:Enabling Applications for Grid Computing with Globus
[9] JamesW．Cooper编．Java设计模式[M]．北京：机械工业出版社，2000．
[10] Rod Johnson等著．Spring框架高级编程[M]．北京：机械工业出版社，2006
[11] 罗时飞编著．精通Spring[M]．北京：电子工业出版社，2005．
[12] Robetr C．Martin著．UML：Java程序员指南：双语版[M]．北京：清华大学出版社，2004．
[13] Joseph Schmuller著．UML基础、案例与应用[M]．北京：人民邮电出版社，2004．
[14] 樊富有．校园计算网格模型研究及UCGrid管理系统的实现(硕士学位论文)[D]．成都
[15] 段林涛．校园计算网格建设与管理研究(硕士学位论文)[D]．成都
[16] 谌俐利．高性能计算环境下的数据管理和传输服务研究(硕士学位论文)[D]．成都
[17] Didier Martin等著．XML高级编程．北京：机械工业出版社，2001．1．
[18] Tom Myers,Alexander Nakhimovsky著．Java XML编程指南[M]．北京：电子工业出版社，2001．4．
[19] Simon Brown,Sam Dalton,Dan Jepp等著．JSP编程指南[M]．北京：电子工业出版社，2004．
[20] Vivek Chopra，Jon Eaves，Rupert Jones等著．JSP高级程序设计[M]．北京：人民邮电出版社．2006
[21] http://gridengine.sunsource.net/
[22] http://www.sun.com/software/gridware/
[23] http://www-128. ibm.com/developerworks/cn/grid/gr-wsgram/index.html
[24] http://www-128.ibm.com/developerworks/cn/grid/gr-mdsgt4/
[25] http://www-128.ibm. com/developerworks/cn/grid/gr-gt4mds/index.html?ca=dwcn-newsletter-grid#main
[26] http://www.globus.org/mail_archive/discuss/2005/O7/msg00090.html
[27] http://www.dcs.shef.ac.uk/support/sge-doc/
[28] http://www-128.ibm.com/developerworks/cn/views/grid/tutorials.jsp
[29] http://jakarta.apache.org/commons/pool/
[30] http://www. yesky.com/imagesnew /software/spring/index.html
[31] 徐志伟，冯百明，李伟编著．网格计算技术[M]．北京：电子工业出版社，2004
[32] 福斯特编著．网格计算：第二版[M]．北京：电子工业出版社，2004
[33] Bil Lewis，Daniel J．Berg著 深入学习Java多线程编程[M] 北京：电子工业出版社，2000
[34] 张龙祥．UML与系统分析设计[M] 北京：人民邮电出版社2001
[35] Bruce E．Wampler著Java与UML面向对象程序设计[M] 北京：人民邮电出版社，2002
[36] I. Foster, C. Kesselman, etc. The Grid: Blueprint for a New Computing Infrastructure USA: Morgan Kaufmann Publishers, 1999
[37] Borja Sotomayor. The Globus Toolkit 4 Programmer's Tutorial Univeristy of Chicago Department of Computer Science,
[38] IBM red Books: Enabling Applications for Grid Computing with Globus
[39] Jarek Gawor, Sam Meder. GT4 WS Java Core Design. May 24, 2004
[40] 网格基础知识介绍. http://www-900.ibm.com/cn/support/faqhtmlfaq/2690004C23000.htm.
[41] mcs.anl.gov. MDS4 and Project Deplyments. July 28, 2005
[42] Ben Clifford. Globus Monitoring and Discovery. The Globus Alliance
[43] Jennifer M. Schopf. Distributed Monitoring and Information Services for the Grid. Argonne National Laboratory. Sept 30, 2005
[44] (美)Maozhen Li，(美)Mark Baker著 网格计算核心技术[M]．北京：清华大学出版社，2006
[45] Bogdan Lobodzinski, Krzysztof Wilk, Pawel Plaszczak. Globus Toolkit 4-Sun Grid Engine 6.0(update 3) Interface: description. Gridwise Technologies, March/April 2005
[46] Hans Bergsten. JavaServer Pages[M]. O'Reilly.2003
[47] 陈刚编著．Eclipse从入门到精通．北京：清华大学出版社，2006
[48] Java CoG Kit. http://www-unix.globus.org/cog/java
[49] Terry Sloan. GridFTP Report. http://www.epcc.ed.ac.uk/sungrid/PUB/D1_5_3-GridFTP.pdf.
[50] http://www.casa-sotomayor.net/gt4-tutorial/
[2] http://www.globus.org/
[3] 中国网格信息中转站．http://www.chinagrid.net
[4] 罗省贤，何大可．基于MPI的网络并行计算环境及应用[M]．成都：西南交通大学出版社，2001．
[5] Bruce Eckel著Java编程思想[M]北京：机械工业出版社，1999
[6] Borja Sotomayor. The Globus Toolkit 4 Programmer's Tutorial Univeristy of Chicago Department of Computer Science
[7] Bil Lewis，Daniel J．Berg著 深入学习：Java多线程编程[M]北京：电子工业出版社．2000
[8] IBM red Books:Enabling Applications for Grid Computing with Globus
[9] JamesW．Cooper编．Java设计模式[M]．北京：机械工业出版社，2000．
[10] Rod Johnson等著．Spring框架高级编程[M]．北京：机械工业出版社，2006
[11] 罗时飞编著．精通Spring[M]．北京：电子工业出版社，2005．
[12] Robetr C．Martin著．UML：Java程序员指南：双语版[M]．北京：清华大学出版社，2004．
[13] Joseph Schmuller著．UML基础、案例与应用[M]．北京：人民邮电出版社，2004．
[14] 樊富有．校园计算网格模型研究及UCGrid管理系统的实现(硕士学位论文)[D]．成都
[15] 段林涛．校园计算网格建设与管理研究(硕士学位论文)[D]．成都
[16] 谌俐利．高性能计算环境下的数据管理和传输服务研究(硕士学位论文)[D]．成都
[17] Didier Martin等著．XML高级编程．北京：机械工业出版社，2001．1．
[18] Tom Myers,Alexander Nakhimovsky著．Java XML编程指南[M]．北京：电子工业出版社，2001．4．
[19] Simon Brown,Sam Dalton,Dan Jepp等著．JSP编程指南[M]．北京：电子工业出版社，2004．
[20] Vivek Chopra，Jon Eaves，Rupert Jones等著．JSP高级程序设计[M]．北京：人民邮电出版社．2006
[21] http://gridengine.sunsource.net/
[22] http://www.sun.com/software/gridware/
[23] http://www-128. ibm.com/developerworks/cn/grid/gr-wsgram/index.html
[24] http://www-128.ibm.com/developerworks/cn/grid/gr-mdsgt4/
[25] http://www-128.ibm. com/developerworks/cn/grid/gr-gt4mds/index.html?ca=dwcn-newsletter-grid#main
[26] http://www.globus.org/mail_archive/discuss/2005/O7/msg00090.html
[27] http://www.dcs.shef.ac.uk/support/sge-doc/
[28] http://www-128.ibm.com/developerworks/cn/views/grid/tutorials.jsp
[29] http://jakarta.apache.org/commons/pool/
[30] http://www. yesky.com/imagesnew /software/spring/index.html
[31] 徐志伟，冯百明，李伟编著．网格计算技术[M]．北京：电子工业出版社，2004
[32] 福斯特编著．网格计算：第二版[M]．北京：电子工业出版社，2004
[33] Bil Lewis，Daniel J．Berg著 深入学习Java多线程编程[M] 北京：电子工业出版社，2000
[34] 张龙祥．UML与系统分析设计[M] 北京：人民邮电出版社2001
[35] Bruce E．Wampler著Java与UML面向对象程序设计[M] 北京：人民邮电出版社，2002
[36] I. Foster, C. Kesselman, etc. The Grid: Blueprint for a New Computing Infrastructure USA: Morgan Kaufmann Publishers, 1999
[37] Borja Sotomayor. The Globus Toolkit 4 Programmer's Tutorial Univeristy of Chicago Department of Computer Science,
[38] IBM red Books: Enabling Applications for Grid Computing with Globus
[39] Jarek Gawor, Sam Meder. GT4 WS Java Core Design. May 24, 2004
[40] 网格基础知识介绍. http://www-900.ibm.com/cn/support/faqhtmlfaq/2690004C23000.htm.
[41] mcs.anl.gov. MDS4 and Project Deplyments. July 28, 2005
[42] Ben Clifford. Globus Monitoring and Discovery. The Globus Alliance
[43] Jennifer M. Schopf. Distributed Monitoring and Information Services for the Grid. Argonne National Laboratory. Sept 30, 2005
[44] (美)Maozhen Li，(美)Mark Baker著 网格计算核心技术[M]．北京：清华大学出版社，2006
[45] Bogdan Lobodzinski, Krzysztof Wilk, Pawel Plaszczak. Globus Toolkit 4-Sun Grid Engine 6.0(update 3) Interface: description. Gridwise Technologies, March/April 2005
[46] Hans Bergsten. JavaServer Pages[M]. O'Reilly.2003
[47] 陈刚编著．Eclipse从入门到精通．北京：清华大学出版社，2006
[48] Java CoG Kit. http://www-unix.globus.org/cog/java
[49] Terry Sloan. GridFTP Report. http://www.epcc.ed.ac.uk/sungrid/PUB/D1_5_3-GridFTP.pdf.
[50] http://www.casa-sotomayor.net/gt4-tutorial/