基于Glubos的网格应用关键技术研究
|
摘要
随着第三次互联网浪潮的到来，“即取即用”的网络应用模式成为资源共享的发展趋势。网格不是因特网的一种新名词，它并不是要抛弃和完全取代因特网。它将建筑在因特网的基础之上，不过比当前的因特网性能更高、功能更强、应用更广。
网格在产生的初期主要集中在高性能科学和工程计算领域中，但随着网格研究的不断发展，网格的应用领域不断地扩大，出现了适用于不同应用领域的网格技术，直接服务于生产和各种商业活动。此时，如何恰当地利用现有工具和技术，更好地实现网格应用变得越来越重要了，这也是本课题希望达到的目的。
论文通过对网格体系结构OGSA以及网格支撑平台Globus的分析和研究，探讨了实现网格应用的一些关键性技术。具体在以下几个方面做了一些工作：
(1) 揭示网格及网格计算深层涵义，介绍网格的国内外研究和发展现状；
(2) 研究和分析通用的网格体系结构(五层沙漏结构和开放网格服务体系结构OGSA)；
(3) 研究和分析Globus项目及其Globus支撑平台(也称Gloubs工具包)，并就Globus平台上一些应用开发工具进行了简单介绍；
(4) 研究和分析在OGSA体系结构和Globus平台基础上，实现网格应用的关键性技术；并以XPort为例，对网格在分布式仪器系统中的应用开发做了实例的探讨和分析。
最后，希望该论文能起到“抛砖引玉”作用，促进我国网格计算的发展。
With the third tide of the Internet, application based on GRID technology has become a tendency of resource share domain. GRID is not a new word for Internet, neither is it mean to abandon or replace Internet. It is based on the Internet with higher quality and stronger function and wider user.
GRID mainly concentrates on high-performance science and engineering calculation field when it initially produces. But with the rapid development of studying GRID, the application of GRID is expanding constantly. GRID technology which is suitable for different applications has appeared, and it has already served production and various kinds of business activities directly. Now, how to utilize existing tools and technology appropriately, and make the best of realizing GRID application becomes more and more important, and this is the purpose that this subject hopes to achieve too.
Through studying and analyzing the GRID architecture -OGSA and the supporting platform - Globus, the paper have probed into some key technology of realizing GRID application. I have done some concrete jobs in the following respects :
(1) Explain and define the deep meaning of GRID and GRID Computing, and introduce the domestic and international current research and development situation of GRID;
(2) Study and analyse the universal GRID architecture (the Five Sand Filter Structure and the Open GRID Service Architecture OGSA);
(3) Study and analyse the Globus project and the Globus platform (or called Globus toolkits ), and carry on a simple introduction on some applied development tools that base on the Globus platform;
(4) Study and analyse the key technology of GRID application on the basis of the OGSA structure and the Globus platform; And take XPort as an example , make the discussion and analysis of the instance to the GRID application in the distributed instrument system.
Finally, I hope this paper can play a "casting a brick to attract jade" role , and promotes the development of GRID application in our country.
网格在产生的初期主要集中在高性能科学和工程计算领域中，但随着网格研究的不断发展，网格的应用领域不断地扩大，出现了适用于不同应用领域的网格技术，直接服务于生产和各种商业活动。此时，如何恰当地利用现有工具和技术，更好地实现网格应用变得越来越重要了，这也是本课题希望达到的目的。
论文通过对网格体系结构OGSA以及网格支撑平台Globus的分析和研究，探讨了实现网格应用的一些关键性技术。具体在以下几个方面做了一些工作：
(1) 揭示网格及网格计算深层涵义，介绍网格的国内外研究和发展现状；
(2) 研究和分析通用的网格体系结构(五层沙漏结构和开放网格服务体系结构OGSA)；
(3) 研究和分析Globus项目及其Globus支撑平台(也称Gloubs工具包)，并就Globus平台上一些应用开发工具进行了简单介绍；
(4) 研究和分析在OGSA体系结构和Globus平台基础上，实现网格应用的关键性技术；并以XPort为例，对网格在分布式仪器系统中的应用开发做了实例的探讨和分析。
最后，希望该论文能起到“抛砖引玉”作用，促进我国网格计算的发展。
With the third tide of the Internet, application based on GRID technology has become a tendency of resource share domain. GRID is not a new word for Internet, neither is it mean to abandon or replace Internet. It is based on the Internet with higher quality and stronger function and wider user.
GRID mainly concentrates on high-performance science and engineering calculation field when it initially produces. But with the rapid development of studying GRID, the application of GRID is expanding constantly. GRID technology which is suitable for different applications has appeared, and it has already served production and various kinds of business activities directly. Now, how to utilize existing tools and technology appropriately, and make the best of realizing GRID application becomes more and more important, and this is the purpose that this subject hopes to achieve too.
Through studying and analyzing the GRID architecture -OGSA and the supporting platform - Globus, the paper have probed into some key technology of realizing GRID application. I have done some concrete jobs in the following respects :
(1) Explain and define the deep meaning of GRID and GRID Computing, and introduce the domestic and international current research and development situation of GRID;
(2) Study and analyse the universal GRID architecture (the Five Sand Filter Structure and the Open GRID Service Architecture OGSA);
(3) Study and analyse the Globus project and the Globus platform (or called Globus toolkits ), and carry on a simple introduction on some applied development tools that base on the Globus platform;
(4) Study and analyse the key technology of GRID application on the basis of the OGSA structure and the Globus platform; And take XPort as an example , make the discussion and analysis of the instance to the GRID application in the distributed instrument system.
Finally, I hope this paper can play a "casting a brick to attract jade" role , and promotes the development of GRID application in our country.
引文
[1] I-WAY ProjectBhttp://www.iway. org/. http://archive, ncsa. uiuc. edu/General/Training/SC95/I-WAY. nextgen. html.
[2] Foster作的演讲稿, http://www-fp, mcs. anl. gov/~foster/Talks/WWWGridsMay2002, ppt.
[3] Chinese NHPCE Project, http://www. grid. ac. cn.
[4] Chinese ACI of MOE Project, http://aci. cs. tsinghua. edu. cn. http://www. hpclab, shu. edu. cn
[5] 徐志伟；因特网涅果—正在浮现的网格技术[N]．计算机世界，2001，(43)．
[6] I. Foster and C. Kesselman; "The Grid: Blueprint for a New Computing Infrastructure" San Francisco, CA: Morgan Kaufmann, 1999. http://mkp, com/grids, http://www.gridforum. org/, http://www.ccgrid. org/.
[7] 刘鹏，《网格概念的界定》清华大学计算机系高性能所网格研究组http://www.gridhome. com
[8] 任建武，《GRID GIS关键技术研究》南京师范大学博士学位论文2003．5．
[9] 网格研究，中国网格：http://www. chinagrid. com.
[10] 刘鹏，《网格的发展趋势》 清华大学计算机系高性能所网格研究组http://www. gridhome. com
[11] M. J. Litzkow, M. Livny, and M.W. Mutka; "Condor-A hunter of idle workstations", 8th International Conference on Distributed Computing Systems, 1988, pp. 104-111. http://www.cs. wisc. edu/condor/
[12] 徐志伟，李伟．织女星网格的体系结构研究[J]．计算机研究与发展，2002，39(8)：923—929．
[13] I. Foster, C. Kesselman, S. Tuecke. "The Anatomy of the Grid: Enabling Scalable Virtual Organizations". International J. Supercomputer Applications, 15(3), 2001.
[14] I. Foster, C. Kesselman, J. Nick, S. Tuecke; "The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration". January, 2002. http://www. Globus. org/research/papers/ogsa, pdf
[15] Ashton Applewhite, "Getting the grid" . IEEE distributed system online. 2002.
[16]．柴晓路，梁宇奇：《WebServices技术、架构和应用》北京：电子工业出版社，2003，1．
[17] OGSA结构描述，http://www. Globus. org/ogsa/http://www. gridforum. org/ogsi-wg/drafts/ogsa_draft2.9_2002-06-22. pdf,
[18] Foster Ian Carl Kesselman Jeffrey M. Nick Steven Tueck著，肖贺译，《基于综合分布系统的网格服务》清华大学计算机系 2003．3．2 http://www. gridhome. com
[19] J. Nieplocha and R. Harrison, Shared memory NUMA programming on the I-WAY, in Proc. Sth IEEE Symp. on High Performance Distributed Computing, IEEE Computer Society Press, 1996, pp. 432-441.
[20] M. Norman et at., Galaxies collide on the I-WAY: An example of heterogeneous wide-area collaborative supercomputing, International Journal of Supercomputer Applications, 10 (1996), pp. 131-140.
[21] I. Foster, J. Geisler, and S. Tuecke, MPI on the I-WAY: A wide-area, multimethod implementation of the Message Passing Interface, in Proceedings of the 1996 MPI Developers Conference, IEEE Computer Society Press, 1996, pp. 10-17.
[22] I. Foster, C. Kesselman; The Globus Project: A Status Report, In Proc. IPPS/SPDP '98 Heterogeneous ComputingWorkshop, pp. 4-18, 1998.
[23] 单久龙 陈国良, "Grid Society: A System View of Grid and P2P Environment" accepted by GCC2002 workshop, 2002.10
[24] I. Foster, C. Kesselman. Globus: A Metacomputing Infrastructure Toolkit. Intl J. Supercomputer Applications, 11(2):115-128, 1997.
[25] http://www. globus. org
[26] 都志辉，陈渝，刘鹏，《网格计算》[M]清华大学出版社2002(181)
[27] G. von Laszewski, I. Foster, J. Gawor, W. Smith, and S. Tuecke. CoG Kits: A Bridge between Commodity Distributed Computing and High-Performance Grids. ACM 2000 Java Grande Conference, 2000.
[28] S. Brunett, K. Czajkowski, S. Fitzgerald, I. Foster, A. Johnson, C. Kesselman, J. Leigh, S. Tuecke. Application Experiences with the Globus Toolkit. To appear in 7th IEEE Symp. on High Performance Distributed Computing, July 1998.
[29] G. von Laszewski, I. Foster. Grid Infrastructure to Support Science Portals for Large Scale Instruments. Proc. of the Workshop Distributed Computing on the Web (DCW), 1999.
[30] 桂小林，钱德沛《基于Internet的网格计算模型研究》西安交通大学学报2001年10月第35卷第10期：1008-1011
[31] 都志辉，李三立，陈渝，刘鹏，黄震春，何川，方兴；网格计算及其原型实现研究[J] 计算机科学，2002，29(8)：1—5
[32] 应宏，网络应用计算模型的演变与发展[J]．计算机系统应用，2003，16(3)：76—79．
[33] 王育峰，杨寿保《网格计算系统研究及发展方向》计算机科学 2002．6第29卷第6期，pp16-18
[34] 王育峰，杨寿保，赵晓春，陈昕，"Research on Security Architecture and Security Policy of Grid System" accepted by GCC2002 workshop, 2002.10
[35] 刘鹏，《网格应用现状与分析——从应用看网格》中国网格信息中转站2003年10月http://www. chinagird. net/
[36] Gabrielle Allen, Thomas Dramlitsch, Ian Foster, Nick Karonis, Matei Ripeanu, Ed Seidel, Brian Toonen. "Supporting Efficient Execution in Heterogeneous Distributed Computing Environments with Cactus and Globus" Supercomputing 2001.
[37] http://go4.163.com/xxys/ycyl/ycyl.htm
[38] http://www.netdoctor.com.cn/telemed/indcx.php?ps_operate=showarticle&pi_articleID=66
[39] I. Foster and C. Kesselman, editors, The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, 1998. Chapter 4
[40] HPSS介绍, http://www.sdsc.edu/hpss/HPSS_main.html
[41] HPSS目标, http://www.sdsc.cdu/hpss/HPSS_objectives.html
[42] Dennis Gannon, "Distributed Problem Solving Environment, collaborative workbenches/frameworks and Portals: how they will be used in the future?", http://www-itg.lbl.gov/DOE-Security_Research/WorkshopⅣ/presentations/DennisGannon.ppt
[43] Donald McMullen, Randall Bramley, et al. The Xport Collaboratory for High-Brilliance X-ray Crystallography, http://www.cs.indiana.edu/ngi/sc2000/index.html.
[2] Foster作的演讲稿, http://www-fp, mcs. anl. gov/~foster/Talks/WWWGridsMay2002, ppt.
[3] Chinese NHPCE Project, http://www. grid. ac. cn.
[4] Chinese ACI of MOE Project, http://aci. cs. tsinghua. edu. cn. http://www. hpclab, shu. edu. cn
[5] 徐志伟；因特网涅果—正在浮现的网格技术[N]．计算机世界，2001，(43)．
[6] I. Foster and C. Kesselman; "The Grid: Blueprint for a New Computing Infrastructure" San Francisco, CA: Morgan Kaufmann, 1999. http://mkp, com/grids, http://www.gridforum. org/, http://www.ccgrid. org/.
[7] 刘鹏，《网格概念的界定》清华大学计算机系高性能所网格研究组http://www.gridhome. com
[8] 任建武，《GRID GIS关键技术研究》南京师范大学博士学位论文2003．5．
[9] 网格研究，中国网格：http://www. chinagrid. com.
[10] 刘鹏，《网格的发展趋势》 清华大学计算机系高性能所网格研究组http://www. gridhome. com
[11] M. J. Litzkow, M. Livny, and M.W. Mutka; "Condor-A hunter of idle workstations", 8th International Conference on Distributed Computing Systems, 1988, pp. 104-111. http://www.cs. wisc. edu/condor/
[12] 徐志伟，李伟．织女星网格的体系结构研究[J]．计算机研究与发展，2002，39(8)：923—929．
[13] I. Foster, C. Kesselman, S. Tuecke. "The Anatomy of the Grid: Enabling Scalable Virtual Organizations". International J. Supercomputer Applications, 15(3), 2001.
[14] I. Foster, C. Kesselman, J. Nick, S. Tuecke; "The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration". January, 2002. http://www. Globus. org/research/papers/ogsa, pdf
[15] Ashton Applewhite, "Getting the grid" . IEEE distributed system online. 2002.
[16]．柴晓路，梁宇奇：《WebServices技术、架构和应用》北京：电子工业出版社，2003，1．
[17] OGSA结构描述，http://www. Globus. org/ogsa/http://www. gridforum. org/ogsi-wg/drafts/ogsa_draft2.9_2002-06-22. pdf,
[18] Foster Ian Carl Kesselman Jeffrey M. Nick Steven Tueck著，肖贺译，《基于综合分布系统的网格服务》清华大学计算机系 2003．3．2 http://www. gridhome. com
[19] J. Nieplocha and R. Harrison, Shared memory NUMA programming on the I-WAY, in Proc. Sth IEEE Symp. on High Performance Distributed Computing, IEEE Computer Society Press, 1996, pp. 432-441.
[20] M. Norman et at., Galaxies collide on the I-WAY: An example of heterogeneous wide-area collaborative supercomputing, International Journal of Supercomputer Applications, 10 (1996), pp. 131-140.
[21] I. Foster, J. Geisler, and S. Tuecke, MPI on the I-WAY: A wide-area, multimethod implementation of the Message Passing Interface, in Proceedings of the 1996 MPI Developers Conference, IEEE Computer Society Press, 1996, pp. 10-17.
[22] I. Foster, C. Kesselman; The Globus Project: A Status Report, In Proc. IPPS/SPDP '98 Heterogeneous ComputingWorkshop, pp. 4-18, 1998.
[23] 单久龙 陈国良, "Grid Society: A System View of Grid and P2P Environment" accepted by GCC2002 workshop, 2002.10
[24] I. Foster, C. Kesselman. Globus: A Metacomputing Infrastructure Toolkit. Intl J. Supercomputer Applications, 11(2):115-128, 1997.
[25] http://www. globus. org
[26] 都志辉，陈渝，刘鹏，《网格计算》[M]清华大学出版社2002(181)
[27] G. von Laszewski, I. Foster, J. Gawor, W. Smith, and S. Tuecke. CoG Kits: A Bridge between Commodity Distributed Computing and High-Performance Grids. ACM 2000 Java Grande Conference, 2000.
[28] S. Brunett, K. Czajkowski, S. Fitzgerald, I. Foster, A. Johnson, C. Kesselman, J. Leigh, S. Tuecke. Application Experiences with the Globus Toolkit. To appear in 7th IEEE Symp. on High Performance Distributed Computing, July 1998.
[29] G. von Laszewski, I. Foster. Grid Infrastructure to Support Science Portals for Large Scale Instruments. Proc. of the Workshop Distributed Computing on the Web (DCW), 1999.
[30] 桂小林，钱德沛《基于Internet的网格计算模型研究》西安交通大学学报2001年10月第35卷第10期：1008-1011
[31] 都志辉，李三立，陈渝，刘鹏，黄震春，何川，方兴；网格计算及其原型实现研究[J] 计算机科学，2002，29(8)：1—5
[32] 应宏，网络应用计算模型的演变与发展[J]．计算机系统应用，2003，16(3)：76—79．
[33] 王育峰，杨寿保《网格计算系统研究及发展方向》计算机科学 2002．6第29卷第6期，pp16-18
[34] 王育峰，杨寿保，赵晓春，陈昕，"Research on Security Architecture and Security Policy of Grid System" accepted by GCC2002 workshop, 2002.10
[35] 刘鹏，《网格应用现状与分析——从应用看网格》中国网格信息中转站2003年10月http://www. chinagird. net/
[36] Gabrielle Allen, Thomas Dramlitsch, Ian Foster, Nick Karonis, Matei Ripeanu, Ed Seidel, Brian Toonen. "Supporting Efficient Execution in Heterogeneous Distributed Computing Environments with Cactus and Globus" Supercomputing 2001.
[37] http://go4.163.com/xxys/ycyl/ycyl.htm
[38] http://www.netdoctor.com.cn/telemed/indcx.php?ps_operate=showarticle&pi_articleID=66
[39] I. Foster and C. Kesselman, editors, The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, 1998. Chapter 4
[40] HPSS介绍, http://www.sdsc.edu/hpss/HPSS_main.html
[41] HPSS目标, http://www.sdsc.cdu/hpss/HPSS_objectives.html
[42] Dennis Gannon, "Distributed Problem Solving Environment, collaborative workbenches/frameworks and Portals: how they will be used in the future?", http://www-itg.lbl.gov/DOE-Security_Research/WorkshopⅣ/presentations/DennisGannon.ppt
[43] Donald McMullen, Randall Bramley, et al. The Xport Collaboratory for High-Brilliance X-ray Crystallography, http://www.cs.indiana.edu/ngi/sc2000/index.html.