基于Globus存储网格传输服务的研究与实现
摘要
网格是利用互联网把地理上广泛分布的各种资源(包括计算资源、存储资源、带宽资源、软件资源、数据资源、信息资源、知识资源等)连成一个逻辑整体,就像一台超级计算机一样,为用户提供一体化信息和应用服务。对网格的研究始于美国,纵观网格相关组织的各个网格项目,Globus是最有影响的网格研究计划,它力图实现计算网格结构,来提供对高性能远程计算资源普遍的、可靠的、一致性的访问。
在网格的所有服务当中,对于数据的传输服务处于很重要的地位,一切的存储和计算都需要传输服务的支持。网格环境需要一种快速、安全、有效并可靠的传输机制。网格项目在通盘考虑了当前可用的协议与技术和已经实现的一些原型基础上,确定以FTP协议为基础,并对FTP协议进行了必要的扩展,增加了一些网格计算必要的功能,从而提出了GridFTP协议。在FTP协议的基础上,GridFTP协议及基于其上的工具集为网格数据传输提供了一些其他特征,支持第三方控制的数据传输,支持并行数据传输,支持带状数据传输等。
本论文重点研究Globus网格平台下的网格数据传输机制,从GridFTP协议的概念、原理、传输功能以及安全性和新的传输机制到其实现,同时对网格的基本概念以及研究所基于的Globus Toolkit4平台进行了介绍,包括其体系结构以及相关组件。本文还对GridFTP协议的进一步集成进行了论述并提出有待增强的地方。
Grid connect so many resouces which are far-ranging distributing geographically to a logical whole, (including compute resource, storage resource, bandwidth resource, software resource,data resource,information resource and knowledge resource)just like a super computer,offering incorporate information and application service.The grid research is from America,review these grid projects which belong to those related organizations, the most famous grid research plan is the Globus,it strives to implement compute grid structure, giving universal,reliable and consistent accessing to high-powered remote compute resource.
The data transfer is at an advantage status in all the grid services, all the storage and compute need the support of transfer. Grid circumstance need a express,secure, effective and reliable transfer mechanism.Grid projects all-around consider the protocol and technology which are available at present and some prototype bases which already come true, make certain use the FTP protocol as foundation and extend the FTP protocol, add some essential function of grid compute, the GridFTP protocol brings forward consequently. Depending on the FTP protocol, the GridFTP protocol and tools base on it provide some other characters for grid data transfer, such as third-party transfer, parallel transfer and tripped transfer and so on.
The research emphases in this paper is the grid data transfer mechanism based on Globus, from the concept of GridFTP protocol,principle,transfer function, security and new transfer mechanism to realization, and then introduce the Globus Toolkit 4 platform, including architecture and related modules.At last we discuss the further integration of the GridFTP protocol and put forward some places that need be strengthened.
在网格的所有服务当中,对于数据的传输服务处于很重要的地位,一切的存储和计算都需要传输服务的支持。网格环境需要一种快速、安全、有效并可靠的传输机制。网格项目在通盘考虑了当前可用的协议与技术和已经实现的一些原型基础上,确定以FTP协议为基础,并对FTP协议进行了必要的扩展,增加了一些网格计算必要的功能,从而提出了GridFTP协议。在FTP协议的基础上,GridFTP协议及基于其上的工具集为网格数据传输提供了一些其他特征,支持第三方控制的数据传输,支持并行数据传输,支持带状数据传输等。
本论文重点研究Globus网格平台下的网格数据传输机制,从GridFTP协议的概念、原理、传输功能以及安全性和新的传输机制到其实现,同时对网格的基本概念以及研究所基于的Globus Toolkit4平台进行了介绍,包括其体系结构以及相关组件。本文还对GridFTP协议的进一步集成进行了论述并提出有待增强的地方。
Grid connect so many resouces which are far-ranging distributing geographically to a logical whole, (including compute resource, storage resource, bandwidth resource, software resource,data resource,information resource and knowledge resource)just like a super computer,offering incorporate information and application service.The grid research is from America,review these grid projects which belong to those related organizations, the most famous grid research plan is the Globus,it strives to implement compute grid structure, giving universal,reliable and consistent accessing to high-powered remote compute resource.
The data transfer is at an advantage status in all the grid services, all the storage and compute need the support of transfer. Grid circumstance need a express,secure, effective and reliable transfer mechanism.Grid projects all-around consider the protocol and technology which are available at present and some prototype bases which already come true, make certain use the FTP protocol as foundation and extend the FTP protocol, add some essential function of grid compute, the GridFTP protocol brings forward consequently. Depending on the FTP protocol, the GridFTP protocol and tools base on it provide some other characters for grid data transfer, such as third-party transfer, parallel transfer and tripped transfer and so on.
The research emphases in this paper is the grid data transfer mechanism based on Globus, from the concept of GridFTP protocol,principle,transfer function, security and new transfer mechanism to realization, and then introduce the Globus Toolkit 4 platform, including architecture and related modules.At last we discuss the further integration of the GridFTP protocol and put forward some places that need be strengthened.
引文
[1]Ian Foster《网格:21世纪信息技术基础设施的蓝图》1998
[2]Ian Foster什么是网格,鉴别网格的三个指标,2002年7月
[3]都志辉,陈渝,刘鹏 网格计算,清华大学出版社2002年8月
[4]刘鹏SF Express-大规模军事仿真清华大学出版社2004年12月
[5]罗作民,张景,李军怀网格计算及其关键技术综述计算机工程与应用2003年5月
[6]王铮,吴兵GridGIS-基于网格计算的地理信息系统计算机工程2003年3月
[7]董方鹏,龚奕利,李伟,查礼网格环境中资源发现机制的研究计算机研究与发展
[8]陈萍,余华山,王彬,许卓群网格计算环境Globus介绍计算机应用研究2003
[9]任晓雨网格计算中作业管理系统的分析及设计计算机仿真2003年10月
[10]李伟,徐志伟一种网格资源空间模型及其应用计算机研究与发展2003年10月
[11]Ian Foster Modeling Stateful Resources with Web Services
[12]Ian Foster,Carl Kesselman,Jeffrey M.Nick,et tl."The Physiology of the Grid-An Open Grid 13.Services Architecture for Distributed Systems Integration",2004.6
[13]14.Postel,J.and Reynolds,J."FILE TRANSFER PROTOCOL(FTP)",RFC 959
[14]15.Horowitx,M.and Lunt,S."FTP Security Extensions",RFC 2228
[15]16.Tsur S.Are Web services the next revolution in E-Commerce Morgan Kaufma Publishers,2001.614-617.
[16]17.Shmueli O.Architectures for internal Web services deployment Morgan Kaufmann Publishers,2001.641-644.
[17]18.Open Grid Services Infrastructure(OGSI)S.Tuecke,K.Czajkowski,etc
[18]19.Karl Czajkowski From Open Grid Services Infrastructure to WSResource Framework:Re factoring&Evolution
[19]20.http://www.ibm.corn/developerworks/cn/grid
[20]21.http://www.Globus.org/
[2]Ian Foster什么是网格,鉴别网格的三个指标,2002年7月
[3]都志辉,陈渝,刘鹏 网格计算,清华大学出版社2002年8月
[4]刘鹏SF Express-大规模军事仿真清华大学出版社2004年12月
[5]罗作民,张景,李军怀网格计算及其关键技术综述计算机工程与应用2003年5月
[6]王铮,吴兵GridGIS-基于网格计算的地理信息系统计算机工程2003年3月
[7]董方鹏,龚奕利,李伟,查礼网格环境中资源发现机制的研究计算机研究与发展
[8]陈萍,余华山,王彬,许卓群网格计算环境Globus介绍计算机应用研究2003
[9]任晓雨网格计算中作业管理系统的分析及设计计算机仿真2003年10月
[10]李伟,徐志伟一种网格资源空间模型及其应用计算机研究与发展2003年10月
[11]Ian Foster Modeling Stateful Resources with Web Services
[12]Ian Foster,Carl Kesselman,Jeffrey M.Nick,et tl."The Physiology of the Grid-An Open Grid 13.Services Architecture for Distributed Systems Integration",2004.6
[13]14.Postel,J.and Reynolds,J."FILE TRANSFER PROTOCOL(FTP)",RFC 959
[14]15.Horowitx,M.and Lunt,S."FTP Security Extensions",RFC 2228
[15]16.Tsur S.Are Web services the next revolution in E-Commerce Morgan Kaufma Publishers,2001.614-617.
[16]17.Shmueli O.Architectures for internal Web services deployment Morgan Kaufmann Publishers,2001.641-644.
[17]18.Open Grid Services Infrastructure(OGSI)S.Tuecke,K.Czajkowski,etc
[18]19.Karl Czajkowski From Open Grid Services Infrastructure to WSResource Framework:Re factoring&Evolution
[19]20.http://www.ibm.corn/developerworks/cn/grid
[20]21.http://www.Globus.org/