基于事件通知服务的网格监测系统研究
|
摘要
网格自90年代中期被提出以来,得到迅猛发展,是目前国际计算机界的热门研究领域之一。网格监测为网格用户和其他组件提供与网格资源有关的重要性能数据,是网格系统进行性能调整和错误发现的依据。因而网格监测系统的建设是网格建设中非常关键的一环,成为重要的研究方向。
本文的主要贡献在于借鉴基于内容的事件通知服务思想,提出并设计一种基于事件通知服务(Event Notification Service,ENS)的网格监测系统。将“基于内容的发布/订阅”通信机制引入到网格监测系统中。
考虑到网格环境是一种跨地域跨组织的广域异构环境,由地理上分布、分属不同管理组织的各类网络构成,本文设计一种“混合结构”的服务器网络拓扑,即采用层次化结构与一般对等结构相混合的方式来建立监测系统的服务器网络。
根据网格资源监测对象的特征,在可扩展的互联网事件通知体系结构(Scalable Internet Event Notification Architecture,SIENA)基础上,本文设计了适用于网格监测系统的数据存储结构和消息格式;在SIENA原始路由转发算法基础上设计了一种基于分类的路由转发(Classification-Based Routing and Forwarding,CBRF)算法。
最后,基于上述框架结构本文设计了一个基于ENS的网格监测原型系统,实现了主要的功能模块,并在局域网内进行了仿真验证。另外,将本文设计的CBRF算法与SIENA原始转发算法做了实验对比,结果表明CBRF算法提高了消息的转发速度。
The grid technology has been developed greatly since it was proposed in 1990s, and has become one of the hot researching fields. Grid Monitoring System provides essential and source-related performance data for the users and developers of grid, and it lays the base for grid system to regulate performance and find errors. So how to construct Grid Monitoring System is one of the critical problems of the grid research, and has become an important research direction.This paper designs an ENS-based (Event Notification Service, ENS for short) Grid Monitoring System, which uses "content-based publish/subscribe" as the communication mechanism and is high scalability. The design idea is derived from Content-based Event Notification Service.The grid environment is wide-area heterogeneous environment, which is across wide areas, and it will be consist of many LANs, these LANs are distributed and belong to different organizations. This paper proposes a hybrid topology in constructing the server network of Grid Monitoring System, which is hybrid from hierarchical topology and generic peer-to-peer topology.According to the characters of the object of grid monitoring, based on the SIENA (Scalable Internet Event Notification Architecture), this paper designs data structure and message format which are suitable for Grid Monitoring System. Based on the original routing and forwarding algorithm of the SIENA, this paper designs a classification-based routing and forwarding algorithm.At last, this paper designs a grid monitoring prototype system according the architecture mentioned above, and implements main function modules. In addition, this paper compares the classification-based algorithm with the original algorithm of the SIENA by experiments, and the results show that the classification-based algorithm increases the speed of forwarding message.
本文的主要贡献在于借鉴基于内容的事件通知服务思想,提出并设计一种基于事件通知服务(Event Notification Service,ENS)的网格监测系统。将“基于内容的发布/订阅”通信机制引入到网格监测系统中。
考虑到网格环境是一种跨地域跨组织的广域异构环境,由地理上分布、分属不同管理组织的各类网络构成,本文设计一种“混合结构”的服务器网络拓扑,即采用层次化结构与一般对等结构相混合的方式来建立监测系统的服务器网络。
根据网格资源监测对象的特征,在可扩展的互联网事件通知体系结构(Scalable Internet Event Notification Architecture,SIENA)基础上,本文设计了适用于网格监测系统的数据存储结构和消息格式;在SIENA原始路由转发算法基础上设计了一种基于分类的路由转发(Classification-Based Routing and Forwarding,CBRF)算法。
最后,基于上述框架结构本文设计了一个基于ENS的网格监测原型系统,实现了主要的功能模块,并在局域网内进行了仿真验证。另外,将本文设计的CBRF算法与SIENA原始转发算法做了实验对比,结果表明CBRF算法提高了消息的转发速度。
The grid technology has been developed greatly since it was proposed in 1990s, and has become one of the hot researching fields. Grid Monitoring System provides essential and source-related performance data for the users and developers of grid, and it lays the base for grid system to regulate performance and find errors. So how to construct Grid Monitoring System is one of the critical problems of the grid research, and has become an important research direction.This paper designs an ENS-based (Event Notification Service, ENS for short) Grid Monitoring System, which uses "content-based publish/subscribe" as the communication mechanism and is high scalability. The design idea is derived from Content-based Event Notification Service.The grid environment is wide-area heterogeneous environment, which is across wide areas, and it will be consist of many LANs, these LANs are distributed and belong to different organizations. This paper proposes a hybrid topology in constructing the server network of Grid Monitoring System, which is hybrid from hierarchical topology and generic peer-to-peer topology.According to the characters of the object of grid monitoring, based on the SIENA (Scalable Internet Event Notification Architecture), this paper designs data structure and message format which are suitable for Grid Monitoring System. Based on the original routing and forwarding algorithm of the SIENA, this paper designs a classification-based routing and forwarding algorithm.At last, this paper designs a grid monitoring prototype system according the architecture mentioned above, and implements main function modules. In addition, this paper compares the classification-based algorithm with the original algorithm of the SIENA by experiments, and the results show that the classification-based algorithm increases the speed of forwarding message.
引文
[1]. Andy Cooke, Alasdair Gray, Lisha Ma, Werner Nutt, James Magowan, et al. R-GMA: An Information Integration System for Grid Monitoring[C]. In Proceedings of the Eleventh International Conference on Cooperative Information Systems (2003). 2003
[2]. Globus. http://www.globus.org, 2003.
[3]. MDS2: http://www.globus.org/mds/mds2, 2003.
[4]. Globus Toolkit 2.2 MDS Technology Brief. Draft 4-January 30, 2003.
[5]. Gregor von Laszewski and Ian Foster. Usage of LDAP in Globus[R]. 1998
[6]. Steven Fitzgerald, Ian Foster, Carl Kesselman, Gregor von Laszewski, Warren Smith, Steven Tuecke. A Directory Service for Configuring High-Performance Distributed Computations. Proc. 6th IEEE Symposium on High-Performance Distributed Computing, pp. 365-375, 1997.
[7]. Karl Czajkowski, Steven Fitzgerald, Ian Foster, and Carl Kesselman. Grid information services for distributed resource sharing. In Proc. 10th IEEE International Symposium on High-Performance Distributed Computing (HPDC-10). IEEE Press, 2001.
[8]. H'el_ene N. Lim Choi Keung, Justin R. D. Dyson, Stephen A. Jarvis, Graham R. Nudd. Predicting the Performance of Globus Monitoring and Discovery Service (MDS-2) Queries[C]. Fourth International Workshop on Grid Computing. 2003.
[9]. Global Grid Forum: http://www.gridforum.org/
[10]. Brian Tierney, Ruth Aydt, Dan Gunter et al. "A Grid Monitoring Architecture" In: Performance Working Group of Grid Forum, 2001.
[11]. Steve Fisher. Relational model for information and monitoring. Technical Report GWD-Perf-7-1, GGF, 2001.
[12]. Information and Monitoring (WP3) Architecture Report, DataGrid-01-D1. 2-0112-0-3, September 2001.
[13]. Rob Byrom, Brian Coghln, Andrew W Cooke, Roney Cordenonsi, Linda Cornwall, Abdeslem Djaoui, Laurence Field, Steve Fisher, et al. Relational Grid Monitoring Architecture(R-GMA)[C]. Talk given at UK e-Science All-Hands meeting, Nottingham, UK, September 2-4, 2003. 7 pages of LaTeX and 5 PNG figures.
[14]. Brian L. Tierney. Project Summary Report: The Distibuted Monitoring Framework[R]. 2003.
[15]. Gunter D, Tierney B, Jackson K, Lee J, Stoufer M. Dynamic Monitoring of High-Performance Distributed Application[C]. In: Proc. Of the 11th IEEE Symposium on High Performace Distributed Computing, 2002.
[16]. Lee J, Gunter D, Stoufer M, Tierney B. Monitoring Data Archives for Grid Envionment[C]. In: Proc. Of IEEE Supercomputing 2002 Conf. LBNL-50216, 2002.
[17]. Peter A. Dinda and Beth Plale. A Unified Relational Approach to Grid Information Services[R]. Tech. Rep. GWD-GIS-012-1, Global Grid Forum, 2001.
[18]. Brian L. Tierney. Project Summary Report: The Distibuted Monitoring Framework[R]. 2003, 1.
[19]. Gunter D, Tierney B, Jackson K, Lee J, Stoufer M. Dynamic Monitoring of High-Performance Distributed Application[C]. In: Proc. Of the 11th IEEE Symposium on High Performace Distributed Computing, July 2002.
[20]. Lee J, Gunter D, Stoufer M, Tierney B. Monitoring Data Archives for Grid Envionment[C]. In: Proc. Of IEEE Supercomputing 2002 Conf. LBNL-50216, 2002.
[21]. Antonio Carzaniga, Alexander L. Wolf. Content-Based Networking: A New Communication Infrastructure. In NSF Workshop on an Infrastructure for Mobile and Wireless Systems. Lecture Notes in Computer Sciencen. 2538 p. 59-68. Springer-Verlag. Scottsdale, Arizona. October, 2001.
[22]. Antonio Carzaniga, Alexander L. Wolf. Content-Based Networking. White Paper.
[23]. Antonio Carzaniga, David S. Rosenblum, Alexander L. Wolf. Content-Based Addressing and Routing: A General Model and its Application[R]. Technical Report CU-CS-902-00, Department of Computer Science, University of Colorado, January, 2000.
[24]. Antonio Carzaniga, Alexander L. Wolf. Fast Forwarding for Content-Based Networking[R]. Technical Report CU-CS-922-01 November 2001.
[25]. Antonio Carzaniga, Matthew J. Rutherford, Alexander L. Wolf. A Routing Scheme for Content-Based Networking[R]. Technical Report CU-CS-953-03 June 2003.
[26]. Antonio Carzaniga, Matthew J. Rutherford, Alexander L. Wolf. A Routing Scheme for Content-Based Networking[C]. IEEE INFOCOM 2004.
[27]. Y. K. Dalal and R. M. Metcalfe. Reverse path forwarding of broadcast packets. Communications of the ACM, 21(12): 1040-1048, Dec. 1978.
[28]. L. R. Ford and D. R. Fulkerson. Flows in Networks. Princeton University Press, Princeton, 1963.
[29]. R. Bellman. Dynamic Programming. Princeton University Press, Princeton, 1957.
[30]. M. Caporuscio, A. Carzaniga, and A. L. Wolf. "Design and Evaluation of a Support Service for Mobile, Wireless Publish/Subscribe Applications". Technical Report CU-CS-944-03, Department of Computer Science, University of Colorado, January, 2003.
[31]. Antonio Carzaniga, Alexander L. Wolf. Forwarding in a Content-Based Network[C]. SIGCOMM' 03, August 25-29, 2003.
[32]. A. Carzaniga, D. S. Rosenblum, and A. L. Wolf "Achieving Expressiveness and Scalability in an Internet-Scale Event Notification Service". Nineteenth ACM Symposium on Principles of Distributed Computing (PODC2000), Portland OR. July, 2000.
[33]. A. Carzaniga, D. S. Rosenblum, and A. L. Wolf "Interfaces and Algorithms for a Wide-Area Event Notification Service". Technical Report CU-CS-888-99, Department of Computer Science, University of Colorado, October, 1999 (revised May 2000).
[34]. A. Carzaniga "Architectures for an Event Notification Service Scalable to Wide-area Networks". PhD Thesis. Politecnico di Milano. December, 1998.
[35]. A. Carzaniga, D. S. Rosenblum, and A. L. Wolf "Design of a Scalable Event Notification Service: Interface and Architecture". Technical Report CU-CS-863-98, Department of Computer Science, University of Colorado, August, 1998.
[36]. D. S. Rosenblum and A. L. Wolf "A Design Framework for Internet-Scale Event Observation and Notification". 6th European Software Engineering Conference. Lecture Notes in Computer Science 1301, Springer, Berlin, 1997, pages 344-360.
[37]. D. S. Rosenblum, A. L. Wolf and A. Carzaniga "Critical Considerations and Designs for Internet-Scale, Event-Based Compositional Architectures". Workshop on Compositional Software Architectures. Monterey, CA. January, 1998.
[38]. http://www.cs.colorado.edu/serl/cbn/forwarding/。
[39].任旭龙,网格资源监控及其资源描述的研究[D],兰州理工大学,2003。
[40].赵东,网格计算环境中若干关键技术的研究[D],电子科技大学,2003。
[41].查礼,徐志伟,林国璋,刘玉树,刘东华,李伟,基于LDAP的网格监控系统[J],计算机研究与发展,2002,39(8)。
[42].都志辉,陈渝,刘鹏.网格计算[M].北京:清华大学出版社,2002.
[43].Ian Foster,Carl Kesselman着。金海等译。网格计算(第二版)[M]。电子工业出版社,2004-10。
[44].陈宁,消息中间件TongLINK Q及其事件管理子系统的设计与实现[D],电子科技大学,2001。
[45].薛涛,冯博琴,数字图书馆中基于内容的事件通知服务的设计与实现,小型微型计算机系统,2004.3。
[46].侯孟书,XML-CORBA消息中间件设计与实现[D],电子科技大学,2002。
[47].汪洋,分布事件通知服务的关键技术及其应用研究[D],中国科学院研究生院(软件研究所),2004。
[48].黄达明,李国东,张德富,网格监控系统研究[J],计算机科学,2003,30(9):144-147.
[49].李晓明,分布式入侵检测系统体系结构的研究[D],西安电子科技大学,2004。
[50].罗泽,南凯,阎保平,基于发布/订阅系统的事件服务体系结构,计算机工程与应用,2003.27。
[51].刘东华,徐志伟,李伟,基于有向无环图的两层网格监测系统,计算机研究与发展,2002.8。
[52].何华海,基于消息的中间件设计模式和系统结构[D],中国科学院研究生院(软件研究所),2002。
[53].孙岱,网格监控研究与监控服务系统的设计[D],中南大学,2004。
[2]. Globus. http://www.globus.org, 2003.
[3]. MDS2: http://www.globus.org/mds/mds2, 2003.
[4]. Globus Toolkit 2.2 MDS Technology Brief. Draft 4-January 30, 2003.
[5]. Gregor von Laszewski and Ian Foster. Usage of LDAP in Globus[R]. 1998
[6]. Steven Fitzgerald, Ian Foster, Carl Kesselman, Gregor von Laszewski, Warren Smith, Steven Tuecke. A Directory Service for Configuring High-Performance Distributed Computations. Proc. 6th IEEE Symposium on High-Performance Distributed Computing, pp. 365-375, 1997.
[7]. Karl Czajkowski, Steven Fitzgerald, Ian Foster, and Carl Kesselman. Grid information services for distributed resource sharing. In Proc. 10th IEEE International Symposium on High-Performance Distributed Computing (HPDC-10). IEEE Press, 2001.
[8]. H'el_ene N. Lim Choi Keung, Justin R. D. Dyson, Stephen A. Jarvis, Graham R. Nudd. Predicting the Performance of Globus Monitoring and Discovery Service (MDS-2) Queries[C]. Fourth International Workshop on Grid Computing. 2003.
[9]. Global Grid Forum: http://www.gridforum.org/
[10]. Brian Tierney, Ruth Aydt, Dan Gunter et al. "A Grid Monitoring Architecture" In: Performance Working Group of Grid Forum, 2001.
[11]. Steve Fisher. Relational model for information and monitoring. Technical Report GWD-Perf-7-1, GGF, 2001.
[12]. Information and Monitoring (WP3) Architecture Report, DataGrid-01-D1. 2-0112-0-3, September 2001.
[13]. Rob Byrom, Brian Coghln, Andrew W Cooke, Roney Cordenonsi, Linda Cornwall, Abdeslem Djaoui, Laurence Field, Steve Fisher, et al. Relational Grid Monitoring Architecture(R-GMA)[C]. Talk given at UK e-Science All-Hands meeting, Nottingham, UK, September 2-4, 2003. 7 pages of LaTeX and 5 PNG figures.
[14]. Brian L. Tierney. Project Summary Report: The Distibuted Monitoring Framework[R]. 2003.
[15]. Gunter D, Tierney B, Jackson K, Lee J, Stoufer M. Dynamic Monitoring of High-Performance Distributed Application[C]. In: Proc. Of the 11th IEEE Symposium on High Performace Distributed Computing, 2002.
[16]. Lee J, Gunter D, Stoufer M, Tierney B. Monitoring Data Archives for Grid Envionment[C]. In: Proc. Of IEEE Supercomputing 2002 Conf. LBNL-50216, 2002.
[17]. Peter A. Dinda and Beth Plale. A Unified Relational Approach to Grid Information Services[R]. Tech. Rep. GWD-GIS-012-1, Global Grid Forum, 2001.
[18]. Brian L. Tierney. Project Summary Report: The Distibuted Monitoring Framework[R]. 2003, 1.
[19]. Gunter D, Tierney B, Jackson K, Lee J, Stoufer M. Dynamic Monitoring of High-Performance Distributed Application[C]. In: Proc. Of the 11th IEEE Symposium on High Performace Distributed Computing, July 2002.
[20]. Lee J, Gunter D, Stoufer M, Tierney B. Monitoring Data Archives for Grid Envionment[C]. In: Proc. Of IEEE Supercomputing 2002 Conf. LBNL-50216, 2002.
[21]. Antonio Carzaniga, Alexander L. Wolf. Content-Based Networking: A New Communication Infrastructure. In NSF Workshop on an Infrastructure for Mobile and Wireless Systems. Lecture Notes in Computer Sciencen. 2538 p. 59-68. Springer-Verlag. Scottsdale, Arizona. October, 2001.
[22]. Antonio Carzaniga, Alexander L. Wolf. Content-Based Networking. White Paper.
[23]. Antonio Carzaniga, David S. Rosenblum, Alexander L. Wolf. Content-Based Addressing and Routing: A General Model and its Application[R]. Technical Report CU-CS-902-00, Department of Computer Science, University of Colorado, January, 2000.
[24]. Antonio Carzaniga, Alexander L. Wolf. Fast Forwarding for Content-Based Networking[R]. Technical Report CU-CS-922-01 November 2001.
[25]. Antonio Carzaniga, Matthew J. Rutherford, Alexander L. Wolf. A Routing Scheme for Content-Based Networking[R]. Technical Report CU-CS-953-03 June 2003.
[26]. Antonio Carzaniga, Matthew J. Rutherford, Alexander L. Wolf. A Routing Scheme for Content-Based Networking[C]. IEEE INFOCOM 2004.
[27]. Y. K. Dalal and R. M. Metcalfe. Reverse path forwarding of broadcast packets. Communications of the ACM, 21(12): 1040-1048, Dec. 1978.
[28]. L. R. Ford and D. R. Fulkerson. Flows in Networks. Princeton University Press, Princeton, 1963.
[29]. R. Bellman. Dynamic Programming. Princeton University Press, Princeton, 1957.
[30]. M. Caporuscio, A. Carzaniga, and A. L. Wolf. "Design and Evaluation of a Support Service for Mobile, Wireless Publish/Subscribe Applications". Technical Report CU-CS-944-03, Department of Computer Science, University of Colorado, January, 2003.
[31]. Antonio Carzaniga, Alexander L. Wolf. Forwarding in a Content-Based Network[C]. SIGCOMM' 03, August 25-29, 2003.
[32]. A. Carzaniga, D. S. Rosenblum, and A. L. Wolf "Achieving Expressiveness and Scalability in an Internet-Scale Event Notification Service". Nineteenth ACM Symposium on Principles of Distributed Computing (PODC2000), Portland OR. July, 2000.
[33]. A. Carzaniga, D. S. Rosenblum, and A. L. Wolf "Interfaces and Algorithms for a Wide-Area Event Notification Service". Technical Report CU-CS-888-99, Department of Computer Science, University of Colorado, October, 1999 (revised May 2000).
[34]. A. Carzaniga "Architectures for an Event Notification Service Scalable to Wide-area Networks". PhD Thesis. Politecnico di Milano. December, 1998.
[35]. A. Carzaniga, D. S. Rosenblum, and A. L. Wolf "Design of a Scalable Event Notification Service: Interface and Architecture". Technical Report CU-CS-863-98, Department of Computer Science, University of Colorado, August, 1998.
[36]. D. S. Rosenblum and A. L. Wolf "A Design Framework for Internet-Scale Event Observation and Notification". 6th European Software Engineering Conference. Lecture Notes in Computer Science 1301, Springer, Berlin, 1997, pages 344-360.
[37]. D. S. Rosenblum, A. L. Wolf and A. Carzaniga "Critical Considerations and Designs for Internet-Scale, Event-Based Compositional Architectures". Workshop on Compositional Software Architectures. Monterey, CA. January, 1998.
[38]. http://www.cs.colorado.edu/serl/cbn/forwarding/。
[39].任旭龙,网格资源监控及其资源描述的研究[D],兰州理工大学,2003。
[40].赵东,网格计算环境中若干关键技术的研究[D],电子科技大学,2003。
[41].查礼,徐志伟,林国璋,刘玉树,刘东华,李伟,基于LDAP的网格监控系统[J],计算机研究与发展,2002,39(8)。
[42].都志辉,陈渝,刘鹏.网格计算[M].北京:清华大学出版社,2002.
[43].Ian Foster,Carl Kesselman着。金海等译。网格计算(第二版)[M]。电子工业出版社,2004-10。
[44].陈宁,消息中间件TongLINK Q及其事件管理子系统的设计与实现[D],电子科技大学,2001。
[45].薛涛,冯博琴,数字图书馆中基于内容的事件通知服务的设计与实现,小型微型计算机系统,2004.3。
[46].侯孟书,XML-CORBA消息中间件设计与实现[D],电子科技大学,2002。
[47].汪洋,分布事件通知服务的关键技术及其应用研究[D],中国科学院研究生院(软件研究所),2004。
[48].黄达明,李国东,张德富,网格监控系统研究[J],计算机科学,2003,30(9):144-147.
[49].李晓明,分布式入侵检测系统体系结构的研究[D],西安电子科技大学,2004。
[50].罗泽,南凯,阎保平,基于发布/订阅系统的事件服务体系结构,计算机工程与应用,2003.27。
[51].刘东华,徐志伟,李伟,基于有向无环图的两层网格监测系统,计算机研究与发展,2002.8。
[52].何华海,基于消息的中间件设计模式和系统结构[D],中国科学院研究生院(软件研究所),2002。
[53].孙岱,网格监控研究与监控服务系统的设计[D],中南大学,2004。