大规模空间信息的网络共享系统
|
摘要
信息共享是信息技术的发展趋势。空间信息是用来描述地球表面与空间位置相关的各种事物及其属性的信息。作为科学数据的重要组成部分,空间数据的共享不仅对国家经济发展具有重要意义,而且是进行重大决策的必要依据。空间信息共享系统则为用户提供了空间数据的输入、存储、查询、检索、处理、分析、显示和更新服务,某些系统还具备处理空间中各种实体及其相互关系的能力。
同时空间信息的可视化与互动系统越来越引起了公众的浓厚兴趣和广泛关注。除了专业用户可以在该系统上从事系统应用规划、统计评价和决策支持,私人用户(如游客和网民)也可通过该系统从空间信息的众多应用领域中获益。
本文提出了一个可扩展的大规模空间信息的网络共享方案,构建了该系统的框架并且论述了具体实现。此方案着重解决了空间信息共享中的两个关键问题:空间信息的组织与存储方式、可支持大量用户的高性能通讯层架构。此方案可支持大量用户共享空间信息,在客户端提供了可视化界面,为用户提供了三维场景漫游功能。此外本文还对该系统的进一步扩展设计了解决方案,即面向于空间信息共享的P2P系统设计。
第一章介绍了空间信息共享的技术背景、系统整体的框架设计。第二章介绍了空间信息的组织与存储,首先描述了场景树与空间索引,然后描述了空间信息的Out-of-Core存储方式,最后描述了空间信息的序列化以及重建。第三章着重介绍了空间信息的网络传输。首先描述了网络传输的基础设施,从事件的多路分离框架开始,逐一介绍了数据传输的优先级控制,数据传输的带宽限制,以及数据传输的安全策略。然后依次介绍了主、从服务器以及客户端的设计与实现,着重分析了从服务器的负载均衡。最后对整个系统的性能进行了测试分析。第四章介绍了基于P2P的空间信息共享系统的设计,从邻居发现问题开始,介绍了Pastry算法、场景的分割、对等端的分类与动态维护,最后介绍了通讯协议。第五章对整篇论文做了总结,并提出了未来工作的方向。
Information sharing is the developing trends of the information technology. Spatial information is used to describe various entities and their attributes on the Earth. As an important part of the scientific data, the sharing of spatial information is crucial to the economic development of the country. It provides the users with spatial data input, storage, search, retrieval, processing, analysis, display, update, and ultimately provide a system to process various entities and their relationships in the space.
Concurrently, the interactive visualization of the spatial information is now attracting more and more attention. The professional users can utilize such system to do project planning, solution evaluating and decision making. The private users (tourist or netizen) can also benefit a lot from the various applications of such system.
This paper introduces an extendible network sharing system which can support massive spatial information and describes its framework and implementation. There are two focuses: one is the organization and storage of massive spatial information and the other is the communication architecture which supports large number of users. This paper also provides the design of an extension (spatial information sharing oriented P2P system) which further improves the communication architecture.
The first chapter is devoted to the technology background of spatial information sharing, and the framework of the overall system. The second chapter describes the storage and organization of the spatial information. It first describes the scene graph and the spatial index, and then describes the out-of-core storage. Finally it describes the serialization and reconstruction of the spatial information. The third chapter is focusing on the transmission of the spatial information. It first describes the infrastructure, and then describes the priority, security, and bandwidth limitation of the transmission. Chapter IV describes the p2p architecture, neighbor finding, the pastry algorithm, and the communication protocol. Chapter V concludes this thesis, and introduces the future work.
同时空间信息的可视化与互动系统越来越引起了公众的浓厚兴趣和广泛关注。除了专业用户可以在该系统上从事系统应用规划、统计评价和决策支持,私人用户(如游客和网民)也可通过该系统从空间信息的众多应用领域中获益。
本文提出了一个可扩展的大规模空间信息的网络共享方案,构建了该系统的框架并且论述了具体实现。此方案着重解决了空间信息共享中的两个关键问题:空间信息的组织与存储方式、可支持大量用户的高性能通讯层架构。此方案可支持大量用户共享空间信息,在客户端提供了可视化界面,为用户提供了三维场景漫游功能。此外本文还对该系统的进一步扩展设计了解决方案,即面向于空间信息共享的P2P系统设计。
第一章介绍了空间信息共享的技术背景、系统整体的框架设计。第二章介绍了空间信息的组织与存储,首先描述了场景树与空间索引,然后描述了空间信息的Out-of-Core存储方式,最后描述了空间信息的序列化以及重建。第三章着重介绍了空间信息的网络传输。首先描述了网络传输的基础设施,从事件的多路分离框架开始,逐一介绍了数据传输的优先级控制,数据传输的带宽限制,以及数据传输的安全策略。然后依次介绍了主、从服务器以及客户端的设计与实现,着重分析了从服务器的负载均衡。最后对整个系统的性能进行了测试分析。第四章介绍了基于P2P的空间信息共享系统的设计,从邻居发现问题开始,介绍了Pastry算法、场景的分割、对等端的分类与动态维护,最后介绍了通讯协议。第五章对整篇论文做了总结,并提出了未来工作的方向。
Information sharing is the developing trends of the information technology. Spatial information is used to describe various entities and their attributes on the Earth. As an important part of the scientific data, the sharing of spatial information is crucial to the economic development of the country. It provides the users with spatial data input, storage, search, retrieval, processing, analysis, display, update, and ultimately provide a system to process various entities and their relationships in the space.
Concurrently, the interactive visualization of the spatial information is now attracting more and more attention. The professional users can utilize such system to do project planning, solution evaluating and decision making. The private users (tourist or netizen) can also benefit a lot from the various applications of such system.
This paper introduces an extendible network sharing system which can support massive spatial information and describes its framework and implementation. There are two focuses: one is the organization and storage of massive spatial information and the other is the communication architecture which supports large number of users. This paper also provides the design of an extension (spatial information sharing oriented P2P system) which further improves the communication architecture.
The first chapter is devoted to the technology background of spatial information sharing, and the framework of the overall system. The second chapter describes the storage and organization of the spatial information. It first describes the scene graph and the spatial index, and then describes the out-of-core storage. Finally it describes the serialization and reconstruction of the spatial information. The third chapter is focusing on the transmission of the spatial information. It first describes the infrastructure, and then describes the priority, security, and bandwidth limitation of the transmission. Chapter IV describes the p2p architecture, neighbor finding, the pastry algorithm, and the communication protocol. Chapter V concludes this thesis, and introduces the future work.
引文
[1] [ISO/IEC 14772:1997] Virtual Reality Modeling Language (VRML97).
[2] [ISO/IEC14772-l:1997/Amd. 1:2002] VRML97 Amendment 1.
[3] Yi-Jen Chiang, Jihad El-Sana, Peter Lindstrom, Cl'audio T. Silva. Out-Of-Core Algorithms for Scientific Visualization and Computer Graphics. Course Notes for IEEE Visualization, 2002.
[4] Paolo Cignoni, Fabio Ganovelli, Enrico Gobbetti, Fabio Marton, Federico Ponchio, Roberto Scopigno. Adaptive TetraPuzzles: Efficient Out-of-Core Construction and Visualization of Gigantic Multiresolution Polygonal Models. Proc. SIGGRAPH, 2004.
[5] W. T. Corr(?)ea, J. T. Klosowski, C. T. Silva. iWalk. Interactive Out-Of-Core Rendering of Large Models. Technical Report TR-653-02, Princeton University, 2002.
[6] W. T. Corr(?)ea, KLOSOWSKI, J. T., SILVA, C. T. Visibility-based prefetching for interactive out-of-core rendering. In Proceedings of PVG (6th IEEE Symposium on Parallel and Large-Data Visualization and Graphics), 2003.
[7] John Kubiatowicz, David Bindel, Yan Chen, Steven Czerwinski, Patrick Eaton, Dennis Geels, Ramakrishna Gummadi, Sean Rhea, Hakim Weatherspoon, Westley Weimer, Chris Wells, Ben Zhao. OceanStore: An Architecture for Global-Scale Persistent Storage. In Proceedings of the Ninth International Conference on Archi-tectural Support for Programming Languages and Operating Systems, ASPLOS 2000,2000-11.
[8] BitTorrent. http://bitconjurer.org/BitTorrent.
[9] Venugopalan Ramasubramanian, Emin Güun Sirer Beehive. Exploiting Power Law Query Distributions for 0(1) Lookup Performance in Peer to Peer Overlays. In NSDI, 2004.
[10]Skype. http://www.skype.com.
[11]M. Castro, P. Druschel, A-M. Kermarrec, A. Nandi, A. Rowstron, A. Singh. SplitStream: High-bandwidth multicast in a cooperative environment. SOSP'03, Lake Bolton, New York, 2003-10.
[12] Napster, http://www.napster.com.
[13]Gnutella, http://gnutella.wego.com.
[14]Clarke, I. A distributed decentralized information storage and retrieval system. Master's thesis, University of Edinburgh, 1999.
[15]Clarke, I., Sandberg, O., Wiley, B., Hong, T.W. Freenet: A distributed anonymous information storage and retrieval system. In Proceedings of the Workshop on Design Issues in Anonymity and Unobservability, Berkeley, Cali-fornia, 2000-6. http://freenet.sourceforge.net.
[16]I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, H. Balakrishnan. Chord: A scalable peer-to-peer lookup service for Internet applications. In Proc. ACM SIG-COMM, San Diego, CA, 2001-8.
[17]X3D framework - Architecture and base components - Amendment 1. ISO/IEC PDAM (Proposed Draft Amendment) 19775-1:200x.
[18]X3D framework & SAL ISO/IEC FDIS (Final Draft International Standard) 19775:200x.
[19]X3D encodings. ISO/IEC FDIS (Final Draft International Standard) 19776-1:200x.
[20]X3D language bindings. ISO/IEC FDIS (Final Draft International Standard) 19777:200x.
[21] Leonard Daly, Organizer Dr. Don Brutzman, Presenter. Advanced X3D Graphics. Course 6 SIGGRAPH, 2003.
[22] Don Brutzman, Leonard Daly, Nicholas Polys, Joe D. Williams. Introducing X3D. Course 7 SIGGRAPH, 2002.
[23]S.Gottschalk, M.C.Lin, D.Manocha. OBB tree: a hierarchical structure for rapid interference detection. Proc. of ACM Siggraph'96, 1996:171-180.
[24] The Open Group. Technical Standard: DCE 1.1: Remote Procedure Call. 1997.
[25] Stephen D. Huston, James CE Johnson, Umar Syyid. ACE Programmer's Guide, The Practical Design Patterns for Network and Systems Programming. Addison Wesley, 2003.
[26]Douglas C. Schmidt, Stephen D. Huston. C++ Network Programming, Volume 1: Mastering Complexity with ACE and Patterns. Addison Wesley, 2001.
[27]Douglas C. Schmidt, Stephen D. Huston. C++ Network Programming, Volume 2: Systematic Reuse with ACE and Frameworks. Addison Wesley, 2002.
[28]SCHMALSTIEG, D., GERVAUTZ, M. 1996. Demand driven geometry transmission for distributed virtual environments. Computer Graphics Forum 15, 3, 421-433.
[29]Bjorn Knutsson, Honghui Lu, Wei Xu, Bryan Hopkins. Peer-to-Peer Support for Massively Multiplayer Games. In INFOCOM, 2004.
[30]Nobutaka Matsumoto, Yoshihiro Kawahara, Hiroyuki Morikawa, Tomonori Aoyama. A Scalable and Low Delay Communication Scheme for Networked Virtual Environments. GlobeCom Workshops, 2004.
[31]Joaquin Keller, Gwendal Simon. Solipsis: A Massively Multi-Participant Virtual World. In Proc. of PDPTA, 2003:262-268.
[32]Peiqun Yu. MOPAR: A Mobile Overlay Peer-to-Peer Architecture for Scalable Massively Multiplayer Online Games. Master Thesis, The University of British Columbia, 2006.
[33] FreePastry. http://freepastry.rice.edu.
[34] JNI. http://java.sun.com/j2se/1.4.2/docs/guide/jni.
[2] [ISO/IEC14772-l:1997/Amd. 1:2002] VRML97 Amendment 1.
[3] Yi-Jen Chiang, Jihad El-Sana, Peter Lindstrom, Cl'audio T. Silva. Out-Of-Core Algorithms for Scientific Visualization and Computer Graphics. Course Notes for IEEE Visualization, 2002.
[4] Paolo Cignoni, Fabio Ganovelli, Enrico Gobbetti, Fabio Marton, Federico Ponchio, Roberto Scopigno. Adaptive TetraPuzzles: Efficient Out-of-Core Construction and Visualization of Gigantic Multiresolution Polygonal Models. Proc. SIGGRAPH, 2004.
[5] W. T. Corr(?)ea, J. T. Klosowski, C. T. Silva. iWalk. Interactive Out-Of-Core Rendering of Large Models. Technical Report TR-653-02, Princeton University, 2002.
[6] W. T. Corr(?)ea, KLOSOWSKI, J. T., SILVA, C. T. Visibility-based prefetching for interactive out-of-core rendering. In Proceedings of PVG (6th IEEE Symposium on Parallel and Large-Data Visualization and Graphics), 2003.
[7] John Kubiatowicz, David Bindel, Yan Chen, Steven Czerwinski, Patrick Eaton, Dennis Geels, Ramakrishna Gummadi, Sean Rhea, Hakim Weatherspoon, Westley Weimer, Chris Wells, Ben Zhao. OceanStore: An Architecture for Global-Scale Persistent Storage. In Proceedings of the Ninth International Conference on Archi-tectural Support for Programming Languages and Operating Systems, ASPLOS 2000,2000-11.
[8] BitTorrent. http://bitconjurer.org/BitTorrent.
[9] Venugopalan Ramasubramanian, Emin Güun Sirer Beehive. Exploiting Power Law Query Distributions for 0(1) Lookup Performance in Peer to Peer Overlays. In NSDI, 2004.
[10]Skype. http://www.skype.com.
[11]M. Castro, P. Druschel, A-M. Kermarrec, A. Nandi, A. Rowstron, A. Singh. SplitStream: High-bandwidth multicast in a cooperative environment. SOSP'03, Lake Bolton, New York, 2003-10.
[12] Napster, http://www.napster.com.
[13]Gnutella, http://gnutella.wego.com.
[14]Clarke, I. A distributed decentralized information storage and retrieval system. Master's thesis, University of Edinburgh, 1999.
[15]Clarke, I., Sandberg, O., Wiley, B., Hong, T.W. Freenet: A distributed anonymous information storage and retrieval system. In Proceedings of the Workshop on Design Issues in Anonymity and Unobservability, Berkeley, Cali-fornia, 2000-6. http://freenet.sourceforge.net.
[16]I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, H. Balakrishnan. Chord: A scalable peer-to-peer lookup service for Internet applications. In Proc. ACM SIG-COMM, San Diego, CA, 2001-8.
[17]X3D framework - Architecture and base components - Amendment 1. ISO/IEC PDAM (Proposed Draft Amendment) 19775-1:200x.
[18]X3D framework & SAL ISO/IEC FDIS (Final Draft International Standard) 19775:200x.
[19]X3D encodings. ISO/IEC FDIS (Final Draft International Standard) 19776-1:200x.
[20]X3D language bindings. ISO/IEC FDIS (Final Draft International Standard) 19777:200x.
[21] Leonard Daly, Organizer Dr. Don Brutzman, Presenter. Advanced X3D Graphics. Course 6 SIGGRAPH, 2003.
[22] Don Brutzman, Leonard Daly, Nicholas Polys, Joe D. Williams. Introducing X3D. Course 7 SIGGRAPH, 2002.
[23]S.Gottschalk, M.C.Lin, D.Manocha. OBB tree: a hierarchical structure for rapid interference detection. Proc. of ACM Siggraph'96, 1996:171-180.
[24] The Open Group. Technical Standard: DCE 1.1: Remote Procedure Call. 1997.
[25] Stephen D. Huston, James CE Johnson, Umar Syyid. ACE Programmer's Guide, The Practical Design Patterns for Network and Systems Programming. Addison Wesley, 2003.
[26]Douglas C. Schmidt, Stephen D. Huston. C++ Network Programming, Volume 1: Mastering Complexity with ACE and Patterns. Addison Wesley, 2001.
[27]Douglas C. Schmidt, Stephen D. Huston. C++ Network Programming, Volume 2: Systematic Reuse with ACE and Frameworks. Addison Wesley, 2002.
[28]SCHMALSTIEG, D., GERVAUTZ, M. 1996. Demand driven geometry transmission for distributed virtual environments. Computer Graphics Forum 15, 3, 421-433.
[29]Bjorn Knutsson, Honghui Lu, Wei Xu, Bryan Hopkins. Peer-to-Peer Support for Massively Multiplayer Games. In INFOCOM, 2004.
[30]Nobutaka Matsumoto, Yoshihiro Kawahara, Hiroyuki Morikawa, Tomonori Aoyama. A Scalable and Low Delay Communication Scheme for Networked Virtual Environments. GlobeCom Workshops, 2004.
[31]Joaquin Keller, Gwendal Simon. Solipsis: A Massively Multi-Participant Virtual World. In Proc. of PDPTA, 2003:262-268.
[32]Peiqun Yu. MOPAR: A Mobile Overlay Peer-to-Peer Architecture for Scalable Massively Multiplayer Online Games. Master Thesis, The University of British Columbia, 2006.
[33] FreePastry. http://freepastry.rice.edu.
[34] JNI. http://java.sun.com/j2se/1.4.2/docs/guide/jni.