空间数据网格的数据访问与集成技术研究
|
摘要
数据网格是海量数据分布式管理和分析的基础设施,它实现了分布、异构空间数据的统一存储、管理、访问和传输。将数据网格技术应用到空间数据的互操作领域,是解决空间数据有效共享与充分利用问题的一种新的尝试。
本文对空间数据网格的数据访问与集成技术进行了探索性研究,取得了如下主要研究成果:
论述了空间数据网格的支撑技术:Web服务、开放网格服务体系结构(OGSA)及Web服务资源框架(WSRF),提出了空间数据网格的四层体系结构:资源层、基础服务层、服务层、应用层。
在网格环境下,基于空间元数据标准ISO 19115和OGC的目录服务规范(CSW)设计并实现了空间元数据目录服务。
针对空间数据的存储分布性及存储格式的多样性问题,提出了基于GML的空间数据表达与集成框架。分析了空间数据互操作方法的现状,通过扩展OGSA-DAI实现了面向服务的空间数据访问与集成方法。设计与实现了对空间数据文件、GML数据库、空间数据库的访问与集成接口,论述了在网格环境下,OGSA-DAI/GML是解决空间数据互操作问题的最佳方案。
基于GT4设计并开发了一个空间数据网格原型系统,实现了元数据目录服务的数据注册功能、数据文件与GML数据库的访问及集成功能,验证了基于OGSA-DAI/GML的空间数据访问与集成方法的可行性。
Data Grid is the distributed management of large-scale data and the infrastructure analysis; it has implemented uniform storage, management, access and transmission of distributed, heterogeneous data. Apply Data Grid to the interoperability field of spatial data,is a new attempt that solve the problem of sharing spatial data effectively and making full use of it.
This thesis dose research on data access and integration technology of Spatial Data Grid .The main contributions can be summarized as following:
This thesis discusses the support technology of Spatial Data Grid, including Web services, Open Grid Services Architecture (OGSA) and Web Services Resource Framework (WSRF), puts forward Spatial Data Grid four-tier architecture: Resource Layer, Basic Service Layer, Service Layer, and Application Layer.
In the Spatial Grid environment, which is based on the Metadata Standard ISO 19115 and the OGC Catalogue services for Web (CSW) criterion, a Spatial Metadata Catalogue Services is designed and implemented.
For the storage distributing and variety of data storage format, this thesis puts forward a framework expression and integration spatial data based on GML which analyzes the status of the spatial data interoperability method, implements a service-oriented spatial data access and integrated approach by expanding the OGSA-DAI. This thesis also designs and implements the access and integration interfaces for the spatial data files, GML database, spatial database, and discusses in the grid environment, that OGSA-DAI/GML is the best option to solve the problem of spatial data interoperability.
Based on GT4, designes and develops a prototype system of Spatial Data Grid, and implements the data registration function of the Metadata Catalogue Service , data files and GML database access and integration, validates the feasibility of data access and integration method based on OGSA-DAI/GML.
本文对空间数据网格的数据访问与集成技术进行了探索性研究,取得了如下主要研究成果:
论述了空间数据网格的支撑技术:Web服务、开放网格服务体系结构(OGSA)及Web服务资源框架(WSRF),提出了空间数据网格的四层体系结构:资源层、基础服务层、服务层、应用层。
在网格环境下,基于空间元数据标准ISO 19115和OGC的目录服务规范(CSW)设计并实现了空间元数据目录服务。
针对空间数据的存储分布性及存储格式的多样性问题,提出了基于GML的空间数据表达与集成框架。分析了空间数据互操作方法的现状,通过扩展OGSA-DAI实现了面向服务的空间数据访问与集成方法。设计与实现了对空间数据文件、GML数据库、空间数据库的访问与集成接口,论述了在网格环境下,OGSA-DAI/GML是解决空间数据互操作问题的最佳方案。
基于GT4设计并开发了一个空间数据网格原型系统,实现了元数据目录服务的数据注册功能、数据文件与GML数据库的访问及集成功能,验证了基于OGSA-DAI/GML的空间数据访问与集成方法的可行性。
Data Grid is the distributed management of large-scale data and the infrastructure analysis; it has implemented uniform storage, management, access and transmission of distributed, heterogeneous data. Apply Data Grid to the interoperability field of spatial data,is a new attempt that solve the problem of sharing spatial data effectively and making full use of it.
This thesis dose research on data access and integration technology of Spatial Data Grid .The main contributions can be summarized as following:
This thesis discusses the support technology of Spatial Data Grid, including Web services, Open Grid Services Architecture (OGSA) and Web Services Resource Framework (WSRF), puts forward Spatial Data Grid four-tier architecture: Resource Layer, Basic Service Layer, Service Layer, and Application Layer.
In the Spatial Grid environment, which is based on the Metadata Standard ISO 19115 and the OGC Catalogue services for Web (CSW) criterion, a Spatial Metadata Catalogue Services is designed and implemented.
For the storage distributing and variety of data storage format, this thesis puts forward a framework expression and integration spatial data based on GML which analyzes the status of the spatial data interoperability method, implements a service-oriented spatial data access and integrated approach by expanding the OGSA-DAI. This thesis also designs and implements the access and integration interfaces for the spatial data files, GML database, spatial database, and discusses in the grid environment, that OGSA-DAI/GML is the best option to solve the problem of spatial data interoperability.
Based on GT4, designes and develops a prototype system of Spatial Data Grid, and implements the data registration function of the Metadata Catalogue Service , data files and GML database access and integration, validates the feasibility of data access and integration method based on OGSA-DAI/GML.
引文
[1] KESSELMAN F C,TUECKE S. The Anatomy of Grid:enabling scalable virtual organizations [J].Supercomputer Applications,2001(3):5～9
[2]夏靖波,刘颖,汪胜荣.网格原理与开发[M].西安电子科技大学出版社,2006.1(5)
[3]卢亚辉,杨崇俊.基于Web服务的WebGIS系统的研究[J].计算机工程与应用,2003(25)
[4]方金云,何建邦.网格GIS体系结构及其实现技术[J].地球信息科学,2002(4):36～42
[5]王方雄.基于原子服务的网格空间信息服务互操作研究[博士学位论文].武汉:武汉大学, 2005(5):60～61
[6]何戈,徐志伟.数据网格技术研究[J].微电子学与计算机,2003(4)
[7]柴晓路,梁宇齐.Web服务技术、架构和应用[M].北京:电子工业出版社,2003
[8] Foster I,Kesselman C,Nick J,Tuecke S.The Physiology of the Grid:An Open Grid Services Architecture for Distributed Systems Integration[EB/OL].2002.http://www.globus.org/research/papers/ogsa.pdf,2007-8-20
[9] Foster I,Kesselman C,Nick J,Tuecke S.Grid Services for Distributed System tegration[J].IEEE Computer,2002,35(6):37～46
[10] McGovern J,Tyagi S,Stevens M,et al.Java Web服务s Architecture[M],San Fransisco,CA:Morgan Kaufmann Publishers,2007. http;//java.sun.com/developer/Books/j2ee/jwsa/JWSA_CH02.pdf,2007-12-15.
[11] Endrei M,Ang J,Arsanjani A,et al.Patterns:Service-Oriented Architecture and Web服务[EB/OL]. 2004.http://www.redbooks.ibm.com/redbooks/pdfs/sg246303.pdf,2007-12-15
[12] World Wide Web Consortium (W3C) ,Inc. Extensible Markup Language (XML) 1.1 [EB/OL]. http://www.w3.org/TR/2003/PR-xml11-20031105/,2007
[13] World Wide Web Consortium (W3C) ,Inc.Simple ObjectAccess Protocol (SOAP) 1.1[EBIOL].
[14] World Wide Web Consortium (W3C) ,Inc.Web服务s Description Language(WSDL) Version 2.0[EB/OL]. http://www.w3.org/TR/2004/WD-wsd120-20040803/, 2007
[15] UDDI Technical White Paper[EB/OL]. httn://www.uddi.ore/nubs/the evolution of uddi 200207I9.ndf} 2007-12-20
[16] Karl Czajkowski (Globus Alliance/USC Information Sciences Institute), Donald F Ferguson (IBM),Ian Foster (Globus Alliance/Argonne National Laboratory), Jeffrey Frey (IBM),Steve Graham (IBM),Igor Sedukhin (Computer Associates International),David Spelling (Fujitsu Laboratories of Europe), Steve Tuecke (Globus Alliance/Argonne National Laboratory), William Vambenepe (Hewlett-Packard).The WS-Resource Framework(Version 1.0), 2007-09-03
[17] Foster I, Kesselman C, Tuecke S. The Anatomy of the Grid: Enabling Scalable Virtual Organizations [J). High-Performance Computing Applications, 2001,15(3): 200222; http://www.globus.org/research/papers/anatomy.pdf,2007-11
[18]蔡少华,骆剑承,沈占锋,郑江,陈秋晓.基于OGSA的网格地理信息系统体系结构研究.中国地理信息系统协会第三次代表大会暨第七届年会,2003.11,论文集.北京
[19] Borja S. The Globus Toolkit 4 Programmer's Tutorial}ZJ. http://gdp.globus.org/Globus Toolkits 4-tutorial/singlchtml/ progtutorial_0.1.html,2007-12
[21] M. Antonioletti, N.P. Chue Hong, A.C. Hume,M. Jackson,K. Karasavvas,A. Krause,J.M. Schopf,M.P. Atkinson,B. Dobrzelecki,M. Illingworth,N. McDonnell,M. Parsons and E. Theocharopoulos. OGSA-DAI 3.0 The Whats and the Whys. Proceedings of the UK e-Science All Hands Meeting 2007,September 2007. http://www.ogsadai.org.uk/documentation/publications/AHM2007_OGSA-DAI_WhatAndWhy.pdf
[22]闾国年,张书亮等.地理信息共享技术[M].北京:科学出版社. 2007.
[23] OGSA-DAI Project, http://www.ogsadai.org.uk/, 2007-11.
[24] Open Middleware Infrastructure Institute– UK,http://www.omii.uk/,2007-8-12.
[25] AstroGrid, http://www.astrogrid.org/,2007-8-24.
[26] DGEMap (Developmental Gene Expression Map),http://www.dgemap.org/,2007-10-5.
[27] OGSA-DAI– projects using OGSA-DAI, http://www.ogsadai.org.uk/about/projects.php,2007-10.
[28] OGSA-DAI 3.0 design documentation,http://www.ogsadai.org.uk/documentation/release3.0/,2007-8.
[29] Alpdemir, M.N., Arijit M., Gounaris, A., Paton,N.M., Watson, P., Fernandes, A.A.A, and Fizgerald, D.J. OGSA-DQP: A Service for Distributed Querying on the Grid. Editors: E.Bertino, S. Christodoulakis, D. Plexousakis, V.Christophides, M. Koubarakis, K. Boehm, Elena Ferrari. Advances in Database Technology– EDBT 2004: 9th International Conference on Extending Database Technology, Heraklion, Crete, Greece,March 14-18, 2004. Lecture Notes in Computer Science, Volume 2992, pp858-861, 2004
[30] FGDC. Content Standard for Digital Geospatlal Metadata, Metadata Ad Hoc Working Group, Federal Geographic Data Committee. 1998. http://www.fdgc/gov.
[31] ISO/TC211.Geographic Information一Metadata (ISO/DIS 19115) [EB/OL]. 2001. http://www.statkart.no/isotc211/scope.htm#19115, 2007-12-5.
[32] Liping Di, Peisheng Zhao, Weiguo Han, Yaxing Wei, Xiaoyan Li. Web服务一based GeoBrain Online Analysis System (GeOnAS).
[33] OGSA-DAI WSRF 2.2 User Guide. The University of Edinburgh. 2002-2006.
[34] ISO/TC 211 /WG 4/PT 19136 Geographic information一Geography Markup Language (GML).
[35] Open Geospatial Consortium. OpenGIS. Catalogue Services Specification. 2007-02-23.Version 2.0.2, Corrigendum 2 Release
[36]黄裕霞,Cliff Kottman,柯正谊,何建邦.可互操作的GIS研究[[J],中国图象图形学报,2001(6A): 925一931.
[37] Levinsohn A. Geospatlal Interoperability: The Holy Grail of GIS [J]. GeoWorld, 2000( I 0).
[38]金宝轩.网格计算环境下的3维空间信息应用研究[博士学位论文].武汉:武汉大学,2005(4):63～64.
[39]承继成,林珲,周成虎,曾杉.数字地球导论[M].北京:科学出版社,2000.
[2]夏靖波,刘颖,汪胜荣.网格原理与开发[M].西安电子科技大学出版社,2006.1(5)
[3]卢亚辉,杨崇俊.基于Web服务的WebGIS系统的研究[J].计算机工程与应用,2003(25)
[4]方金云,何建邦.网格GIS体系结构及其实现技术[J].地球信息科学,2002(4):36～42
[5]王方雄.基于原子服务的网格空间信息服务互操作研究[博士学位论文].武汉:武汉大学, 2005(5):60～61
[6]何戈,徐志伟.数据网格技术研究[J].微电子学与计算机,2003(4)
[7]柴晓路,梁宇齐.Web服务技术、架构和应用[M].北京:电子工业出版社,2003
[8] Foster I,Kesselman C,Nick J,Tuecke S.The Physiology of the Grid:An Open Grid Services Architecture for Distributed Systems Integration[EB/OL].2002.http://www.globus.org/research/papers/ogsa.pdf,2007-8-20
[9] Foster I,Kesselman C,Nick J,Tuecke S.Grid Services for Distributed System tegration[J].IEEE Computer,2002,35(6):37～46
[10] McGovern J,Tyagi S,Stevens M,et al.Java Web服务s Architecture[M],San Fransisco,CA:Morgan Kaufmann Publishers,2007. http;//java.sun.com/developer/Books/j2ee/jwsa/JWSA_CH02.pdf,2007-12-15.
[11] Endrei M,Ang J,Arsanjani A,et al.Patterns:Service-Oriented Architecture and Web服务[EB/OL]. 2004.http://www.redbooks.ibm.com/redbooks/pdfs/sg246303.pdf,2007-12-15
[12] World Wide Web Consortium (W3C) ,Inc. Extensible Markup Language (XML) 1.1 [EB/OL]. http://www.w3.org/TR/2003/PR-xml11-20031105/,2007
[13] World Wide Web Consortium (W3C) ,Inc.Simple ObjectAccess Protocol (SOAP) 1.1[EBIOL].
[14] World Wide Web Consortium (W3C) ,Inc.Web服务s Description Language(WSDL) Version 2.0[EB/OL]. http://www.w3.org/TR/2004/WD-wsd120-20040803/, 2007
[15] UDDI Technical White Paper[EB/OL]. httn://www.uddi.ore/nubs/the evolution of uddi 200207I9.ndf} 2007-12-20
[16] Karl Czajkowski (Globus Alliance/USC Information Sciences Institute), Donald F Ferguson (IBM),Ian Foster (Globus Alliance/Argonne National Laboratory), Jeffrey Frey (IBM),Steve Graham (IBM),Igor Sedukhin (Computer Associates International),David Spelling (Fujitsu Laboratories of Europe), Steve Tuecke (Globus Alliance/Argonne National Laboratory), William Vambenepe (Hewlett-Packard).The WS-Resource Framework(Version 1.0), 2007-09-03
[17] Foster I, Kesselman C, Tuecke S. The Anatomy of the Grid: Enabling Scalable Virtual Organizations [J). High-Performance Computing Applications, 2001,15(3): 200222; http://www.globus.org/research/papers/anatomy.pdf,2007-11
[18]蔡少华,骆剑承,沈占锋,郑江,陈秋晓.基于OGSA的网格地理信息系统体系结构研究.中国地理信息系统协会第三次代表大会暨第七届年会,2003.11,论文集.北京
[19] Borja S. The Globus Toolkit 4 Programmer's Tutorial}ZJ. http://gdp.globus.org/Globus Toolkits 4-tutorial/singlchtml/ progtutorial_0.1.html,2007-12
[21] M. Antonioletti, N.P. Chue Hong, A.C. Hume,M. Jackson,K. Karasavvas,A. Krause,J.M. Schopf,M.P. Atkinson,B. Dobrzelecki,M. Illingworth,N. McDonnell,M. Parsons and E. Theocharopoulos. OGSA-DAI 3.0 The Whats and the Whys. Proceedings of the UK e-Science All Hands Meeting 2007,September 2007. http://www.ogsadai.org.uk/documentation/publications/AHM2007_OGSA-DAI_WhatAndWhy.pdf
[22]闾国年,张书亮等.地理信息共享技术[M].北京:科学出版社. 2007.
[23] OGSA-DAI Project, http://www.ogsadai.org.uk/, 2007-11.
[24] Open Middleware Infrastructure Institute– UK,http://www.omii.uk/,2007-8-12.
[25] AstroGrid, http://www.astrogrid.org/,2007-8-24.
[26] DGEMap (Developmental Gene Expression Map),http://www.dgemap.org/,2007-10-5.
[27] OGSA-DAI– projects using OGSA-DAI, http://www.ogsadai.org.uk/about/projects.php,2007-10.
[28] OGSA-DAI 3.0 design documentation,http://www.ogsadai.org.uk/documentation/release3.0/,2007-8.
[29] Alpdemir, M.N., Arijit M., Gounaris, A., Paton,N.M., Watson, P., Fernandes, A.A.A, and Fizgerald, D.J. OGSA-DQP: A Service for Distributed Querying on the Grid. Editors: E.Bertino, S. Christodoulakis, D. Plexousakis, V.Christophides, M. Koubarakis, K. Boehm, Elena Ferrari. Advances in Database Technology– EDBT 2004: 9th International Conference on Extending Database Technology, Heraklion, Crete, Greece,March 14-18, 2004. Lecture Notes in Computer Science, Volume 2992, pp858-861, 2004
[30] FGDC. Content Standard for Digital Geospatlal Metadata, Metadata Ad Hoc Working Group, Federal Geographic Data Committee. 1998. http://www.fdgc/gov.
[31] ISO/TC211.Geographic Information一Metadata (ISO/DIS 19115) [EB/OL]. 2001. http://www.statkart.no/isotc211/scope.htm#19115, 2007-12-5.
[32] Liping Di, Peisheng Zhao, Weiguo Han, Yaxing Wei, Xiaoyan Li. Web服务一based GeoBrain Online Analysis System (GeOnAS).
[33] OGSA-DAI WSRF 2.2 User Guide. The University of Edinburgh. 2002-2006.
[34] ISO/TC 211 /WG 4/PT 19136 Geographic information一Geography Markup Language (GML).
[35] Open Geospatial Consortium. OpenGIS. Catalogue Services Specification. 2007-02-23.Version 2.0.2, Corrigendum 2 Release
[36]黄裕霞,Cliff Kottman,柯正谊,何建邦.可互操作的GIS研究[[J],中国图象图形学报,2001(6A): 925一931.
[37] Levinsohn A. Geospatlal Interoperability: The Holy Grail of GIS [J]. GeoWorld, 2000( I 0).
[38]金宝轩.网格计算环境下的3维空间信息应用研究[博士学位论文].武汉:武汉大学,2005(4):63～64.
[39]承继成,林珲,周成虎,曾杉.数字地球导论[M].北京:科学出版社,2000.