面向Web地图服务的数据一致性维护技术的研究
|
摘要
在网络信息时代中,信息量庞大,且信息模式多样。XML作为兼具可扩展性及灵活性的通用数据传输格式,越来越多地被人们用来表示异构数据,以克服多数据源的不一致性,从而达到信息整合的目的。因此,XML数据视图广泛地应用于各种Web应用系统中,针对常用的数据信息建立物化视图已经成为提高XML数据查询效率的重要手段。然而,物化视图与数据源之间的一致性维护却面临新的挑战。
在众多的Web应用系统中,对于提供地理数据的Web地图服务(WMS)系统来说,由于表示地图的数据量大,而网络资源有限,因此对XML数据处理性能有更迫切的要求。
本文为解决Web应用系统,特别是Web地图服务系统中的查询性能优化问题,以及数据一致性问题,提出了一种面向Web地图服务的物化视图增量维护方法,该方法能够依据后台地图数据的变化对Web客户端的物化视图进行一致性增量维护,并且给出了面向WMS系统的XPath物化视图的增量维护系统框架。在此基础上,重点探讨了面向WMS的物化视图增量维护的一些关键技术。
作者依据面向WMS的XPath物化视图增量维护方法,设计并实现了一个通用的物化视图增量维护系统框架。该框架能够为客户提供定制的Web地图高效查询,它可以应用于支持OpenGIS简单要素规范的空间数据存储方式,并且能提供Web地图服务的空间数据库系统,从而支持高性能Web地图查询系统的实现。
在物化视图增量维护系统的实现中,本文采用了自动触发等相关技术,实现了在物化视图增量维护过程中变更的自动捕获及处理机制,有效地将数据源的变更快速准确地捕获,并为视图的增量维护所用。在物化视图增量维护过程中的各种处理的协调方面,采用同步控制技术,有效地协调控制物化视图增量维护过程中的客户查询及后台数据源变更。此外,本文研究了增量计算程序代码生成方法的探索查询实现技术,实现了面向WMS的物化视图增量维护系统框架的系统整合。
As the Web-based technique is widely applied, the volume of information increases, and the format of information is various. XML, which is the general communication format of data, is scalable and flexible, and it is widely used to eliminate the flaw brought up by the isomeric data sources to meet the goal of information integration. Therefore, XML views are widely used in various Web systems. It is an important way that materializes views for data frequently used to increase the efficiency of XML querying. However, there are some new challenges in keeping consistency between materialized views and their data sources.
In many Web systems, especially for Web map services system which provides geographical data, it is emergent to improve the performance of XML data processing because of the great amount of map and the limited network resource.
For the problems of query performance and the data consistency in Web systems, especially in Web map service systems, this paper provides a WMS-oriented incremental maintenance way for materialized views, in which you can maintain the materialized view at client side incrementally according to the change of geographical data, and give the architecture. In the basic of this way, this paper discusses some key technologies.
Based on the way of WMS-oriented incremental maintenance for materialized XPath views, the author has designed and implemented a common architecture of incremental maintenance for materialized views. It provides the capability of querying Web maps, and allows the user to customize the query expression. This can be used as the fundamental architecture of spatial database systems which support the spatial data schema in the OpenGIS simple feature specification and can provide Web map services, to implement the high efficiency of Web map query systems.
For the implementation of incremental maintenance systems for materialized views, this paper adopts the automation triggering technique to provide the mechanism of catching and processing changes automatically which can quickly and accurately get the change. For the coordination, let the querying and changing work well, using the synchronization control. Further more, this paper considers the implementation method for exploring query, and integrates the subsystems in WMS-oriented system architecture of incremental maintenance for materialized views.
在众多的Web应用系统中,对于提供地理数据的Web地图服务(WMS)系统来说,由于表示地图的数据量大,而网络资源有限,因此对XML数据处理性能有更迫切的要求。
本文为解决Web应用系统,特别是Web地图服务系统中的查询性能优化问题,以及数据一致性问题,提出了一种面向Web地图服务的物化视图增量维护方法,该方法能够依据后台地图数据的变化对Web客户端的物化视图进行一致性增量维护,并且给出了面向WMS系统的XPath物化视图的增量维护系统框架。在此基础上,重点探讨了面向WMS的物化视图增量维护的一些关键技术。
作者依据面向WMS的XPath物化视图增量维护方法,设计并实现了一个通用的物化视图增量维护系统框架。该框架能够为客户提供定制的Web地图高效查询,它可以应用于支持OpenGIS简单要素规范的空间数据存储方式,并且能提供Web地图服务的空间数据库系统,从而支持高性能Web地图查询系统的实现。
在物化视图增量维护系统的实现中,本文采用了自动触发等相关技术,实现了在物化视图增量维护过程中变更的自动捕获及处理机制,有效地将数据源的变更快速准确地捕获,并为视图的增量维护所用。在物化视图增量维护过程中的各种处理的协调方面,采用同步控制技术,有效地协调控制物化视图增量维护过程中的客户查询及后台数据源变更。此外,本文研究了增量计算程序代码生成方法的探索查询实现技术,实现了面向WMS的物化视图增量维护系统框架的系统整合。
As the Web-based technique is widely applied, the volume of information increases, and the format of information is various. XML, which is the general communication format of data, is scalable and flexible, and it is widely used to eliminate the flaw brought up by the isomeric data sources to meet the goal of information integration. Therefore, XML views are widely used in various Web systems. It is an important way that materializes views for data frequently used to increase the efficiency of XML querying. However, there are some new challenges in keeping consistency between materialized views and their data sources.
In many Web systems, especially for Web map services system which provides geographical data, it is emergent to improve the performance of XML data processing because of the great amount of map and the limited network resource.
For the problems of query performance and the data consistency in Web systems, especially in Web map service systems, this paper provides a WMS-oriented incremental maintenance way for materialized views, in which you can maintain the materialized view at client side incrementally according to the change of geographical data, and give the architecture. In the basic of this way, this paper discusses some key technologies.
Based on the way of WMS-oriented incremental maintenance for materialized XPath views, the author has designed and implemented a common architecture of incremental maintenance for materialized views. It provides the capability of querying Web maps, and allows the user to customize the query expression. This can be used as the fundamental architecture of spatial database systems which support the spatial data schema in the OpenGIS simple feature specification and can provide Web map services, to implement the high efficiency of Web map query systems.
For the implementation of incremental maintenance systems for materialized views, this paper adopts the automation triggering technique to provide the mechanism of catching and processing changes automatically which can quickly and accurately get the change. For the coordination, let the querying and changing work well, using the synchronization control. Further more, this paper considers the implementation method for exploring query, and integrates the subsystems in WMS-oriented system architecture of incremental maintenance for materialized views.
引文
1 Blakeley, J. A., Larson, P., Tompa, F.W. Efficiently Updating Materialized Views. In Proceedings of the 1986 ACM SIGMOD international conference, 1986.
2 Ashish Gupta, Inderpal Singh Mumick. Maintenance of materialized views: Problems and techniques and applications[C]. IEEE Data Engineering Bulletin. 1995,18(2):3–18
3 廖湖声, 吴冰. 一个基于部分求值的增量式数据库引擎. 计算机工程与设计. 2000.10(21):5–8
4 A Gupta, IS Mumick, VS Subrahmanian. Maintaining Views Incrementally. The 1993 ACM SIGMOD international conference. 1993:157–166.
5 W3C. Extensible Markup Language (XML) Version 1.0 (Fouth Edition). W3C Recommendation. 2006.8
6 Michael Rys, Don Chamberlin. XML and relational database management systems: the inside story. Proceedings of the 2005 ACM SIGMOD international conference, 2005. ACM Press,2005:945–947
7 Abiteboul S, et al. Incremental Maintenance for Materialized Views over Semistructured Data. In Procedings of the 24th International Conference on Very Large Databases. 1998:2-24.
8 Web Map Service Implementation Specification, Version 1.3. Open GIS Consortium Inc.
9 W3C Scalable Vector Graphic (SVG) 1.0 Specification.
10 刘啸, 毕永年. 基于 XML 的 SVG 应用指南. 北京科海培训中心, 2003
11 Styled Layer Descriptor Implementation Specification, Version1.0.0. Open GIS Consortium Inc.
12 Maged EL–Sayed, Ling Wang. An algebraic approach for incremental maintenance of materialized XQuery views. Proceedings of the 4th international workshop on Web information and data management, 2002. ACM Press, 2002:88–91
13 Katica Dimitrova, Maged El–Sayed, Elke A.Rundensteiner. Order–sensitive view maintenance of materialized xquery views. ER, Springer–Verlag Berlin Heidelberg,2003. 2003:144–157.
14 W3C. XML Path Language (XPath). Version 1.0. W3C Recommendation. 1999.10.
15 张昱, 付雄. 含 XPath 的表达式的解析与应用. 小型微型计算机系统. 2004.4(25):3–5
16 Xueyun Jin, et al. Maintaining Materialized XPath Views Incrementally by Program Transformation. In Proceedings of the 2nd ICCSE. 2007.
17 Kenneth Messa, Bogdan Czejdo. Using XML views for improving graphical query specifications. Journal of Computing Sciences in Colleges. 2005, 20(6):170–179
18 全立新. 使用 Java 编写 Oracle 触发器的实现. 计算机与现代化. 2004.10
19 Steven Feuerstein, Bill Pribyl. Oracle PL/SQL Programming. O'Reilly. August 2005
20 李代平. Oracle9i 应用系统开发技术. 冶金工业出版社. 2004
21 来宾, 谭明勇. 数据库原理与应用. 冶金工业出版社. 2003
22 H.Matsumura, K.Tajima. Incremental Evaluation of a Monotone XPath Fragment. The 14th ACM international conference on Information and knowledge management,2005. 2005:245–246.
23 曾春平, 王超和张鹏等. XML 编程从入门到精通. 北京希望电子出版社, 2002
24 Harvard University WMS (Distributed) Servers. http://www.gis.harvard.edu/
25 Dae Hyun Hwang and Hyun Chul Kang. XML View Materialization with Deferred Incremental Refresh. Journal of Information Science and Engineering 21, 1083-1119, 2005
26 W3C. XSL Transformations (XSLT) Version 1.0. W3C Recommendation 16, November 1999
27 Makoto Onizuka, Fong Yee Chan, Ryusuke Michigami and Takashi Honishi. Incremental Maintenance for Materialized XPath/XSLT Views. World Wide Web Conference Committee (IW3C2), May 2005
28 W3C. XQuery 1.0: An XML Query Language. W3C Candidate Recommendation 3, November 2005
29 Howard Katz Editor, Don Chamberlin, Denise Draper, Mary Fernández, Michael Kay, Jonathan Robie, Michael Rys, Jér?me Siméon, Jim Tivy and Philip Wadler. XQuery from the Experts: A Guide to the W3C XML Query Language. Addison Wesley, August 29, 2003
30 Arsany Sawires, Junichi Tatemura,Oliver Po. Incremental Maintenance of Path–Expression Views. SIGMOD Conference,2005. 2005:443–454
31 孟彦, 廖湖声, 金雪云. 面向 XML 物化视图远程增量维护的版本管理技术研究. 计算机工程与设计. 2008.12
32 Open GIS Consortium, Inc. OpenGISò Simple Features Specification For SQL Revision 1.1. OpenGIS Project Document 99-049, 1999
33 Chuck Murray. Oracle? Spatial User’s Guide and Reference Release 8.1.7. Oracle Corporation, 2000
34 结城浩. JAVA 多线程设计模式. 中国铁道出版社,2005:35–42
35 Bruce Eckel. Thinking In Java. Java 编程思想. 机械工业出版社,1999:230-250
36 Joshua Bloch 著. 潘爱民 译. Effective Java. 机械工业出版社,2003:27-35
37 Oracle. Developing Stored Procedures In JavaTM. April 1999
38 汤子瀛, 哲凤屏, 汤小丹. 计算机操作系统. 第 2 版. 西安电子科技大学出版社. 2001:46-49
39 Phil Locke. Oraclea Call Interface Programmer’s Guide Release 8.1.6. Oracle Corporation, 1999
40 Hyunchul Kang, Hosang Sung and ChanHo Moon. Deferred Incremental Refresh of XML Materialized Views: Algorithms and Performance Evaluation. ADC2003, 2003
41 Andrew S.Tanenbaum. 分布式系统:原理与范例. 清华大学出版社,2002:10–23
42 刘润东. UML 对象设计与编程. 北京希望电子出版社,2001:23–30
43 Erich G., Richard H., Ralph J., John V. Design Patterns: Elements of Reusable Object Oriented Software, Addison Wesley Longman, Inc. 李英军等译,设计模式:可复用面向对象软件设计的基础. 机械工业出版社,2000:17–29
44 王元珍, 陈懿. 地图应用中层次—关系型 DBMS 的实视图及其增量维护. 微型机与应用第 2 期, 2000
45 王蒙智, 刘宏亮和施伯乐. 半结构化数据视图的增量维护. 计算机研究与发展, 2001
46 杨存东, 申瑞民. OODB 中连接视图的物化和增量保持技术. 计算机辅助设计与图形学学报, 2002
47 Parand Tony Darugar, Effective XML processing with DOM and XPath in Java. IBM, 2001
48 Peter Buneman. Semistructured Data. PODS’97, 1997
2 Ashish Gupta, Inderpal Singh Mumick. Maintenance of materialized views: Problems and techniques and applications[C]. IEEE Data Engineering Bulletin. 1995,18(2):3–18
3 廖湖声, 吴冰. 一个基于部分求值的增量式数据库引擎. 计算机工程与设计. 2000.10(21):5–8
4 A Gupta, IS Mumick, VS Subrahmanian. Maintaining Views Incrementally. The 1993 ACM SIGMOD international conference. 1993:157–166.
5 W3C. Extensible Markup Language (XML) Version 1.0 (Fouth Edition). W3C Recommendation. 2006.8
6 Michael Rys, Don Chamberlin. XML and relational database management systems: the inside story. Proceedings of the 2005 ACM SIGMOD international conference, 2005. ACM Press,2005:945–947
7 Abiteboul S, et al. Incremental Maintenance for Materialized Views over Semistructured Data. In Procedings of the 24th International Conference on Very Large Databases. 1998:2-24.
8 Web Map Service Implementation Specification, Version 1.3. Open GIS Consortium Inc.
9 W3C Scalable Vector Graphic (SVG) 1.0 Specification.
10 刘啸, 毕永年. 基于 XML 的 SVG 应用指南. 北京科海培训中心, 2003
11 Styled Layer Descriptor Implementation Specification, Version1.0.0. Open GIS Consortium Inc.
12 Maged EL–Sayed, Ling Wang. An algebraic approach for incremental maintenance of materialized XQuery views. Proceedings of the 4th international workshop on Web information and data management, 2002. ACM Press, 2002:88–91
13 Katica Dimitrova, Maged El–Sayed, Elke A.Rundensteiner. Order–sensitive view maintenance of materialized xquery views. ER, Springer–Verlag Berlin Heidelberg,2003. 2003:144–157.
14 W3C. XML Path Language (XPath). Version 1.0. W3C Recommendation. 1999.10.
15 张昱, 付雄. 含 XPath 的表达式的解析与应用. 小型微型计算机系统. 2004.4(25):3–5
16 Xueyun Jin, et al. Maintaining Materialized XPath Views Incrementally by Program Transformation. In Proceedings of the 2nd ICCSE. 2007.
17 Kenneth Messa, Bogdan Czejdo. Using XML views for improving graphical query specifications. Journal of Computing Sciences in Colleges. 2005, 20(6):170–179
18 全立新. 使用 Java 编写 Oracle 触发器的实现. 计算机与现代化. 2004.10
19 Steven Feuerstein, Bill Pribyl. Oracle PL/SQL Programming. O'Reilly. August 2005
20 李代平. Oracle9i 应用系统开发技术. 冶金工业出版社. 2004
21 来宾, 谭明勇. 数据库原理与应用. 冶金工业出版社. 2003
22 H.Matsumura, K.Tajima. Incremental Evaluation of a Monotone XPath Fragment. The 14th ACM international conference on Information and knowledge management,2005. 2005:245–246.
23 曾春平, 王超和张鹏等. XML 编程从入门到精通. 北京希望电子出版社, 2002
24 Harvard University WMS (Distributed) Servers. http://www.gis.harvard.edu/
25 Dae Hyun Hwang and Hyun Chul Kang. XML View Materialization with Deferred Incremental Refresh. Journal of Information Science and Engineering 21, 1083-1119, 2005
26 W3C. XSL Transformations (XSLT) Version 1.0. W3C Recommendation 16, November 1999
27 Makoto Onizuka, Fong Yee Chan, Ryusuke Michigami and Takashi Honishi. Incremental Maintenance for Materialized XPath/XSLT Views. World Wide Web Conference Committee (IW3C2), May 2005
28 W3C. XQuery 1.0: An XML Query Language. W3C Candidate Recommendation 3, November 2005
29 Howard Katz Editor, Don Chamberlin, Denise Draper, Mary Fernández, Michael Kay, Jonathan Robie, Michael Rys, Jér?me Siméon, Jim Tivy and Philip Wadler. XQuery from the Experts: A Guide to the W3C XML Query Language. Addison Wesley, August 29, 2003
30 Arsany Sawires, Junichi Tatemura,Oliver Po. Incremental Maintenance of Path–Expression Views. SIGMOD Conference,2005. 2005:443–454
31 孟彦, 廖湖声, 金雪云. 面向 XML 物化视图远程增量维护的版本管理技术研究. 计算机工程与设计. 2008.12
32 Open GIS Consortium, Inc. OpenGISò Simple Features Specification For SQL Revision 1.1. OpenGIS Project Document 99-049, 1999
33 Chuck Murray. Oracle? Spatial User’s Guide and Reference Release 8.1.7. Oracle Corporation, 2000
34 结城浩. JAVA 多线程设计模式. 中国铁道出版社,2005:35–42
35 Bruce Eckel. Thinking In Java. Java 编程思想. 机械工业出版社,1999:230-250
36 Joshua Bloch 著. 潘爱民 译. Effective Java. 机械工业出版社,2003:27-35
37 Oracle. Developing Stored Procedures In JavaTM. April 1999
38 汤子瀛, 哲凤屏, 汤小丹. 计算机操作系统. 第 2 版. 西安电子科技大学出版社. 2001:46-49
39 Phil Locke. Oraclea Call Interface Programmer’s Guide Release 8.1.6. Oracle Corporation, 1999
40 Hyunchul Kang, Hosang Sung and ChanHo Moon. Deferred Incremental Refresh of XML Materialized Views: Algorithms and Performance Evaluation. ADC2003, 2003
41 Andrew S.Tanenbaum. 分布式系统:原理与范例. 清华大学出版社,2002:10–23
42 刘润东. UML 对象设计与编程. 北京希望电子出版社,2001:23–30
43 Erich G., Richard H., Ralph J., John V. Design Patterns: Elements of Reusable Object Oriented Software, Addison Wesley Longman, Inc. 李英军等译,设计模式:可复用面向对象软件设计的基础. 机械工业出版社,2000:17–29
44 王元珍, 陈懿. 地图应用中层次—关系型 DBMS 的实视图及其增量维护. 微型机与应用第 2 期, 2000
45 王蒙智, 刘宏亮和施伯乐. 半结构化数据视图的增量维护. 计算机研究与发展, 2001
46 杨存东, 申瑞民. OODB 中连接视图的物化和增量保持技术. 计算机辅助设计与图形学学报, 2002
47 Parand Tony Darugar, Effective XML processing with DOM and XPath in Java. IBM, 2001
48 Peter Buneman. Semistructured Data. PODS’97, 1997