政务信息化建设中数据整合技术的研究与应用
|
摘要
当前,我国各级政府行政方式开始逐渐打破原有的条块壁垒,向“一站式”方向发展,越来越多的政府职能需要跨地域、跨部门联合完成。这就要求我国政务信息化建设必须充分利用己有的网络基础、业务系统和信息资源,加强整合,促进互联互通、信息共享,使有限的资源发挥最大效益。这一发展趋势充分表明,目前我国政务信息化建设的重点己经由业务信息化逐渐转向信息资源的整合共享和开发利用。于是,数据整合已成为我国政务信息化基础设施建设的重点。
政府门户网站是提供“一站式”公共服务和整合发布政务信息的窗口。针对这一需求,航天四创及时推出了内容管理产品ASOP-CMP,它很好的解决了对非结构化数据的统一管理问题,数据共享的矛盾并不突出。因此,本文侧重于如何对结构化数据进行整合,提出了一个基于CWM&XMI的标准化的数据整合模型和实现方案。
论文对国内外数据整合技术的发展现状以及发展趋势进行了深入地调查与研究,了解了现有数据整合产品的不足,总结出一个基于CWM&XMI的数据整合模型。DCP模型采用集中式资源管理模式,数据中心对整个数据整合过程进行集中控制和管理,适配器作为业务系统的代理在元数据信息的控制下与数据中心通过Web Service调用完成数据的交换和共享。ASOP-DCP是一个基于Java技术的对该模型的实现原型,文中首先给出了系统的实现目标并对功能模块进行划分,接着对其中一些关键问题进行了细致的设计。最后,将ASOP-DCP作为ASOP-CMP功能的重要扩展,成功应用在了实际项目之中,验证了模型的可行性与实用性。
At present, administrative mode of governments at all levels begins to break the barriers gradually. More and more government's jobs need to be completed in a way of inter-departmental joint. All requires that China's government information construction must make full use of own network infrastructure, business systems and information resources, strengthen integration, promote interoperability and share information so that the limited resources to achieve maximum efficiency. This trend shows that China's government information construction has began to convert from building business systems to integrating information resources. Therefore, data conformity is becoming emphases in the foundation establishment of China's government information construction. The government's portal site should be a window which to provide "one-station" services and release government affair information. In response to this demand, Aerostrong company developed timely a content management product (ASOP-CMP). It is a good solution for the unstructured data management, so conflicts of data sharing were not prominent. Therefore, the dissertation focuses on how to integrate structure data and present a model based on CWM&XMI
The dissertation first carried on thoroughly investigation and research to the present status of data conformity technology in domestic and foreign. Understanding the inadequacies of the existing data integration product, we conclude a data conformity modal based on CWM&XMI. DCP model introduces a kind of mode named centralized resource management mode. Data center carried out centralized control and management in the process of data conformity. As a application's agent, the adapter exchanges and shares data with data center through Web Service and Meta-data. ASOP-DCP is a Java-based prototype of this model. This dissertation first advanced a goal of the realization and divide system functions into different modules. Then some of the key issues is designed in detail. Finally, being a important extension to ASOP-CMP, ASOP-DCP has been applied in practical project and it proved the feasibility and the usability.
政府门户网站是提供“一站式”公共服务和整合发布政务信息的窗口。针对这一需求,航天四创及时推出了内容管理产品ASOP-CMP,它很好的解决了对非结构化数据的统一管理问题,数据共享的矛盾并不突出。因此,本文侧重于如何对结构化数据进行整合,提出了一个基于CWM&XMI的标准化的数据整合模型和实现方案。
论文对国内外数据整合技术的发展现状以及发展趋势进行了深入地调查与研究,了解了现有数据整合产品的不足,总结出一个基于CWM&XMI的数据整合模型。DCP模型采用集中式资源管理模式,数据中心对整个数据整合过程进行集中控制和管理,适配器作为业务系统的代理在元数据信息的控制下与数据中心通过Web Service调用完成数据的交换和共享。ASOP-DCP是一个基于Java技术的对该模型的实现原型,文中首先给出了系统的实现目标并对功能模块进行划分,接着对其中一些关键问题进行了细致的设计。最后,将ASOP-DCP作为ASOP-CMP功能的重要扩展,成功应用在了实际项目之中,验证了模型的可行性与实用性。
At present, administrative mode of governments at all levels begins to break the barriers gradually. More and more government's jobs need to be completed in a way of inter-departmental joint. All requires that China's government information construction must make full use of own network infrastructure, business systems and information resources, strengthen integration, promote interoperability and share information so that the limited resources to achieve maximum efficiency. This trend shows that China's government information construction has began to convert from building business systems to integrating information resources. Therefore, data conformity is becoming emphases in the foundation establishment of China's government information construction. The government's portal site should be a window which to provide "one-station" services and release government affair information. In response to this demand, Aerostrong company developed timely a content management product (ASOP-CMP). It is a good solution for the unstructured data management, so conflicts of data sharing were not prominent. Therefore, the dissertation focuses on how to integrate structure data and present a model based on CWM&XMI
The dissertation first carried on thoroughly investigation and research to the present status of data conformity technology in domestic and foreign. Understanding the inadequacies of the existing data integration product, we conclude a data conformity modal based on CWM&XMI. DCP model introduces a kind of mode named centralized resource management mode. Data center carried out centralized control and management in the process of data conformity. As a application's agent, the adapter exchanges and shares data with data center through Web Service and Meta-data. ASOP-DCP is a Java-based prototype of this model. This dissertation first advanced a goal of the realization and divide system functions into different modules. Then some of the key issues is designed in detail. Finally, being a important extension to ASOP-CMP, ASOP-DCP has been applied in practical project and it proved the feasibility and the usability.
引文
1 “沉睡信息”亟等唤醒. 参政消息—北京参考,2006.05.10
2 在连贯信息环境中管理元数据:21世纪企业成功的根本要素. IT经理世界网, 2006.04
3 中国航天工程咨询中心项目部. 罪犯数据库整体解决方案,2006.04.20
4 中关村科技软件有限公司. 中关通用电子政务系统(CenEG)简介
5 胡克瑾,刘义理. 信息资源管理. 同济大学出版社,2004.02
6 胡昌平. 现代信息管理机制研究. 武汉大学出版社,2004.07
7 林宇. 数据仓库原理与实践. 人民邮电出版社,2003.01
8 东方通科技有限公司. TongLink/Q 白皮书
9 T1soft. 中国人民大学统计数据库研究. 数据整合解决方案,2006
10 高复先. 信息资源规划---信息化基础建设工程. 清华大学出版社,2002.04
11 田志博,孙政顺. 基于 WEB 的数据整合与发布系统的设计与实现. 小型微型计算机系统,Vol.24 No.12 Dec.2003
12 孙卫琴. Java 面向对象编程. 电子工业出版社,2006.06
13 徐春金. Tuxedo 中间件开发与配置. 中国电力出版社,2003.07
14 邵敏,李力鸿,郑震坤,何川. XML 编程实践. 清华大学出版社,2002.12
15 航天四创公司. 民政部门户网站整体升级改造项目建设方案. 2006.11
16 赵俊三,徐涛,傅晓东. 面向电子政务的自然资源与地理空间数据整合方法研究. Vol.03 No.3 Jun,2005
17 庄永龙,马飞,周敏,沈岩,李衍达. 基于多 Agent 的生物信息数据整合系统-BioAgent1. 电子学报,2005 年月 1 月第 1 期
18 满靖,闫健卓,王普. 异构数据库信息整合系统的测试技术研究. 中国自控网
19 赵宝林,夏斌,张俊岭,熊永柱. 广州市电子政务四大基础数据库关键问题研究. 情报杂志 2006 年第 3 期, 2006
20 李庆忠,王栋. 关于语义网格环境中异构数据资源整合的研究. 南京大学学报(自然科学),Vol.42,No.2 Mar.2006
21 Timothy J. Grose, Gary C. Doney, Stephen A. Brodsky, PhD. JavaProgramming with XMI,XML, and UML, John Wiley & Sons Inc, 2001
22 BEA Systems, Inc. BEA AquaLogic Data Services Platform.doc. 2005.07
23 John Poole Dan Chang, Common Warehouse Meta-model, John Wiley & Sons Inc,2002
24 W.H. Inmon. Building the Data Warehouse , Third Edition. wiley, 2004.03
24 JMI Specification (JSR 000040). OMG, June 2002
25 BusinessObjects, Inc. BusinessOjbects Metadata Manager, 2006.05
26 BusinessObjects, Inc. BusinessOjbects Data Cleansing, 2006.05
27 Database System Concepts (Fourth Edition) Abraham Silberschatz, Henry F.Korth, S.Sudarshan The McGraw-Hill Companies Inc. 2002
28 Java 2 Platform Standard Edition 5.0 API. http://java.sun.com
29 CAO Hu. The conformability of information resource based on unity database Information technology, Jul.2003
30 Microsoft. Integration Patterns. Microsoft, 2006.03
31 Jack Herrington. Code Generation in Action. Manning Publications Co. 2003
32 Frank Budinsky, David Steinberg, Ed Merks, Raymond Ellersick, Timothy J. Grose. Eclipse Modeling Framework: A Developer’s Guide. Addison Wesley. August 11, 2005
33 D. Gallardo, E. Burnette, R. McGovern. Eclipse In Action. Manning. 2006
34 D. Lockman. Teach Yourself Oracle 8 Database Development in 21 Days. SAMS, 1999
35 Object Management Group. Common Warehouse Metamodel (CWM) Specification Volume 2. Extensions. Version 1.0, 2 February 2001
36 Object Management Group. Common Warehouse Metamodel (CWM). Specification. Version 1.0, 2 February 2001
37 S. Bergamaschi, S.Castano, M. Vincini. Semantic Integration of Semistructured and Structured Data Sources. 1999
38 Wayne W. Eckerson, Anne Thomas Manes. Paving the Way for TransparentApplication and Data Interchange. Patricia Seybold Group. November 1999
39 CIM Development Team. JMI-RI Documentation(CIM Version 1.3). Unisys Corporation, Last updated 2006-10-02
40 Ravi Dirckze, Don Baisley. JMI Brings MDA to the J2EE Environment – An Overview. Unisys Corporation, 2005
41 Bill Moore. Eclipse Development using the Graphical Editing Framework and the Eclipse Modeling Framework. IBM redbooks, 2004
42 Demuth, B., Hussmann, H., Obermaier, S.: Experiments with XMI-based Transformations of Software Models, in: Online Proc. WTUML: Workshop on Transformations in UML (ETAPS 2001 Satellite Event), Genova, Apr. 2001, http://ase.arc.nasa.gov/wtuml01/
43 W3C, Extensible Markup Language (XML), http://www.w3.org/XML/
44 NetBeans Metadata Repository website http://mdr.netbeans.org/. 2002.1.10
45 Meta Object Facility (MOF) Core Specification. OMG. 2006.1
46 中华人民共和国国民经济和社会发展第十一个五年规划纲要. 人民出版社,2006.03.14
2 在连贯信息环境中管理元数据:21世纪企业成功的根本要素. IT经理世界网, 2006.04
3 中国航天工程咨询中心项目部. 罪犯数据库整体解决方案,2006.04.20
4 中关村科技软件有限公司. 中关通用电子政务系统(CenEG)简介
5 胡克瑾,刘义理. 信息资源管理. 同济大学出版社,2004.02
6 胡昌平. 现代信息管理机制研究. 武汉大学出版社,2004.07
7 林宇. 数据仓库原理与实践. 人民邮电出版社,2003.01
8 东方通科技有限公司. TongLink/Q 白皮书
9 T1soft. 中国人民大学统计数据库研究. 数据整合解决方案,2006
10 高复先. 信息资源规划---信息化基础建设工程. 清华大学出版社,2002.04
11 田志博,孙政顺. 基于 WEB 的数据整合与发布系统的设计与实现. 小型微型计算机系统,Vol.24 No.12 Dec.2003
12 孙卫琴. Java 面向对象编程. 电子工业出版社,2006.06
13 徐春金. Tuxedo 中间件开发与配置. 中国电力出版社,2003.07
14 邵敏,李力鸿,郑震坤,何川. XML 编程实践. 清华大学出版社,2002.12
15 航天四创公司. 民政部门户网站整体升级改造项目建设方案. 2006.11
16 赵俊三,徐涛,傅晓东. 面向电子政务的自然资源与地理空间数据整合方法研究. Vol.03 No.3 Jun,2005
17 庄永龙,马飞,周敏,沈岩,李衍达. 基于多 Agent 的生物信息数据整合系统-BioAgent1. 电子学报,2005 年月 1 月第 1 期
18 满靖,闫健卓,王普. 异构数据库信息整合系统的测试技术研究. 中国自控网
19 赵宝林,夏斌,张俊岭,熊永柱. 广州市电子政务四大基础数据库关键问题研究. 情报杂志 2006 年第 3 期, 2006
20 李庆忠,王栋. 关于语义网格环境中异构数据资源整合的研究. 南京大学学报(自然科学),Vol.42,No.2 Mar.2006
21 Timothy J. Grose, Gary C. Doney, Stephen A. Brodsky, PhD. JavaProgramming with XMI,XML, and UML, John Wiley & Sons Inc, 2001
22 BEA Systems, Inc. BEA AquaLogic Data Services Platform.doc. 2005.07
23 John Poole Dan Chang, Common Warehouse Meta-model, John Wiley & Sons Inc,2002
24 W.H. Inmon. Building the Data Warehouse , Third Edition. wiley, 2004.03
24 JMI Specification (JSR 000040). OMG, June 2002
25 BusinessObjects, Inc. BusinessOjbects Metadata Manager, 2006.05
26 BusinessObjects, Inc. BusinessOjbects Data Cleansing, 2006.05
27 Database System Concepts (Fourth Edition) Abraham Silberschatz, Henry F.Korth, S.Sudarshan The McGraw-Hill Companies Inc. 2002
28 Java 2 Platform Standard Edition 5.0 API. http://java.sun.com
29 CAO Hu. The conformability of information resource based on unity database Information technology, Jul.2003
30 Microsoft. Integration Patterns. Microsoft, 2006.03
31 Jack Herrington. Code Generation in Action. Manning Publications Co. 2003
32 Frank Budinsky, David Steinberg, Ed Merks, Raymond Ellersick, Timothy J. Grose. Eclipse Modeling Framework: A Developer’s Guide. Addison Wesley. August 11, 2005
33 D. Gallardo, E. Burnette, R. McGovern. Eclipse In Action. Manning. 2006
34 D. Lockman. Teach Yourself Oracle 8 Database Development in 21 Days. SAMS, 1999
35 Object Management Group. Common Warehouse Metamodel (CWM) Specification Volume 2. Extensions. Version 1.0, 2 February 2001
36 Object Management Group. Common Warehouse Metamodel (CWM). Specification. Version 1.0, 2 February 2001
37 S. Bergamaschi, S.Castano, M. Vincini. Semantic Integration of Semistructured and Structured Data Sources. 1999
38 Wayne W. Eckerson, Anne Thomas Manes. Paving the Way for TransparentApplication and Data Interchange. Patricia Seybold Group. November 1999
39 CIM Development Team. JMI-RI Documentation(CIM Version 1.3). Unisys Corporation, Last updated 2006-10-02
40 Ravi Dirckze, Don Baisley. JMI Brings MDA to the J2EE Environment – An Overview. Unisys Corporation, 2005
41 Bill Moore. Eclipse Development using the Graphical Editing Framework and the Eclipse Modeling Framework. IBM redbooks, 2004
42 Demuth, B., Hussmann, H., Obermaier, S.: Experiments with XMI-based Transformations of Software Models, in: Online Proc. WTUML: Workshop on Transformations in UML (ETAPS 2001 Satellite Event), Genova, Apr. 2001, http://ase.arc.nasa.gov/wtuml01/
43 W3C, Extensible Markup Language (XML), http://www.w3.org/XML/
44 NetBeans Metadata Repository website http://mdr.netbeans.org/. 2002.1.10
45 Meta Object Facility (MOF) Core Specification. OMG. 2006.1
46 中华人民共和国国民经济和社会发展第十一个五年规划纲要. 人民出版社,2006.03.14