摘要
国家和各个地方的政府部门经过多年的信息建设,积累了大量的各行各业的数据,但是数据零散,集中整合度低,不能适应数据分析和决策的需要,随着电子政务信息化建设的进一步深入和数据仓库(DW)技术的迅猛发展,将数据仓库技术运用到政府部门工作中用以数据分析和支持政府决策,提高工作的效率和质量己成为现实的需要。
本文首先介绍了课题的研究背景、当前电子政务信息化水平、政府信息集中整合利用的状况,接着对数据仓库的基本概念、数据组织结构以及数据仓库的设计方法与步骤进行详细研究。然后重点研究了在政府决策支持系统(DSS)中创建数据仓库的方法,根据实际情况,并以当前流行的Oracle 10g数据库为平台,提出了面向各项经济指标为主题的数据仓库的设计方案:第一步是根据业务需求以及政府数据的特殊层次结构,进行数据仓库的模型设计;第二步结合Oracle Warehouse Builder(OWB)工具分别论述时间戳和触发器两种方式的增量数据抽取、转换、装载(ETL)过程,将源数据按照数据仓库模型整合到数据仓库中,并针对数据仓库的删除操作,提出一种增量ETL过程中对删除数据实现装载的设计方案;第三步利用Oracle OLAP Analytic Workspace(AW)对数据仓库中的数据进行多维数据分析,并以报表和图表的方式进行展现;最后,为满足政府DSS中对数据综合分析的需求,提出了一种数据仓库报表生成方法,实现多主题数据的即席查询展现,在一定程度上解决了Oracle前端展现工具无法跨事实表抽取数据并展现的问题。
Government and branches of the government informationization has accumulated a great deal of grassroots data from all industries after many years of building. But the data scattered and the centralized concordance now, could not meet the government revenue decision-making and the data analysis need. With the government informationization improved further and the rapid development of data warehouse technology, data storage technology used in the work to government has become reality, because it can support decision making and the data analysis, improve the efficiency and the quality of the work. This topic is produced in this kind of situation.
First, this article introduced the research background of the topic, the current level of government informationization and the situation of the government informationization on the integration. Then it made a detailed study in the basic concept of the data warehouse, the structure of the data organization as well as the design method and steps of the data warehouse. This article based on current popular Oracle 10g database as a platform and the practical situation, put forward a data warehouse application plan on all industries for the government management applications subjects, and focused on the study of the government system in data warehouse methodologies and the steps, as follow:
Firstly, design the models of the government data warehouse based on the analyses and special hierarchy of government data. Secondly, with the OWB tool, described the process of the data extracted, transformed and loaded including time-tag schema and trigger schema, for integrating original data to the data warehouse based on models. Additionally, came up with a design incremental ETL plan to deal with the deleted data. Thirdly, used Oracle OLAP Analytic Workspace (AW) analyses the data multidimensionally in the data warehouse, and presented them by reports and graphs. Finally, for the requirement of the comprehensive data analysis in the government DSS and the realization of mutil_subject ad_hoc, an approach extracting data from several subjects in a data warehouse to create integration analysis report is proposed to solve the problem of Oracle report tool to some extent.
引文
[1]王卫国.电子政务系统.北京:科学出版社,2007.1-1
[2]高洪深.决策支持系统(DSS).理论.方法.案例(第3版).北京:清华大学出版社,2005.1-1
[3]徐洁磐.数据仓库与决策支持系统.北京:科技出版社,2005.3-4
[4]王开成.数据仓库在市场营销支撑系统中的应用:[硕士学位论文].哈尔滨:哈尔滨工程大学软件工程学院,2006
[5]W.H.Inmon.数据仓库.北京:机械工业出版社,2003.7-7
[6]高晓菲.基于数据仓库的电力支持决策系统:[硕士学位论文].山东:山东大学软件工程学院,2006
[7]徐雷波.数据仓库中可视化决策支持模型的研究与构建:[硕士学位论文].山东:山东大学软件工程学院,2006
[8]段楚雄.数据仓库在税务系统中的应用:[硕士学位论文].上海:同济大学软件学院,2006
[9]Ralph Kimball.数据仓库工具箱:维度建模的完全指南(第二版).北京:电子工业出版社,2003.17-18
[10]王珊.数据仓库技术与联机分析处理.北京:科学出版社,1998.55-55
[11]萨师煊,王珊.数据库基础.北京:高等教育出版社,1993.76-82
[12]薛晶.基于数据仓库的统计库的设计和实现:[硕士学位论文].中国科学院计算技术研究所计算机应用,2000
[13]JF Francois Weilbach Herna L Viktor,A Data Warehouse for Policy Making:A Case study,Proceedings of the 32nd Hawaii International Conference on System Sciences-1999:1-8
[14]李文印,何湘东,寇峰.基于数据仓库的动态报表系统设计与实现.长春邮电学院学报,2001,19(3,4):39-42
[15]曹斌,齐剑锋,涂序彦.商业智能决策支持系统(BIDSS).计算机工程与应用,2001(20):29-31
[16]WangYongsheng Shao,Huihe,Data Warehouse Technology in Process Industry,Proceedings of the 3rd World Congress on Intelligent Control and Automation,June 28-July 2,2000:2037-2039
[17]李正友,杨建设,曹渠江.数据仓库技术及其在Web上动态报表中的应用.上海理工大学学报,2001,23(4):382-384
[18]Gavin Powell.Beginning Database Design.Wiley Publishing,Inc.2005,7:83-92
[19]梁文斌,孙涌.基于web的通用报表系统设计与实现.计算机与现代化,2005,(4):107-109
[20]张昊.数据仓库技术及其在企业报表环境中的应用.当代化工,2004,33(6):367-369
[21]柳雪涛,黄志球,左银龙.数据仓库系统中用户驱动报表工具的设计与实现.小型微型计算机系统,2002,23(2):185-188
[22]Chaudhuri S,Dayal U.An Overview of Data Warehousing and OLAP Technology.SIGMOD Record,1997,26(1):75-74
[23]江文年,李明星.数据仓库与决策支持系统.决策借鉴,2000,(2):20-21
[24]Robert Winter,Bernhard Strauch,A Method for Demand-driven Information Requirements Analysis in Data Warehousing Projects,Proceedings of the 36th Hawaii International Conference on System Sciences,2002:161-166
[25]王晓军.数据仓库在决策支持系统中的应用.计算机工程与应用,1997,(12):43-45
[26]Robert Winter,The Current and Future Role of Data Warehousing in Corporate Application Architecture,Proceedings of the 34th Hawaii International Conference on System Sciences,2001:1-8
[27]彭奇志.图书馆数据仓库模型的研究.现代情报,2005,(1):106-110
[28]徐长惠,潘和平.商业智能及其核心技术.计算机应用研究,2002,(9):14-16
[29]Timon C.Du,Jacqueline Wong,Designing Data Warehouses for Supply Chain Management,Proceedings of the IEEE International Conference on E-Commerce Technology.2002:124-131
[30]李泽海,孙吉贵,赵君.商业智能技术及行业应用分析.吉林大学学报(信息科学版),2003:21(1):54-60
[31]Christopher Adamson,Michael Venerable,Data Warehouse Design Solution.New York:Wiley,June 29,1998
[32]Jeff Lawyer and Shamsul Chowdhury,Best Practices in Data Warehousing to Support Business Initiatives and Needs,Proceedings of the 37th Hawaii International Conference on System Sciences,2004:1-9
[33]钟辉新,胡勇.应用商业智能技术实现DSS情报技术,2005,(7):86-88
[34]熊齐,潘梅森.基于数据仓库的银行卡统计系统,微计算机信息,2006,(2):223-224
[35]M.Serrano.C.Calero and M.Piattini,Validating metrics for data warehouses,IEE Proc-Sofw,2002,149(5):56-60
[36]Dr.Frank Bensberg,Controlling the Data Warehouse-a Balanced Scorecard approach 25th Int.Conf.Information Technology Interfaces IT/2003,June 16-19,2003,Cavtat,Croatia:127-132
[37]A.Halim Elamy,Reda S.Alhajj,Behrouz H.Far,Building Data Warehouses with incremental maintenance for decision support,CCECE/CCGEI,Saskatoon,May 2005:1809-1814
[38]孙卫琴.精通Struts:基于MVC的Java Web设计与开发.北京:电子工业出版社,2004
[39]Jorge Bernardino,Pedro Furtado,Henrique Madeira,DWS-AQA:A Cost Effective Approach for Very Large Data Warehouses,Proceedings of the International Database Engineering and Applications Symposium,2002
[40]Svetlozar Nestorov,Umeshwar Dayal,An Overview of Data Warehousing and OLAP Technology,2001 12th IEEE International Symposium on,Volume:1,30 Sept.3Oct.2001:B-60-B-64vol.1
[41]Panos Vassiliadis.Data Warehouse process management,Communications Magazine,IEEE,Volume:41,Issue:7,July 2003:154-163
[42]孙鑫,java WEB开发详解--XML+XSLT+Servlet+JSP深入剖析与实例应用.北京:电子工业出版社,2006
[43]Bruce Eckel.Thinking in Java Third Edition.北京:机械工业出版社,2006
[44]句群慧,张华新,胡维华.基于J2EE的部门交互式审批平台的设计与实现.计算机应用与软件,2005,22(12):12-15
[45]Jim D'Anjou,Scott Fairbrother,Dan Kehn,John Kellerman,Pat McCarthy.THE JAVA DEVELOPER'S GUIDE TO ECLIPSE,2ND EDITION.ADDISON-WESLEY press.2005,1
