数据仓库技术基于业务报表数据的应用研究
|
摘要
本文对基于业务报表级的数据仓库技术在某业务领域进行了探讨和研究。针对该业务系统现有数据源,在此基础上实现的ETL、多维数据模型、应用功能等方面的研究,对系统的具体实现有一定的借鉴作用。
随着信息技术的高速发展,企业信息化逐渐成为现代企业核心竞争力的重要组成部分,如何有效的管理企业在运营过程中产生的数据,为企业决策提供依据己经成为信息管理人员所面临的最重要课题。自1970年提出关系型数据库模式以来,历经近40年的发展,关系型数据库系统已经成为数据管理领域的主流,然而这种以快速响应为目标的事务系统模式在面向主题的数据分析应用中存在着先天性不足。因此,在现有关系型数据库之上构建分析型的业务系统变得异常困难,数据仓库应运而生。当前数据仓库技术已经进入一个快速发展阶段。当现代企业开始重视信息的价值时,数据仓库就成为一个必然的选择。企业要想在激烈的竞争中获胜或是取得有利地位,必须要能够透过复杂而多变的业务环境,通过对比、分析等手段从庞大的信息中寻找数据内在规律和有用信息,从而快速做出方向性的决策和计划,并付诸实施。企业为应付竞争,对信息的需求大大加剧,正是数据仓库得以快速发展的根本原因。
中国石油于2006年开始建立数据仓库系统,现已完成项目二期。已初步完成一些部门的数据仓库实施工作,本文将重点介绍某业务的数据仓库的建设过程。介绍如何通过报表级的数据粒度为该业务提供了有力的业务支持,以及对财务和业务管理等数据进行更高层次的分析,自动地、智能地将数据转化为有用的信息和知识。这将是实现大型企业业务信息化的有效途径。
In this paper, We discuss and research the Audit services which is based on the data warehouse technology. Based on the Audit services research focus on the existing data source, and which developed ETL, multi-dimensional data model, application functionality and other research. All the above research will have some specific reference effect to the system practice.
With the rapidly development of information technology, enterprise information has become a concept of core competence. And how to effective management data which is got from operating process, to provide a basis for decision-making. It is a important subject of information management.
Since1970, facts and information database model has become the mainstream of database management. But this kind of model which is rapidly response to the service as target, there are some deficiency for application of the subject-oriented database analysis.
Therefore, it is very difficult for building analysis business system which is based on the fact and information database. Data Warehouse emerges as the times require. Now, Data warehouse has entered a rapidly development process. When the modern enterprise has taken the value of information, data warehouse has become a necessary choice.
If an enterprise hope to win and take the advantage position in the fierce competition, it must find internal rule and values information from huge data though the complex and changeful environment and make a oriented make-decision and at the same time execute it through contrast, analysis ways.
The more and more information demand from business caused the database warehouse rapid development.
From2006, CNPC has set up data warehouse system and accomplished the second phrase. The article will focus on the how to build auditing business data warehouse which has been accomplished. Data warehouse provide data support for the auditing business, and make the financial and audit management data into the value information and knowledge through high level analysis, automatically and intelligently ways ,which is a effective channel to realize audit business information.
随着信息技术的高速发展,企业信息化逐渐成为现代企业核心竞争力的重要组成部分,如何有效的管理企业在运营过程中产生的数据,为企业决策提供依据己经成为信息管理人员所面临的最重要课题。自1970年提出关系型数据库模式以来,历经近40年的发展,关系型数据库系统已经成为数据管理领域的主流,然而这种以快速响应为目标的事务系统模式在面向主题的数据分析应用中存在着先天性不足。因此,在现有关系型数据库之上构建分析型的业务系统变得异常困难,数据仓库应运而生。当前数据仓库技术已经进入一个快速发展阶段。当现代企业开始重视信息的价值时,数据仓库就成为一个必然的选择。企业要想在激烈的竞争中获胜或是取得有利地位,必须要能够透过复杂而多变的业务环境,通过对比、分析等手段从庞大的信息中寻找数据内在规律和有用信息,从而快速做出方向性的决策和计划,并付诸实施。企业为应付竞争,对信息的需求大大加剧,正是数据仓库得以快速发展的根本原因。
中国石油于2006年开始建立数据仓库系统,现已完成项目二期。已初步完成一些部门的数据仓库实施工作,本文将重点介绍某业务的数据仓库的建设过程。介绍如何通过报表级的数据粒度为该业务提供了有力的业务支持,以及对财务和业务管理等数据进行更高层次的分析,自动地、智能地将数据转化为有用的信息和知识。这将是实现大型企业业务信息化的有效途径。
In this paper, We discuss and research the Audit services which is based on the data warehouse technology. Based on the Audit services research focus on the existing data source, and which developed ETL, multi-dimensional data model, application functionality and other research. All the above research will have some specific reference effect to the system practice.
With the rapidly development of information technology, enterprise information has become a concept of core competence. And how to effective management data which is got from operating process, to provide a basis for decision-making. It is a important subject of information management.
Since1970, facts and information database model has become the mainstream of database management. But this kind of model which is rapidly response to the service as target, there are some deficiency for application of the subject-oriented database analysis.
Therefore, it is very difficult for building analysis business system which is based on the fact and information database. Data Warehouse emerges as the times require. Now, Data warehouse has entered a rapidly development process. When the modern enterprise has taken the value of information, data warehouse has become a necessary choice.
If an enterprise hope to win and take the advantage position in the fierce competition, it must find internal rule and values information from huge data though the complex and changeful environment and make a oriented make-decision and at the same time execute it through contrast, analysis ways.
The more and more information demand from business caused the database warehouse rapid development.
From2006, CNPC has set up data warehouse system and accomplished the second phrase. The article will focus on the how to build auditing business data warehouse which has been accomplished. Data warehouse provide data support for the auditing business, and make the financial and audit management data into the value information and knowledge through high level analysis, automatically and intelligently ways ,which is a effective channel to realize audit business information.
引文
[1]中国石油信息技术总体规划(内部资料),2000;
[2]中国石油数据仓库二期可行性研究报告(内部资料),2007;
[3]中国石油数据仓库二期实施方案(内部资料),2008;
[4]中国石油数据仓库一期可行性研究报告(内部资料),2007;
[5]中国石油数据仓库一期实施总结报告(内部资料),2004;
[6]中国石油计算机网络现状与需求分析报告(内部资料),2003;
[7]王志海,林友芳等译数据仓库(第3版)北京:机械工业出版社,2003;
[8]王珊等,数据仓库技术与联机分析处理北京:科学出版社,1999;
[9]段云峰,李剑威,韩洁等数据仓库基础北京:电子工业出版社2004;
[10] Ralph Kimball著数据仓库工具箱:维度建模的完全指南(第二版)北京:电子工业出版社2003;
[11]朱建秋、张晓辉、蔡伟杰等译OLAP解决方案:创建多维信息系统(第二版)北京:电子工业出版社2004;
[12]陈京民数据仓库原理、设计与应用北京:中国水利水电出版社2004;
[13]张维明等数据仓库原理与应用北京:电子工业出版社2002;
[14]于戈、鲍玉斌、王大玲等数据仓库设计北京:机械工业出版社2004;
[15]曾佳玉等元数据及其在审计系统中的应用北京邮电大学2008.2
[16]赵林明等基于数据仓库的信用卡数据挖掘研究;山东科技大学2005-5
[17]邰伟民等基于数据仓库技术的油田生产经营管理系统研究2004-5
[18]王新庄、段建华;面向数据仓库的MIS系统设计,计算机工程与应用Vol.37,No.16,2001
[19]王峰;数据仓库在煤炭系统的应用研究辽宁工程技术大学2004,5
[20] William H. Inmon,Building the Data Warehouse ,QED Technical Publishing Group, 1992
[21] Laney, Dong.“Are OLAP and OLTP Like Twins?”, DMR, 1996
[22] WHITE PAPER:Why Consider Oracle For Business Intelligence;http://www.idc.com;2004;
[23] Bill Inmon, Data Mart Does Not Equal Data Warehouse, DM Review, 1998
[24] Bill Inmon, The Operational Data Store : Designing the Operational Data Store, DM Review, 1998
[25] Ralph Kimball, The Data Warehouse Has No Center, Intelligent Enterprise, 1999
[26] Ralph Kimball, Rating Your Dimensional Data Warehouse, Intelligent Enterprise, 1999
[27] E F Codd,S B Codd,C T Salley, Providing OLAP(On-Line Analytical Processing) to User Analysts, An IT mandate, 1993
[28]Ralph Kimball, Is ER Modeling Hazardous to DSS? DBMS, 1995, http://www.dbmsmag.com/
[2]中国石油数据仓库二期可行性研究报告(内部资料),2007;
[3]中国石油数据仓库二期实施方案(内部资料),2008;
[4]中国石油数据仓库一期可行性研究报告(内部资料),2007;
[5]中国石油数据仓库一期实施总结报告(内部资料),2004;
[6]中国石油计算机网络现状与需求分析报告(内部资料),2003;
[7]王志海,林友芳等译数据仓库(第3版)北京:机械工业出版社,2003;
[8]王珊等,数据仓库技术与联机分析处理北京:科学出版社,1999;
[9]段云峰,李剑威,韩洁等数据仓库基础北京:电子工业出版社2004;
[10] Ralph Kimball著数据仓库工具箱:维度建模的完全指南(第二版)北京:电子工业出版社2003;
[11]朱建秋、张晓辉、蔡伟杰等译OLAP解决方案:创建多维信息系统(第二版)北京:电子工业出版社2004;
[12]陈京民数据仓库原理、设计与应用北京:中国水利水电出版社2004;
[13]张维明等数据仓库原理与应用北京:电子工业出版社2002;
[14]于戈、鲍玉斌、王大玲等数据仓库设计北京:机械工业出版社2004;
[15]曾佳玉等元数据及其在审计系统中的应用北京邮电大学2008.2
[16]赵林明等基于数据仓库的信用卡数据挖掘研究;山东科技大学2005-5
[17]邰伟民等基于数据仓库技术的油田生产经营管理系统研究2004-5
[18]王新庄、段建华;面向数据仓库的MIS系统设计,计算机工程与应用Vol.37,No.16,2001
[19]王峰;数据仓库在煤炭系统的应用研究辽宁工程技术大学2004,5
[20] William H. Inmon,Building the Data Warehouse ,QED Technical Publishing Group, 1992
[21] Laney, Dong.“Are OLAP and OLTP Like Twins?”, DMR, 1996
[22] WHITE PAPER:Why Consider Oracle For Business Intelligence;http://www.idc.com;2004;
[23] Bill Inmon, Data Mart Does Not Equal Data Warehouse, DM Review, 1998
[24] Bill Inmon, The Operational Data Store : Designing the Operational Data Store, DM Review, 1998
[25] Ralph Kimball, The Data Warehouse Has No Center, Intelligent Enterprise, 1999
[26] Ralph Kimball, Rating Your Dimensional Data Warehouse, Intelligent Enterprise, 1999
[27] E F Codd,S B Codd,C T Salley, Providing OLAP(On-Line Analytical Processing) to User Analysts, An IT mandate, 1993
[28]Ralph Kimball, Is ER Modeling Hazardous to DSS? DBMS, 1995, http://www.dbmsmag.com/