福建烟草数据中心数据质量监控与建模技术应用
详细信息 查看官网全文
- 英文论文题名：Data Quality Monitoring and Modeling Technology Applied in Date Center of Fujian Tobacco Company
- 论文作者：章惠民
- 年：2016
- 作者机构：漳州市烟草公司信息中心;
- 论文关键词：数据中心 ; ETL ; ODS ; 数据仓库 ; 数据模型 ; 商务智能 ; 数据质量
- 英文论文关键词：Date center ; ETL ; ODS ; Data warehouse ; Data model ; Business intelligence ; Data quality
- 会议召开时间：2016-12-01
- 会议录名称：中国烟草学会2016年度优秀论文汇编—— 信息化管理主题
- 语种：中文
- 分类号：F426.8;TP308
- 学会代码：ZGYG
- 学会名称：中国烟草学会
- 页数：8
- 文件大小：1122k
- 原文格式：D
摘要
在介绍数据中心ETL与数据建模技术基础上结合福建烟草商业公司数据中心平台的营销、专卖、物流、人力劳资、综合计划等多个部门业务主题建设与分析应用项目的具体需要,研究并提出了一种合适的ETL与建模实现方法。该方法首先在保证数据质量的前提下成功将烟草公司源系统数据抽取到省公司数据仓库中,然后在数据集市层主要利用星型关系完成数据模型设计作业,最后在BI应用中分析与展现了数据。该方法对整个数据中心的高效应用起到了至关重要的作用。
On the basis of introducing the data center ETL and data modeling technology, and proposed a suitable ETL and modeling method, combined with the specific needs of many sectors business subject construction and analysis application project based on the Fujian tobacco Business Company data center platform. These sectors contain marketing, monopoly, logistics, human capital, integrated plan, and so on. This method first can successfully extract data from the source system of tobacco companies to the data warehouse of the provincial company under the premise of ensuring data quality, and then the data models are designed mainly by star model in the data mart layer, finally can analyze and display data in BI application. It plays an important role to enhance efficiency in the whole DC project.
On the basis of introducing the data center ETL and data modeling technology, and proposed a suitable ETL and modeling method, combined with the specific needs of many sectors business subject construction and analysis application project based on the Fujian tobacco Business Company data center platform. These sectors contain marketing, monopoly, logistics, human capital, integrated plan, and so on. This method first can successfully extract data from the source system of tobacco companies to the data warehouse of the provincial company under the premise of ensuring data quality, and then the data models are designed mainly by star model in the data mart layer, finally can analyze and display data in BI application. It plays an important role to enhance efficiency in the whole DC project.
引文
[1]密红,何利力,杨秀梅.烟草数据中心ETL技术应用[J].计算机应用系统,2011,20(5):184-187.
[2]罗亮,吴文峻,张飞.面向云计算数据中心的能耗建模方法[J].软件学报,2014,25(7):1032-1038.
[3]Bertossi,L.,Bravo,L.:Generic and declarative approaches to data quality management.In:Handbook of Data Quality,Springer(2013):181-211.
[4]Dallachiesa,M.,Ebaid,A.,Eldawy,A.,Elmagarmid,A.,Ilyas,I.F.,Ouzzani,M.,Tang,N.:Nadeef:A commodity data cleaning system.In:Proceedings of the 2013ACM SIGMOD International Conference on Management of Data,SIGMOD 2013,ACM,New York(2013):541-552.
[5]Wilkinson K,Simitsis A,Dayal U,Castellanos M.Leveraging Business Process Models for ETL Design.Conceptual Modeling-ER 2010:15-30.
[6]Schmidt W.Business Activity Monitoring(BAM).Business Intelligence and Performance Management,Advanced Information and Knowledge Processing,2013:229-242.
[7]El Akkaoui Z,Mazón JN,Vaisman A,Zimányi E.BPMN-Based Conceptual Modeling of ETL Processes.LNCS vol.7448,2012:1-14.
[2]罗亮,吴文峻,张飞.面向云计算数据中心的能耗建模方法[J].软件学报,2014,25(7):1032-1038.
[3]Bertossi,L.,Bravo,L.:Generic and declarative approaches to data quality management.In:Handbook of Data Quality,Springer(2013):181-211.
[4]Dallachiesa,M.,Ebaid,A.,Eldawy,A.,Elmagarmid,A.,Ilyas,I.F.,Ouzzani,M.,Tang,N.:Nadeef:A commodity data cleaning system.In:Proceedings of the 2013ACM SIGMOD International Conference on Management of Data,SIGMOD 2013,ACM,New York(2013):541-552.
[5]Wilkinson K,Simitsis A,Dayal U,Castellanos M.Leveraging Business Process Models for ETL Design.Conceptual Modeling-ER 2010:15-30.
[6]Schmidt W.Business Activity Monitoring(BAM).Business Intelligence and Performance Management,Advanced Information and Knowledge Processing,2013:229-242.
[7]El Akkaoui Z,Mazón JN,Vaisman A,Zimányi E.BPMN-Based Conceptual Modeling of ETL Processes.LNCS vol.7448,2012:1-14.