分布式企业Data Warehouse的创建及应用研究
|
摘要
随着计算机网络与数据库技术的迅速发展和广泛应用，使得企业管理进入了一个崭新的时代。面对竞争日趋激烈、瞬息万变的市场经济，各级管理人员迫切需要对不同层次的大量信息迅速作出抉择。这就要求各级管理人员能够从大量复杂的业务数据中获取各自权限内的决策信息，及时把握市场变化的脉搏，作出正确有效的判断。特别是随着数据库系统的逐日运行，数据的堆积将越来越庞大，这种需求就比以往任何时候都更加迫切。从各级决策者的角度来看，数据处理的重点应该从传统的业务过程扩展到对业务数据的联机分析处理，并从中得到面向各种管理主题的统计信息和决策支持信息。
Data Warehouse(数据仓库)就是针对解决上述问题所产生的一种技术方案，是基于大规模数据库的决策支持系统环境的核心。正如数据仓库之父W.H.Inmon所定义的，数据仓库是一个面向主题的、集成的、不可更新的且随时间不断变化的数据集合，用来支持管理人员的决策。
本论文概括地讲述了数据仓库系统的基本概念与基本原理。主要包括数据仓库的结构、数据分割与粒度划分、数据仓库模型、数据仓库中的数据访问方式、数据仓库的各种组织技术、分布式数据仓库、数据仓库与管理人员之间的关系、设计复查以及数据仓库的开发方法等。同时，结合“企业信息中心”系统的开发实践，将数据仓库的设计思想和网络Web发布技术结合到科研项目中，总结出一个可行的数据驱动开发模型，并且解决了开发实践中遇到的各种软硬件难题，对于自行开发数据仓库应用系统，作出了有力的探索。
With the quick development and application of the computer network and Database technology, the enterprise management enters into the new time. Facing the changing marketing economy in which competition becomes more and more furious, all kinds of managers need firmly to make a decision from the large different information. It requires that managers are able to get complex operation data in their own field, master the direction of marketing and make a good judgment in effect. As the running of database system, data turn bigger and bigger. So the request becomes urgent. According to the stand of decision-making people, emphases of data transaction should be changed from the old operation process into the on-line analyzing process and we can find statistics and decision support information.
Data Warehouse is a technological answer to the above problem, which is the corner in circumstance of the decision support system based on huge database. The father of Data Warehouse brings forward a definition: Data Warehouse is compositive data based on subject which cannot be updated but changed with time. It can be used to support manager's decision.
This thesis describes basic conception and principle. It includes structure, data partition, granularity, model, data access, organization, distributing, relationship among manager, design checking, design method about Data Warehouse. At the same time, I put the design ideas and network web publishing technology into a project, and then work out a feasible data-drive model. More importantly, I have succeeded to resolve many difficult problems of software and hardware and explore a new route to the self-design Data Warehouse application system.
Data Warehouse(数据仓库)就是针对解决上述问题所产生的一种技术方案，是基于大规模数据库的决策支持系统环境的核心。正如数据仓库之父W.H.Inmon所定义的，数据仓库是一个面向主题的、集成的、不可更新的且随时间不断变化的数据集合，用来支持管理人员的决策。
本论文概括地讲述了数据仓库系统的基本概念与基本原理。主要包括数据仓库的结构、数据分割与粒度划分、数据仓库模型、数据仓库中的数据访问方式、数据仓库的各种组织技术、分布式数据仓库、数据仓库与管理人员之间的关系、设计复查以及数据仓库的开发方法等。同时，结合“企业信息中心”系统的开发实践，将数据仓库的设计思想和网络Web发布技术结合到科研项目中，总结出一个可行的数据驱动开发模型，并且解决了开发实践中遇到的各种软硬件难题，对于自行开发数据仓库应用系统，作出了有力的探索。
With the quick development and application of the computer network and Database technology, the enterprise management enters into the new time. Facing the changing marketing economy in which competition becomes more and more furious, all kinds of managers need firmly to make a decision from the large different information. It requires that managers are able to get complex operation data in their own field, master the direction of marketing and make a good judgment in effect. As the running of database system, data turn bigger and bigger. So the request becomes urgent. According to the stand of decision-making people, emphases of data transaction should be changed from the old operation process into the on-line analyzing process and we can find statistics and decision support information.
Data Warehouse is a technological answer to the above problem, which is the corner in circumstance of the decision support system based on huge database. The father of Data Warehouse brings forward a definition: Data Warehouse is compositive data based on subject which cannot be updated but changed with time. It can be used to support manager's decision.
This thesis describes basic conception and principle. It includes structure, data partition, granularity, model, data access, organization, distributing, relationship among manager, design checking, design method about Data Warehouse. At the same time, I put the design ideas and network web publishing technology into a project, and then work out a feasible data-drive model. More importantly, I have succeeded to resolve many difficult problems of software and hardware and explore a new route to the self-design Data Warehouse application system.
引文
1．王珊等，数据仓库技术与联机分析处理，科学出版社，1999
2．Eric Sperley，企业数据仓库的规划、建立与实现，人民邮电出版社，2000-08
3．Lou Agosta，数据仓库技术指南，人民邮电出版社，2000-12
4．吴晓东，在多层体系结构下建立数据仓库，电子周刊，2000-01-11
5．何红波，王文军，数据仓库在决策支持系统中的应用，微机世界，2000-02-16
6．刘月晴，单东，网络安全与策略，电子工程，2001-01
7．王巍，SQL Server上数据对象结构的动态建立与访问，软件世界，1988(5)
8．李建中，王珊，数据库系统原理，电子工业出版社，1998-08
9．宋轶勤，宋顺林，基于Web的综合查询系统实现的关键技术，计算机工程，2001-01，27(1)
10．蒋文伟，许华虎，唐毅，基于Agent的数据仓库的研究，计算机工程，2001-03，27(3)
11．陈汝震，刘杰，王军，基于Web网络性能管理系统的设计和实现，2001-3，27(3)
12．曹军，大连农行数据仓库建设，CNW On-line，2000-10-09
13．王立平，Informix数据仓库实施专家论坛，数据库技术，2001-02
14．谈战海，新一代数据仓库平台Adaptive Server IQ 12 Multiplex，2000，7
15．商业智能及数据仓库技术应用背景，http://www.zol.com.cn，中关村在线，2001-01
16．Sean McGrath，XML应用实例，人民邮电出版社，2001-01
17．William A. Giovinazzo，面向对象的数据仓库的设计，人民邮电出版社，2001-12
18．Harjinder S.Gill，数据仓库客户/服务器计算指南，清华大学出版社，2000-01
19．Robert Orfali，智能PHP，电子工业出版社，1999
20．Hackathorn, Richard D, When Farming for the Data Warehouse，北京希望出版社，2000-03
21．John Papa, Matthew Shepker, Mircosoft SQL Server Programming Unleashed，机械工业出版社，1999-09
22. Braden R, Clark D, Shenker S.RFC 1633: Integrated Services in the Internet Architecture: An Overview, 1994-06
23. Lucent Technologies. PSTN-Internet Ineterworking-An Architecture Overview. Internet Draft, 1997-11
24. ITU-T Recommendation H.323: Packet Based Multimedia Communication System, 1998
25. Arango M, Huitema C.Simple Gateway Control Protocol(SGCP). Internet Draft, 1998-07-28
26. Guerin R, Peris V. Quality-of-service in Packet Networs: Basic Mechanisms and Directions, Computer Networks, 1999(31): 169-189
27. Schulzrinne H. Casner S, Frederick R. et al. RFC1889: RTP: A Transport Protocol for Real-time Applications, Audio-Video Transport Working Group, 1996-01
28. Ralph Kimball, The ClickingStream Data Mart: Window into Customer Behavior, Intellegent Enterprise Vol2, No.1
29. W.H.Inmon, Building the Data Warehouse Second Edition, 2000-5
30. Diffie W, Hellman M E, New Direction in Cryptography, IEEE Trans. Informat. Theory, 1976
31. Dan Mezick, Scot Hillier, Programming Active Server Pages[M], Microsoft Press, 1998
32. Stephen Walther, Active Server Pages 2.0 Unleashed[M], Macmillan Computer Publishing, 2000
33. HongLeili, Construction of Customer Behavior Analysis System on Internet, http://www.jfdd/ckpjwork.org, 2000-04
34． Phi Wainewright, Building the information Utility[EB/OL], http://www.futurelink.net, 2001-03
35． Clare Gillan, Steve Graham, The PHP's Impact on the IT industry:An IDC-Wide Option, http://www.aspnews.com, 2000
36． SourceForge Documentation, http://sfdocs.sourceforge.net. 2000-01
37． "Hypertext Transfer Protocol-HTTP/1． 1", January 1997, http://www.ietf.org/rfc/rfc2616． txt
38． "The Directory-Authentication Framework", CCITT, Recommendation X.509,1988
39． Cisco Documentation, Cisco Managerment Information Base(MIB) User Quick Reference, 1999-07
40． Case J D.Fedor, M.Schoffstall, ML.et al.RFCl098:SimpIe Network Management Protocal, 1998-04
2．Eric Sperley，企业数据仓库的规划、建立与实现，人民邮电出版社，2000-08
3．Lou Agosta，数据仓库技术指南，人民邮电出版社，2000-12
4．吴晓东，在多层体系结构下建立数据仓库，电子周刊，2000-01-11
5．何红波，王文军，数据仓库在决策支持系统中的应用，微机世界，2000-02-16
6．刘月晴，单东，网络安全与策略，电子工程，2001-01
7．王巍，SQL Server上数据对象结构的动态建立与访问，软件世界，1988(5)
8．李建中，王珊，数据库系统原理，电子工业出版社，1998-08
9．宋轶勤，宋顺林，基于Web的综合查询系统实现的关键技术，计算机工程，2001-01，27(1)
10．蒋文伟，许华虎，唐毅，基于Agent的数据仓库的研究，计算机工程，2001-03，27(3)
11．陈汝震，刘杰，王军，基于Web网络性能管理系统的设计和实现，2001-3，27(3)
12．曹军，大连农行数据仓库建设，CNW On-line，2000-10-09
13．王立平，Informix数据仓库实施专家论坛，数据库技术，2001-02
14．谈战海，新一代数据仓库平台Adaptive Server IQ 12 Multiplex，2000，7
15．商业智能及数据仓库技术应用背景，http://www.zol.com.cn，中关村在线，2001-01
16．Sean McGrath，XML应用实例，人民邮电出版社，2001-01
17．William A. Giovinazzo，面向对象的数据仓库的设计，人民邮电出版社，2001-12
18．Harjinder S.Gill，数据仓库客户/服务器计算指南，清华大学出版社，2000-01
19．Robert Orfali，智能PHP，电子工业出版社，1999
20．Hackathorn, Richard D, When Farming for the Data Warehouse，北京希望出版社，2000-03
21．John Papa, Matthew Shepker, Mircosoft SQL Server Programming Unleashed，机械工业出版社，1999-09
22. Braden R, Clark D, Shenker S.RFC 1633: Integrated Services in the Internet Architecture: An Overview, 1994-06
23. Lucent Technologies. PSTN-Internet Ineterworking-An Architecture Overview. Internet Draft, 1997-11
24. ITU-T Recommendation H.323: Packet Based Multimedia Communication System, 1998
25. Arango M, Huitema C.Simple Gateway Control Protocol(SGCP). Internet Draft, 1998-07-28
26. Guerin R, Peris V. Quality-of-service in Packet Networs: Basic Mechanisms and Directions, Computer Networks, 1999(31): 169-189
27. Schulzrinne H. Casner S, Frederick R. et al. RFC1889: RTP: A Transport Protocol for Real-time Applications, Audio-Video Transport Working Group, 1996-01
28. Ralph Kimball, The ClickingStream Data Mart: Window into Customer Behavior, Intellegent Enterprise Vol2, No.1
29. W.H.Inmon, Building the Data Warehouse Second Edition, 2000-5
30. Diffie W, Hellman M E, New Direction in Cryptography, IEEE Trans. Informat. Theory, 1976
31. Dan Mezick, Scot Hillier, Programming Active Server Pages[M], Microsoft Press, 1998
32. Stephen Walther, Active Server Pages 2.0 Unleashed[M], Macmillan Computer Publishing, 2000
33. HongLeili, Construction of Customer Behavior Analysis System on Internet, http://www.jfdd/ckpjwork.org, 2000-04
34． Phi Wainewright, Building the information Utility[EB/OL], http://www.futurelink.net, 2001-03
35． Clare Gillan, Steve Graham, The PHP's Impact on the IT industry:An IDC-Wide Option, http://www.aspnews.com, 2000
36． SourceForge Documentation, http://sfdocs.sourceforge.net. 2000-01
37． "Hypertext Transfer Protocol-HTTP/1． 1", January 1997, http://www.ietf.org/rfc/rfc2616． txt
38． "The Directory-Authentication Framework", CCITT, Recommendation X.509,1988
39． Cisco Documentation, Cisco Managerment Information Base(MIB) User Quick Reference, 1999-07
40． Case J D.Fedor, M.Schoffstall, ML.et al.RFCl098:SimpIe Network Management Protocal, 1998-04