WEB数据库和数据仓库技术的研究与应用
|
摘要
随着Internet应用的飞速发展，网站信息的实时性、交互性成为网站设计的关键点。而Internet／Intranet和Web技术的出现和不断发展，使得越来越多的企业通过建立Internet站点实时发布企业动态信息，以及建立内部Intranet网进行企业集成与共享，以达到企业优化管理。
数据仓库技术是近几年来出现的、发展迅速的一种技术。它可以充分利用存于数据仓库中的已有信息，帮助决策者进行正确的决策，使企业能在激烈的市场竞争中把握先机。
数据清理是由创建数据仓库产生的为确保数据完整性的过程。数据的来源不同使数据仓库很容易产生“脏”的和“不稳定”的数据。对于一个公司而言，有一个拥有错误信息的数据仓库比没有数据仓库更糟。数据清理的步骤为：集成前清理、集成后清理、集成后提炼。本文以一个实例——数据清理系统(DCS)的设计并实现，从应用的角度上，初步论证了数据仓库技术在管理信息系统中的重要意义和在实际生活中的现实作用。
本文应用ASP和Oracle数据库技术构建了基于Web数据库的数据查询和信息发布系统，并阐述其设计和实现方法。该系统采用Browser／Server结构，使客户端能通过浏览器动态访问数据库信息，并通过浏览方式实现信息的发布与查询，其中采用ASP技术通过Oracle数据库自带的Oracle Objects for OLE来访问数据库，实现交互式、动态的企业数据库查询和信息发布。实践证明，该系统具有安全性强、稳定性高、操作简单等优点。在水电厂数据的实时显示方面，本文提出利用PUSH技术实现服务器主动发送数据，并把网络多播技术的应用作为未来进一步研究的方向。
As a communication age has come, Internet is continuously changing people's work and life. We can get a lot of information conveniently and quickly by web. With the fast development of Internet's application, the key of Web node design is that the information of web must be time-effective aad be exchanged between both sides. So with the appearance and development of the technology of Internet/Intranet and web, in order to optimize management more and more enterprises have issued their dynamic information at real time by establishing Internet sites and have established Intranet inside to integrate and share all the information.
Data warehouse is a technology that appeared and has got a fast development in recent years. It makes the best of the information that has been stored and helps decision-makers to make a wise decision. So enterprises can take an earlier advance than others in the vehement market competition.
Data cleaning is the process that is done by data warehouse created to guarantee the integrality of data. The difference of data sources brings the result that data warehouse is easy to have some "dirty" and " unstable" data. For enterprises it is worse to have a data warehouse that has error information than to have no data warehouse. The procedures of data cleaning are cleaning before integrating, cleaning after integrating and extracting after integrating. Through an example - the design and implementation of data cleaning system(DCS), the great significance of data warehouse technology in Manage and Information System is demonstrated from the application point of view and the actual function in real life is introduced.
In this paper the data query and information issuing system based on Web Database, in which the technology of ASP and Oracle database is applied, is introduced. And its design, implementation and examples are showed as well. In this system Browser/Server structure is applied in order that the client can dynamically access database information by browsers and perform the function of information issuing and query by the method of full-browser, in which ASP technology accesses databases by Oracle Objects for OLE of Oracle database to issue enterprise's information dynamically and mutually. It is proved that this system has the advantages of high security and stability and easy-operation.
数据仓库技术是近几年来出现的、发展迅速的一种技术。它可以充分利用存于数据仓库中的已有信息，帮助决策者进行正确的决策，使企业能在激烈的市场竞争中把握先机。
数据清理是由创建数据仓库产生的为确保数据完整性的过程。数据的来源不同使数据仓库很容易产生“脏”的和“不稳定”的数据。对于一个公司而言，有一个拥有错误信息的数据仓库比没有数据仓库更糟。数据清理的步骤为：集成前清理、集成后清理、集成后提炼。本文以一个实例——数据清理系统(DCS)的设计并实现，从应用的角度上，初步论证了数据仓库技术在管理信息系统中的重要意义和在实际生活中的现实作用。
本文应用ASP和Oracle数据库技术构建了基于Web数据库的数据查询和信息发布系统，并阐述其设计和实现方法。该系统采用Browser／Server结构，使客户端能通过浏览器动态访问数据库信息，并通过浏览方式实现信息的发布与查询，其中采用ASP技术通过Oracle数据库自带的Oracle Objects for OLE来访问数据库，实现交互式、动态的企业数据库查询和信息发布。实践证明，该系统具有安全性强、稳定性高、操作简单等优点。在水电厂数据的实时显示方面，本文提出利用PUSH技术实现服务器主动发送数据，并把网络多播技术的应用作为未来进一步研究的方向。
As a communication age has come, Internet is continuously changing people's work and life. We can get a lot of information conveniently and quickly by web. With the fast development of Internet's application, the key of Web node design is that the information of web must be time-effective aad be exchanged between both sides. So with the appearance and development of the technology of Internet/Intranet and web, in order to optimize management more and more enterprises have issued their dynamic information at real time by establishing Internet sites and have established Intranet inside to integrate and share all the information.
Data warehouse is a technology that appeared and has got a fast development in recent years. It makes the best of the information that has been stored and helps decision-makers to make a wise decision. So enterprises can take an earlier advance than others in the vehement market competition.
Data cleaning is the process that is done by data warehouse created to guarantee the integrality of data. The difference of data sources brings the result that data warehouse is easy to have some "dirty" and " unstable" data. For enterprises it is worse to have a data warehouse that has error information than to have no data warehouse. The procedures of data cleaning are cleaning before integrating, cleaning after integrating and extracting after integrating. Through an example - the design and implementation of data cleaning system(DCS), the great significance of data warehouse technology in Manage and Information System is demonstrated from the application point of view and the actual function in real life is introduced.
In this paper the data query and information issuing system based on Web Database, in which the technology of ASP and Oracle database is applied, is introduced. And its design, implementation and examples are showed as well. In this system Browser/Server structure is applied in order that the client can dynamically access database information by browsers and perform the function of information issuing and query by the method of full-browser, in which ASP technology accesses databases by Oracle Objects for OLE of Oracle database to issue enterprise's information dynamically and mutually. It is proved that this system has the advantages of high security and stability and easy-operation.
引文
[1]. Van Jacobson, "Defining high-speed protocols: five challenges and an examples that survives the challenges", Selected Areas in Communications, IEEE Journal on, Volume: 135, June 1995, Pages: 828-835.
[2]. Silberchatz H. K., and Sudarshan S., Database System Concepts-Third Edition, McGraw Hill, 1996.
[3]. Webcasting in Microsoft Internet Explorer 4.0 White Paper, 1997.9.
[4]. Joshi, R. Runolfson and R. Chandak, 1997. Comprehensive Guide to JDBC, SQL, API. Coriolis Group.
[5]. Te-Chih Chen, Wei-Po Lin Chin-An Wu, and Chih-Shen, "A Client-Server Database Enviornment for Supporting Multimedia Applications,' in proceedings of the 18th IEEE annueal interneational computer software and application conference (COMPSAC'94), Taipei, Taiwan, 1994, pp215-220.
[6]. Gupta, R., Haritsa, J., Ramamritham, K., and Seshadri S., "Commit Processing in Distributed Real-Time Database Systems," Proceedings of 17th IEEE Real-Time Systems Symposium, 1996.
[7]. Eigamal T., "A pubic-key cryptosystem and a signature scheme based on discrete logarityhm," IEEE Transactions on IT, 1985, 31: 469-472.
[8]. Real Networks web site. http://www.realnetworks.com
[9]. MySQL Site. http://www.mysql.net
[10]．CCITT．号码簿验证框架，CCITT'88 Blue Book VⅡ 8 X．509．1988．
[11]．Michael J., Oracle数据库性能优化技术，学苑出版社，1994．120-160．
[12]．Sumit ASarin，《Oracle数据库管理员技术指南》，机械工业出版社，2001．04．
[13]．Peter Gulutzan and Trudy Pelzer，《SQL-3参考大全》，机械工业出版社 2000．01．
[14]. Jon Udell, "Push Me Pull You", BYTE, 1997.9.117.
[15]．Jalal Feghhi，《怎样用JavaBeans开发Web》，机械工业出版社
[16]. Buchwitz L, "Monitoring competitive intelligence using internet push technology", Competitive Intelligence Review, 1997.45.
[17]．Douglas E Corner, “用TCP／IP进行网络互连”，电子工业出版社，1998．
[18]. J W Wong, Broadcast Delivery. Proc IEEE, 1998.76.
[19]. Comer D E, "Internetworking with TCP/IP", Prentice Hall Inc., 1995.
[20]. Holbrook H, Cherlton D., "IP Muticst Channels: EXPRESS Support for Large-scale Single-source Applications" in ACM Sigcomm, 1998.08.
[21]. Microsoft, Microsoft Active Server Page Roadmap, Microsoft Windows NT service Pack3,1997.
[22]．Gunnir S.Kburana等著，《Web数据库的建立和管理》，机械工业出版社，1997．
[23]. Sun Microsystem Inc., The JDBC API Version 1.20, Palo Alto, California: Sun Microsystem Press, 1997.
[24]．Leonid Braginski,Matthew Powell,《Internet Information Server 4.0使用大全》，北京华中兴业科技发展有限公司译，人民邮电出版社，1998．
[25]. Toshihiko Takeychi、Akiyuki Sakuma, Applying task-given-type examination system to the semester examination of a university, 2002, IEEE
[26]. Wu Bing、Zhao Lindu, Web Ming Model Based on Rough Set Theory, Journal of Southeast University(English Edition), 2002.3, Vol. 18, No.1
[27]. David McSherry, Attribute-value distribution as a strategy for increasing the efficiency of data mining
[28]. Xiaodong Chen、Ilias Petrounias, An Architecture for Temporal Data Mining
[29]．王振勇，利用ASP技术实现企业技术网上查询，计算机辅助工程，2002．9，No．3
[30]．程玉、周柏涛、石丽等，Web数据库在电量查询系统中的应用，沈阳工业学院学报，2002．3，Vol．21，No．1
[31]．周小军，基于Web页面的通用查询系统，计算机应用，2002．8，Vol．22，No．8
[32]．杨兴凯，新一代Web开发环境—ASP.net，2002．4，Vo．20，No．2
[33]．张锋奇，隋秀兰，基于B／S模式的网上话费查询系统的设计，科技情报开发与经济，2002．4，Vol．4，No．12
[34]．张哲、韦庆如，基于B/S模式的变电站台帐网上查询系统，微型电脑应用，2002．3，Vol．18，No．3
[35]．张成国、石双元等，基于ASP技术的通用动态查询系统的设计与实现，计算机工程与应用，2002．21 209
[36]．罗锦 苏振中，“基于关系型数据库的故障诊断专家系统设计”，电测与仪表，2002．07．
[37]．殷国富，“基于Intranet的企业信息化系统技术与应用”，计算机科学，1999年第3期：P59．
[38]．徐宝民等，“基于模式的新型企业MIS的研究与设计”，计算机工程与应用，1999年第6期，P113．
[39]．赵洪标、周立柱，“数据库系统与WWW的集成途径”，计算机科学，1997．6，P66．
[40]．王国荣，《Active Server Pages & Web数据库》，人民邮电出版社，1999．
[41]．阳威特、熊传胜，“数据库与Web的集成及发布技术研究和应用”，微机发展，2000．5：p58-61．
[42]．赵季中、宋政湘，“基于组件事务服务器的电力局Intranet信息系统模型设计”，计算机工程与应用，200．36：157-160．
[43]．徐东晖、蔡希尧，“扩展ISAPI支持基于Web应用系统的开发”，西安电子科技大学学报，1998．25：646-649．
[44]．蔡奇玉等著，《CGI编程指南》，机械工业出版社，1997．
[45]．薛元军、颐佳雯，《网页数据库的设计与发布》，清华大学出版社，1997．
[46]．淌青松、颜亮，《ASP应用开发全攻略宝典》，中国水利水电出版社，2000．
[47]．王凯等著，《网页制作与实例》，冶金工业出版社，2000．
[48]．汪广洪，“利用ASP技术开发动态交互网页”，计算机应用，1999．5．
[49]．胡泳，“Java Applet与Servlet通讯机制的探讨”，计算机系统应用，2000．04．
[50]．余波等，《Web应用高级开发指南》，人民出版社，1999．
[51]．曲大成，“Internet Explorer 4.0的Web广播和频道技术“，电子与电脑，1998．04．
[52]．谢希任等，《计算机网络》，电子工业出版社，1994．
[53]．应刚、顾春华，《Intranet原理与应用》，上海交通大学出版社，1998．9．
[54]．蔡丹媚、黄以宽，“利用ASP轻松实现Web的动态交互访问”，计算机应用研究，1999．2．
[55]．冯玉才，《数据库系统基础》，大连理工大学出版社，1994．
[56]．彭明全，《网络实用技术》，电子科技大学出版社，2001．
[57]．徐罕、吴玉新，《网站ASP后台解决方案》，人民邮电出版社，2001．
[58]．王珊等编著，数据仓库技术与联机分析处理，科学出版社，1999
[59]．Tom Hammergren著，曹增强 王备战 等译，数据仓库技术(Data Wharehousing:Building the Corporate Knowledge Base)，中国水利水电出版社，1998
[60]．Harjinder S.GILL等著，王仲谋 刘书舟 译，数据仓库——客户／服务器计算指南，清华大学出版社，西蒙舒斯特国际出版公司，1997
[61]．高人伯、陈文伟，数据仓库和数据开采相结合的决策支持新技术，计算机世界专题综述，1997
[62]．王珊、王秋月，我国数据仓库的应用展望，计算机世界专题综述，1996
[63]. Surajit Chaudhuri and Umeshwar Dayal, An Overview of Data Warehousing and OLAP Technology
[64]. Data Management Solutions, IBM WHTTE PAPER
[65]. Data Mining Version 7.0, IBM WHTTE PAPER
[66]. Excavate Your Data, DATAMATION WHITE PAPER
[2]. Silberchatz H. K., and Sudarshan S., Database System Concepts-Third Edition, McGraw Hill, 1996.
[3]. Webcasting in Microsoft Internet Explorer 4.0 White Paper, 1997.9.
[4]. Joshi, R. Runolfson and R. Chandak, 1997. Comprehensive Guide to JDBC, SQL, API. Coriolis Group.
[5]. Te-Chih Chen, Wei-Po Lin Chin-An Wu, and Chih-Shen, "A Client-Server Database Enviornment for Supporting Multimedia Applications,' in proceedings of the 18th IEEE annueal interneational computer software and application conference (COMPSAC'94), Taipei, Taiwan, 1994, pp215-220.
[6]. Gupta, R., Haritsa, J., Ramamritham, K., and Seshadri S., "Commit Processing in Distributed Real-Time Database Systems," Proceedings of 17th IEEE Real-Time Systems Symposium, 1996.
[7]. Eigamal T., "A pubic-key cryptosystem and a signature scheme based on discrete logarityhm," IEEE Transactions on IT, 1985, 31: 469-472.
[8]. Real Networks web site. http://www.realnetworks.com
[9]. MySQL Site. http://www.mysql.net
[10]．CCITT．号码簿验证框架，CCITT'88 Blue Book VⅡ 8 X．509．1988．
[11]．Michael J., Oracle数据库性能优化技术，学苑出版社，1994．120-160．
[12]．Sumit ASarin，《Oracle数据库管理员技术指南》，机械工业出版社，2001．04．
[13]．Peter Gulutzan and Trudy Pelzer，《SQL-3参考大全》，机械工业出版社 2000．01．
[14]. Jon Udell, "Push Me Pull You", BYTE, 1997.9.117.
[15]．Jalal Feghhi，《怎样用JavaBeans开发Web》，机械工业出版社
[16]. Buchwitz L, "Monitoring competitive intelligence using internet push technology", Competitive Intelligence Review, 1997.45.
[17]．Douglas E Corner, “用TCP／IP进行网络互连”，电子工业出版社，1998．
[18]. J W Wong, Broadcast Delivery. Proc IEEE, 1998.76.
[19]. Comer D E, "Internetworking with TCP/IP", Prentice Hall Inc., 1995.
[20]. Holbrook H, Cherlton D., "IP Muticst Channels: EXPRESS Support for Large-scale Single-source Applications" in ACM Sigcomm, 1998.08.
[21]. Microsoft, Microsoft Active Server Page Roadmap, Microsoft Windows NT service Pack3,1997.
[22]．Gunnir S.Kburana等著，《Web数据库的建立和管理》，机械工业出版社，1997．
[23]. Sun Microsystem Inc., The JDBC API Version 1.20, Palo Alto, California: Sun Microsystem Press, 1997.
[24]．Leonid Braginski,Matthew Powell,《Internet Information Server 4.0使用大全》，北京华中兴业科技发展有限公司译，人民邮电出版社，1998．
[25]. Toshihiko Takeychi、Akiyuki Sakuma, Applying task-given-type examination system to the semester examination of a university, 2002, IEEE
[26]. Wu Bing、Zhao Lindu, Web Ming Model Based on Rough Set Theory, Journal of Southeast University(English Edition), 2002.3, Vol. 18, No.1
[27]. David McSherry, Attribute-value distribution as a strategy for increasing the efficiency of data mining
[28]. Xiaodong Chen、Ilias Petrounias, An Architecture for Temporal Data Mining
[29]．王振勇，利用ASP技术实现企业技术网上查询，计算机辅助工程，2002．9，No．3
[30]．程玉、周柏涛、石丽等，Web数据库在电量查询系统中的应用，沈阳工业学院学报，2002．3，Vol．21，No．1
[31]．周小军，基于Web页面的通用查询系统，计算机应用，2002．8，Vol．22，No．8
[32]．杨兴凯，新一代Web开发环境—ASP.net，2002．4，Vo．20，No．2
[33]．张锋奇，隋秀兰，基于B／S模式的网上话费查询系统的设计，科技情报开发与经济，2002．4，Vol．4，No．12
[34]．张哲、韦庆如，基于B/S模式的变电站台帐网上查询系统，微型电脑应用，2002．3，Vol．18，No．3
[35]．张成国、石双元等，基于ASP技术的通用动态查询系统的设计与实现，计算机工程与应用，2002．21 209
[36]．罗锦 苏振中，“基于关系型数据库的故障诊断专家系统设计”，电测与仪表，2002．07．
[37]．殷国富，“基于Intranet的企业信息化系统技术与应用”，计算机科学，1999年第3期：P59．
[38]．徐宝民等，“基于模式的新型企业MIS的研究与设计”，计算机工程与应用，1999年第6期，P113．
[39]．赵洪标、周立柱，“数据库系统与WWW的集成途径”，计算机科学，1997．6，P66．
[40]．王国荣，《Active Server Pages & Web数据库》，人民邮电出版社，1999．
[41]．阳威特、熊传胜，“数据库与Web的集成及发布技术研究和应用”，微机发展，2000．5：p58-61．
[42]．赵季中、宋政湘，“基于组件事务服务器的电力局Intranet信息系统模型设计”，计算机工程与应用，200．36：157-160．
[43]．徐东晖、蔡希尧，“扩展ISAPI支持基于Web应用系统的开发”，西安电子科技大学学报，1998．25：646-649．
[44]．蔡奇玉等著，《CGI编程指南》，机械工业出版社，1997．
[45]．薛元军、颐佳雯，《网页数据库的设计与发布》，清华大学出版社，1997．
[46]．淌青松、颜亮，《ASP应用开发全攻略宝典》，中国水利水电出版社，2000．
[47]．王凯等著，《网页制作与实例》，冶金工业出版社，2000．
[48]．汪广洪，“利用ASP技术开发动态交互网页”，计算机应用，1999．5．
[49]．胡泳，“Java Applet与Servlet通讯机制的探讨”，计算机系统应用，2000．04．
[50]．余波等，《Web应用高级开发指南》，人民出版社，1999．
[51]．曲大成，“Internet Explorer 4.0的Web广播和频道技术“，电子与电脑，1998．04．
[52]．谢希任等，《计算机网络》，电子工业出版社，1994．
[53]．应刚、顾春华，《Intranet原理与应用》，上海交通大学出版社，1998．9．
[54]．蔡丹媚、黄以宽，“利用ASP轻松实现Web的动态交互访问”，计算机应用研究，1999．2．
[55]．冯玉才，《数据库系统基础》，大连理工大学出版社，1994．
[56]．彭明全，《网络实用技术》，电子科技大学出版社，2001．
[57]．徐罕、吴玉新，《网站ASP后台解决方案》，人民邮电出版社，2001．
[58]．王珊等编著，数据仓库技术与联机分析处理，科学出版社，1999
[59]．Tom Hammergren著，曹增强 王备战 等译，数据仓库技术(Data Wharehousing:Building the Corporate Knowledge Base)，中国水利水电出版社，1998
[60]．Harjinder S.GILL等著，王仲谋 刘书舟 译，数据仓库——客户／服务器计算指南，清华大学出版社，西蒙舒斯特国际出版公司，1997
[61]．高人伯、陈文伟，数据仓库和数据开采相结合的决策支持新技术，计算机世界专题综述，1997
[62]．王珊、王秋月，我国数据仓库的应用展望，计算机世界专题综述，1996
[63]. Surajit Chaudhuri and Umeshwar Dayal, An Overview of Data Warehousing and OLAP Technology
[64]. Data Management Solutions, IBM WHTTE PAPER
[65]. Data Mining Version 7.0, IBM WHTTE PAPER
[66]. Excavate Your Data, DATAMATION WHITE PAPER