Web分布式数据库系统研究与实现
|
摘要
在分布式数据库系统环境下，信息可能存储在异构的、
地理位置分散的数据库中。如何在全局逻辑上检索、更新分
布在分布式数据库中的数据，是分布式数据库技术要着力解
决的问题。分布式数据库技术是数据库技术和计算机网络技
术的结合，它除了具有集中式数据库所具有的特点外，还具
有它自己独有的特点：它不但要考虑局部场地的自治，而且
要着力解决全局数据库的逻辑整体性；它除了具有集中式数
据库所具有数据逻辑独立性和物理独立性外，还具有数据的
分布独立性，这包括三个层次，从高到低依次是：分片透明
性、分配透明性、局部场地数据模型的透明性，另外，在查
询处理、事务管理、并发控制、数据的完整性与安全性等方
面，分布式数据库系统比集中式数据库系统具有更复杂更丰
富的内容。
本文首先简单介绍集中式数据库的一些知识，然后主要
介绍了分布式数据库的一些技术，包括分布式数据库系统的
体系结构、数据分片及分配、分布式查询处理、分布式事务
管理、分布式并发控制、分布式数据库的完整性与安全性和
分布式数据库系统设计。最后给出了一个分布式数据库系统
应用的具体实例。
这个具体实例是有关一个总公司下属的各个分公司将
本公司数据库中的数据传到总公司的数据库服务器上，以便
于总公司的经理对各分公司的生产和经营进行分析和评价，
并进而为做出全局决策提供信息。为了达到这个目标，各分
公司与总公司的数据库管理系统是必不可少的，另外，还必
须借助局域网或广域网在总公司与各分公司间传输数据。数
据传输是利用PowerBuilder的数据管道实现的。应用中还给
出了分布式系统的安全性的具体实现、分布数据管理以及分
布数据的透明查询。分布数据管理体现了各个场地的数据独
立性、全局数据库逻辑整体性和局部数据与全局数据通过数
据传输相互关联。数据传输的安全通过使用安全协议和建立
虚拟专用网来实现。与此类似的应用系统，通常采用客户/
服务器二层结构，本应用系统采用三层结构实现，扩展了系
统的应用范围。在各个分公司场地上，不但可以向总公司的
数据库传输数据，而且可以在各个分公司场地间实现数据透
卜U霎弓爿 故十堂1六井寸
IS章因／门”人上 卞卜人〔人
丫’。。一Y v乃乃RS 工旺SIS
明查询。在这个应用系统中，各个分公司场地上数据的透明
查询，都将总公司做为一个应用服务器。
分布数据的透明查询的具体实现是：首先，某一个分公
司给出需要查询的数据，通过该分公司与总公司事先定义的
连接，在总公司的数据库中进行查找，如果没有找到，在总：
公司场地上，分门别类地到相应的分公司的数据库中查找，－乎
如果找到，就将查找结果返回给请求查找的场地，如果没找 卜“
到，则将没有找到信息返回给请求查找的场地。
在总公司场地上不但可以接收各个分公司场地上传来
的数据，而且能以Web技术发布到WTERNET网上。
~I3 S Th~c~T?
Information might be stored in heterogeneous
location-distributed databases in distributed database
system environments. How to select and renew data
distributed in distributed database system in global
logic is problems which distributed database
technologies mainly solve, distributed database
technologies are combined with database technologies
and computer network technologies. Besides the
characters of central database, it has its own
specialities:It not only thinks of the autonomy of local node,but
focuses on solving the logical integrity of global database;
Except that it possesses logical independency and physical
independency that central database has,it has data distribution
independency that includes three layers of meanings which,
from the top to the bottom,in turn are :slicing transparency
allocation transparency data type transparency on
local node . In addition, in query conduct ?. transaction
management concurrence control . data integrity and
security and so on , distributed database system has more
complex and richer content.
The dissertation simply introduces some knowledge
of central database at first, then mainly introduces
some knowledge of distributed database including
the system structure of distributed database system
data slicing and data allocation ... distributed query
conduct .. distributed transaction management
distributed concurrence control .. distributed database
integrity and security and distributed database
system development, At last give a tangible
application example of distributed database system.
The example is that each sub-company in a
general company transfer the data in its own
database into the database server of the general
company so that the general manager anaiyses and
~III~v~
evalutes the prodctiofl and management of each
sub-company through which the manager makes
general decisions. To realize this target , databases
of each sub-company and the general company are
indispensible, in addition, data must be transferred
between each sub-company and the general
company through the local area network or wide
area network. Data transfer is realized by
PowerBuilder?Pipeline. In application programme,
also give tangible realization of security of the
distributed system and the management of
distributed data and the transparent query of distributed data.
The management of distributed data incarnates local
data抯 independence global data抯 integrity and the
relation of local data and global data through
data transfer. Through the security protocol, the
security of data transfer can be ensured.ApplicatiOfl
systems similar to the application system usually adopt two
layer structure of clientlserver.The application system adopt
three layer structure,which extends application scope of the
application system. .On every sub-company node, not only
transfer data into the database of the general company ,but also
among sub-company node realize the transparent query of
distributed data . In this implication system, the transparent
query of distributed data on every sub-company node all
regards the general company node as implication server.
The real realization of the transparent query of distributed
r
地理位置分散的数据库中。如何在全局逻辑上检索、更新分
布在分布式数据库中的数据，是分布式数据库技术要着力解
决的问题。分布式数据库技术是数据库技术和计算机网络技
术的结合，它除了具有集中式数据库所具有的特点外，还具
有它自己独有的特点：它不但要考虑局部场地的自治，而且
要着力解决全局数据库的逻辑整体性；它除了具有集中式数
据库所具有数据逻辑独立性和物理独立性外，还具有数据的
分布独立性，这包括三个层次，从高到低依次是：分片透明
性、分配透明性、局部场地数据模型的透明性，另外，在查
询处理、事务管理、并发控制、数据的完整性与安全性等方
面，分布式数据库系统比集中式数据库系统具有更复杂更丰
富的内容。
本文首先简单介绍集中式数据库的一些知识，然后主要
介绍了分布式数据库的一些技术，包括分布式数据库系统的
体系结构、数据分片及分配、分布式查询处理、分布式事务
管理、分布式并发控制、分布式数据库的完整性与安全性和
分布式数据库系统设计。最后给出了一个分布式数据库系统
应用的具体实例。
这个具体实例是有关一个总公司下属的各个分公司将
本公司数据库中的数据传到总公司的数据库服务器上，以便
于总公司的经理对各分公司的生产和经营进行分析和评价，
并进而为做出全局决策提供信息。为了达到这个目标，各分
公司与总公司的数据库管理系统是必不可少的，另外，还必
须借助局域网或广域网在总公司与各分公司间传输数据。数
据传输是利用PowerBuilder的数据管道实现的。应用中还给
出了分布式系统的安全性的具体实现、分布数据管理以及分
布数据的透明查询。分布数据管理体现了各个场地的数据独
立性、全局数据库逻辑整体性和局部数据与全局数据通过数
据传输相互关联。数据传输的安全通过使用安全协议和建立
虚拟专用网来实现。与此类似的应用系统，通常采用客户/
服务器二层结构，本应用系统采用三层结构实现，扩展了系
统的应用范围。在各个分公司场地上，不但可以向总公司的
数据库传输数据，而且可以在各个分公司场地间实现数据透
卜U霎弓爿 故十堂1六井寸
IS章因／门”人上 卞卜人〔人
丫’。。一Y v乃乃RS 工旺SIS
明查询。在这个应用系统中，各个分公司场地上数据的透明
查询，都将总公司做为一个应用服务器。
分布数据的透明查询的具体实现是：首先，某一个分公
司给出需要查询的数据，通过该分公司与总公司事先定义的
连接，在总公司的数据库中进行查找，如果没有找到，在总：
公司场地上，分门别类地到相应的分公司的数据库中查找，－乎
如果找到，就将查找结果返回给请求查找的场地，如果没找 卜“
到，则将没有找到信息返回给请求查找的场地。
在总公司场地上不但可以接收各个分公司场地上传来
的数据，而且能以Web技术发布到WTERNET网上。
~I3 S Th~c~T?
Information might be stored in heterogeneous
location-distributed databases in distributed database
system environments. How to select and renew data
distributed in distributed database system in global
logic is problems which distributed database
technologies mainly solve, distributed database
technologies are combined with database technologies
and computer network technologies. Besides the
characters of central database, it has its own
specialities:It not only thinks of the autonomy of local node,but
focuses on solving the logical integrity of global database;
Except that it possesses logical independency and physical
independency that central database has,it has data distribution
independency that includes three layers of meanings which,
from the top to the bottom,in turn are :slicing transparency
allocation transparency data type transparency on
local node . In addition, in query conduct ?. transaction
management concurrence control . data integrity and
security and so on , distributed database system has more
complex and richer content.
The dissertation simply introduces some knowledge
of central database at first, then mainly introduces
some knowledge of distributed database including
the system structure of distributed database system
data slicing and data allocation ... distributed query
conduct .. distributed transaction management
distributed concurrence control .. distributed database
integrity and security and distributed database
system development, At last give a tangible
application example of distributed database system.
The example is that each sub-company in a
general company transfer the data in its own
database into the database server of the general
company so that the general manager anaiyses and
~III~v~
evalutes the prodctiofl and management of each
sub-company through which the manager makes
general decisions. To realize this target , databases
of each sub-company and the general company are
indispensible, in addition, data must be transferred
between each sub-company and the general
company through the local area network or wide
area network. Data transfer is realized by
PowerBuilder?Pipeline. In application programme,
also give tangible realization of security of the
distributed system and the management of
distributed data and the transparent query of distributed data.
The management of distributed data incarnates local
data抯 independence global data抯 integrity and the
relation of local data and global data through
data transfer. Through the security protocol, the
security of data transfer can be ensured.ApplicatiOfl
systems similar to the application system usually adopt two
layer structure of clientlserver.The application system adopt
three layer structure,which extends application scope of the
application system. .On every sub-company node, not only
transfer data into the database of the general company ,but also
among sub-company node realize the transparent query of
distributed data . In this implication system, the transparent
query of distributed data on every sub-company node all
regards the general company node as implication server.
The real realization of the transparent query of distributed
r
引文
[1] A.Sheth and J.L.Larson ,Federated:Architectures and Integration.ACM Comput.Surv.,Special Issue on Heterogeneous Databases,A.Elmagarmid and C.Pu(eds),1990
[2] A.R.Hevner,S.B.Yao, Optimization Algorithms for Distributed Queries,IEEE-TSE,SE-9:1,1983
[3] Alex Berson,George Anderson. Sybase and client/server computing, 2rd ED. McGraw-Hill. 1999
[4] B.Jeffery. Enterprise Client/Server Computing, Informating Systems Management,Vol. 13, No.4,1996
[5] J.D.Ullman, Principles of Database and Knowledge-base Systems, Vol. I , II .Compute Science Press, 1988, ISBN 088175-188-X(X. 1)
[6] David Bell, Jane Grimson. Distributed database systems. Addison-Wesley, 1992
[7] George Coulouris,Jean Dollinore and Tim Kindberg. Distributed System Concepts and Design,2rd ED. Addison-Wesley. 1994
[8] Jeffrey D.Ullman,Jennifer Widom.A First course in database system. Prentice Hall. 1997
[9] Philip A. Bernstein, et al.,Concurrency Control and Recovery in Database Systems ,Addison-Wesley Publishing Company ,1987,ISBN 0-201-10715-5
[10] Litwin et al.,SIRIUS Systems for Distributed Data Management ,In Distributed Data Bases, H.-J.Schneider(ed.),Amsterdam:North-Holland, 1982
[11] Christor H. Papadimitrion, The Theory of Database Concurrency Control,Computer Science Press ,1986,Isbn-0-88175-027-1
[12] Hypertext Transfer Protocol-HTTP/1． 1 RFC 2616
[13] N.Goodman,P.A.Bernstern,E.Wong rt al.,Query Processing in SDD1 :A System for Distributed Database, ACM-TODS,6:4,1981
[14] M.Tarner Ozsu,Patrick Valduriez. Distributed Data Management: Unsolved Promblems and New Issues
[15] Nandit Soparkar,Henry E.Korth, Abraham Silberschatz. Transaction Management for Distributed Multidatabases.
[16] A.L.P.Chen,V.O.K.Li,Optimising Star Queries in a Distributed Database System ,Proc.VLDB,1984
[17] N.G.Joan distributed Query Management for a Local
Network,IEEE, 1981
[18] M.TEMPleton, Mermaid-A Front-End to Distributed Heterogeneous Database System ,Proc. IEEE(May 1987),75(5)
[19] Ozsu. M.Tamer, P. valduriez,Principles of Distributed Database Systems,Orentice-Hall,Inc, 1991
[20] Randy chow, Theodore Johnson. Distributed operating systems & algorithms. Addison Wesley, 1997
[21] S.Kent,et al. Security Architecture for the Internet Protocol, RFC2401.November 1998
[22] Stefano Ceri,Giuseppe Pelagatti,Distributed Databases Principles and Systems,McGraw-Hill Book Company, 1984,ISON 0-07-010829-3
[23] Epstein R, Stonebraker M R. Analysis of Distributed Database Processing Strategies. in Proceedings of VLDB,1980
[24] Security Architecture for the Internet Procotol, RFC2401
[25] Obermarck R. Distributed Deadlock Detection Algorithm. ACM TODS, Volume 7, Number 2, 1982
[26] Using Java Applets and CORBA for Multi-user Distributed Applications, IEEE Internet Computing, May-June 1997
[27] Venkat N.Gudivada, Vijay V. Roghvavan, William I.Grosky, Rajesh Kasanagotlu. Information Retrieval on the World Wide Web. IEEE Internet Computing September. October, 1997
[28] Won Kim. Modern database systems. Addisn-Wesley, 1995
[29] 苏运霖。分布式系统与分布式算法，暨南大学出版社。1995
[30] 萨师煊，王珊，数据库系统概论。高等教育出版社，1991
[31] Lampson B, Sturgis H. Crash Recovery in a Distributed Data Storage System. Technical Report, Computer Science Laboratory, Xerox, Palo Alto Research Center, Palo Alto,CA, 1976
[32] 动态Web网页技大全，於志渊，清华大学出版社，1999，10
[33] The Common Gateway Interface. http://hoohoo.ncsa.uiuc.edu/cgi/overview.html
[34] Peter T.Davis,Barry D.Lewis著，薛荣华等译。计算机安全保密指南，电子工业出版社。1994
[35] Apers P M G. Yao S B. Optimization Algorithms for Distributed Queries,IEEE Transaction on Software Engineering, Volume SE-9,Number 1, January 1983
[36] 刘红岩，何军。PowerBuilder原理与应用指南，电子工业出版社。1999
[37] 王珊，陈红，文继荣。数据库和数据库管理系统。北京：电子工业出版社1995
[38]Larson J A, Ratrimi S K。Tutorial: Distributed Database Management。IEEE Computer Souenty Pr., 1983
[39] 朱海滨。分布式系统原理与设计，国防科技大学。1997
[40]DOUGLAS E. COMER著，林瑶，蒋慧，杜蔚轩等译。用TCP/IP进行网际互连 第1卷：原理、协议和体系结构(第3版)，电子工业出版社。1998
[41]严蔚敏，吴伟民。数据结构，清华大学出版社。1998，118-138
[42]Java程序设计与开发教程，机械工业出版社1998
[43]Tamer Ozsu M, Valduriez P. Principles of Distributed Database Systems. Prentice-Hall International Inc. 1991
[44]Kohler W H. A Survey of Techniques for Synchronization and Recovery in Decentralized Computer Systems. in Proceedings of VLDB, 1980
[45]Bhargava B(Editor), Concurrency and Reliability in Distributed Systems. Van Nostrand Reinhold, New York, 1987
[46]郑振眉，于戈，郭敏。分布式数据库，科学出版社。1997，1-23
[47]Kambayashi Y, Yoshikawa M, Yajima S. Query Processing for Distributed Database Management Systems. ACM TODS, Volume7, Number3, September 1982
[48]Berntstein P A, Chiu D W. Using Semijoins to Solve Relational Queries. Journal of the ACM, Volume, Number 1, January 1981
[49]谢希仁。计算机网络(第2版)，电子工业出版社。1999，269-277
[50]胡道元。INTRANET网络技术及应用，清华大学出版社。1998，280-355
[51]Mahmoud S, Riordon J S. Optimal Allocation of Resources in Distributed Information Networks. ACM TODS, Vol. 1, No.1, January 1976
[52]Ceri S, Navathe B, Wiederhold G. Distribution Design of Logical Database Schemas. IEEE Transactions on Software Engineering, Vol.SE-9, No.4, July 1983
[53]Daniel J. Berlin, et al著，丁一强，刘瑞红等译。精通CGI编程，清华大学出版社。1998
[54]Jajodia S, Mutchler D. Dynamic Voting Algorithms for Maintaining the Consistency of a Replicated Database. ACM TODS, Volume 15, Number2, June 1990
[55]Scot Johnson著，新智工作室译。Active Server Pages祥解，电子工业出版社。1999
[56]王以和，涂小平编、分布式数据库系统。北京：电子工业出版社，1988
[57]刘云生著，数据库设计与分析。华中理工大学出版社，1993
[58]沃得工作室 编著PowerBuilder6.0应用开发指南(编程篇)。人民邮电出版社，1999
[59]Web数据库开发进阶，唐东，人民邮电出版社，1999，8
[2] A.R.Hevner,S.B.Yao, Optimization Algorithms for Distributed Queries,IEEE-TSE,SE-9:1,1983
[3] Alex Berson,George Anderson. Sybase and client/server computing, 2rd ED. McGraw-Hill. 1999
[4] B.Jeffery. Enterprise Client/Server Computing, Informating Systems Management,Vol. 13, No.4,1996
[5] J.D.Ullman, Principles of Database and Knowledge-base Systems, Vol. I , II .Compute Science Press, 1988, ISBN 088175-188-X(X. 1)
[6] David Bell, Jane Grimson. Distributed database systems. Addison-Wesley, 1992
[7] George Coulouris,Jean Dollinore and Tim Kindberg. Distributed System Concepts and Design,2rd ED. Addison-Wesley. 1994
[8] Jeffrey D.Ullman,Jennifer Widom.A First course in database system. Prentice Hall. 1997
[9] Philip A. Bernstein, et al.,Concurrency Control and Recovery in Database Systems ,Addison-Wesley Publishing Company ,1987,ISBN 0-201-10715-5
[10] Litwin et al.,SIRIUS Systems for Distributed Data Management ,In Distributed Data Bases, H.-J.Schneider(ed.),Amsterdam:North-Holland, 1982
[11] Christor H. Papadimitrion, The Theory of Database Concurrency Control,Computer Science Press ,1986,Isbn-0-88175-027-1
[12] Hypertext Transfer Protocol-HTTP/1． 1 RFC 2616
[13] N.Goodman,P.A.Bernstern,E.Wong rt al.,Query Processing in SDD1 :A System for Distributed Database, ACM-TODS,6:4,1981
[14] M.Tarner Ozsu,Patrick Valduriez. Distributed Data Management: Unsolved Promblems and New Issues
[15] Nandit Soparkar,Henry E.Korth, Abraham Silberschatz. Transaction Management for Distributed Multidatabases.
[16] A.L.P.Chen,V.O.K.Li,Optimising Star Queries in a Distributed Database System ,Proc.VLDB,1984
[17] N.G.Joan distributed Query Management for a Local
Network,IEEE, 1981
[18] M.TEMPleton, Mermaid-A Front-End to Distributed Heterogeneous Database System ,Proc. IEEE(May 1987),75(5)
[19] Ozsu. M.Tamer, P. valduriez,Principles of Distributed Database Systems,Orentice-Hall,Inc, 1991
[20] Randy chow, Theodore Johnson. Distributed operating systems & algorithms. Addison Wesley, 1997
[21] S.Kent,et al. Security Architecture for the Internet Protocol, RFC2401.November 1998
[22] Stefano Ceri,Giuseppe Pelagatti,Distributed Databases Principles and Systems,McGraw-Hill Book Company, 1984,ISON 0-07-010829-3
[23] Epstein R, Stonebraker M R. Analysis of Distributed Database Processing Strategies. in Proceedings of VLDB,1980
[24] Security Architecture for the Internet Procotol, RFC2401
[25] Obermarck R. Distributed Deadlock Detection Algorithm. ACM TODS, Volume 7, Number 2, 1982
[26] Using Java Applets and CORBA for Multi-user Distributed Applications, IEEE Internet Computing, May-June 1997
[27] Venkat N.Gudivada, Vijay V. Roghvavan, William I.Grosky, Rajesh Kasanagotlu. Information Retrieval on the World Wide Web. IEEE Internet Computing September. October, 1997
[28] Won Kim. Modern database systems. Addisn-Wesley, 1995
[29] 苏运霖。分布式系统与分布式算法，暨南大学出版社。1995
[30] 萨师煊，王珊，数据库系统概论。高等教育出版社，1991
[31] Lampson B, Sturgis H. Crash Recovery in a Distributed Data Storage System. Technical Report, Computer Science Laboratory, Xerox, Palo Alto Research Center, Palo Alto,CA, 1976
[32] 动态Web网页技大全，於志渊，清华大学出版社，1999，10
[33] The Common Gateway Interface. http://hoohoo.ncsa.uiuc.edu/cgi/overview.html
[34] Peter T.Davis,Barry D.Lewis著，薛荣华等译。计算机安全保密指南，电子工业出版社。1994
[35] Apers P M G. Yao S B. Optimization Algorithms for Distributed Queries,IEEE Transaction on Software Engineering, Volume SE-9,Number 1, January 1983
[36] 刘红岩，何军。PowerBuilder原理与应用指南，电子工业出版社。1999
[37] 王珊，陈红，文继荣。数据库和数据库管理系统。北京：电子工业出版社1995
[38]Larson J A, Ratrimi S K。Tutorial: Distributed Database Management。IEEE Computer Souenty Pr., 1983
[39] 朱海滨。分布式系统原理与设计，国防科技大学。1997
[40]DOUGLAS E. COMER著，林瑶，蒋慧，杜蔚轩等译。用TCP/IP进行网际互连 第1卷：原理、协议和体系结构(第3版)，电子工业出版社。1998
[41]严蔚敏，吴伟民。数据结构，清华大学出版社。1998，118-138
[42]Java程序设计与开发教程，机械工业出版社1998
[43]Tamer Ozsu M, Valduriez P. Principles of Distributed Database Systems. Prentice-Hall International Inc. 1991
[44]Kohler W H. A Survey of Techniques for Synchronization and Recovery in Decentralized Computer Systems. in Proceedings of VLDB, 1980
[45]Bhargava B(Editor), Concurrency and Reliability in Distributed Systems. Van Nostrand Reinhold, New York, 1987
[46]郑振眉，于戈，郭敏。分布式数据库，科学出版社。1997，1-23
[47]Kambayashi Y, Yoshikawa M, Yajima S. Query Processing for Distributed Database Management Systems. ACM TODS, Volume7, Number3, September 1982
[48]Berntstein P A, Chiu D W. Using Semijoins to Solve Relational Queries. Journal of the ACM, Volume, Number 1, January 1981
[49]谢希仁。计算机网络(第2版)，电子工业出版社。1999，269-277
[50]胡道元。INTRANET网络技术及应用，清华大学出版社。1998，280-355
[51]Mahmoud S, Riordon J S. Optimal Allocation of Resources in Distributed Information Networks. ACM TODS, Vol. 1, No.1, January 1976
[52]Ceri S, Navathe B, Wiederhold G. Distribution Design of Logical Database Schemas. IEEE Transactions on Software Engineering, Vol.SE-9, No.4, July 1983
[53]Daniel J. Berlin, et al著，丁一强，刘瑞红等译。精通CGI编程，清华大学出版社。1998
[54]Jajodia S, Mutchler D. Dynamic Voting Algorithms for Maintaining the Consistency of a Replicated Database. ACM TODS, Volume 15, Number2, June 1990
[55]Scot Johnson著，新智工作室译。Active Server Pages祥解，电子工业出版社。1999
[56]王以和，涂小平编、分布式数据库系统。北京：电子工业出版社，1988
[57]刘云生著，数据库设计与分析。华中理工大学出版社，1993
[58]沃得工作室 编著PowerBuilder6.0应用开发指南(编程篇)。人民邮电出版社，1999
[59]Web数据库开发进阶，唐东，人民邮电出版社，1999，8