基于Web Service异构数据集成技术的研究
|
摘要
随着Internet的飞速发展,网络迅速成为一种重要的信息传播和交换的手段,在Web上出现了丰富的数据资源。为了更有效的利用这些数据资源,需要在一个统一的平台上对这些数据资源进行集成和访问。
传统的数据库集成方法已经逐渐不能适应人们获取数据的需求,它们在动态的添加或删除数据源方面、支持异构数据源之间的互操作性方面及如何模型化源数据内容和用户查询等方面存在着许多的不足。因此,本文提出了一种以XML为数据交换格式,使用XML Schema建立全局模型,Mediator集成模式的基于Web Service框架的异构数据库数据集成中间件HDIM。通过在分布式环境下建立一个公共的集成环境,屏蔽了各个异构数据源的平台、系统环境、内部数据结构等方面的异构性,对它们进行无缝连接,为用户提供一个统一和透明的访问接口,实现了对异构数据源间关联数据的访问和发布。本文主要研究内容如下:
1)提出异构数据源集成中间件HDIM体系结构的设计。提出并设计了以XML为共享数据的交换格式的模式异构数据库数据集成中间件HDIM。
2)将Web Service技术融入到异构数据集成的系统框架中,实现了应用系统前端和局部数据源包装的零维护。
3)关系模式到XML模式转换算法的设计和实现。通过对数据库关系模式和XML Schema分析,提出了合理有效的关系模式到XML Schema模式转换算法。
4)数据查询处理器和结果集成器的结构设计及算法流程;提出了查询分配算法,对基于GAV方法的查询分配算法在权限控制方面进行了改进。
With the rapid development of Internet, the network is rapidly becoming an important means of information dissemination and exchange, on the web a wealthy of information resources. To make an effective use of those data source, we need a unifie platform for data integration and visit.
The traditional way of data integration has far from the people’need of obtaining data.There are a lot of defects in dynamic adding or deleting data sources,supporting the interoperability among heterogeneous data source,the way of making mode of data source contents as a model and custom query and so on.Thus the paper proposes a kind of design and realizing program, which uses XML data transforming format, XML Schema to built a public model and Heterogeneous Data Integration Middleware (HDIM) and it is based on the framework of the Web Service.To set up a public integrated environment under distributed which shields all the differences in aspects of data source including the platform, system environment and internal data structure and so on. It provides a unified and transparent interface for all the users to implement the accession and publication of relative data among heterogeneous data sources. The followings are the main study of the content:
1)The design of the mediator of heterogeneous data source integration. Present and design HDIM, which is based on XML as shared data transforming format.
2)Using the technology of Web Service into the HDIM.It plays an effort that makes client side and the wrapper none of the maintaining.
3)The design and realization from the public model to XML model.Through the analysis of the public model of databases and XML Schema, the transform from relation schema to reasonable and effective XML schema is proposed.
4)The structure design and the arithmetic flow of the data inquiry processor and result integration processor.The inquiry assign arithmetic is presented. The inquiry assign base on GAV technology is improved in the aspect of the purview control.
传统的数据库集成方法已经逐渐不能适应人们获取数据的需求,它们在动态的添加或删除数据源方面、支持异构数据源之间的互操作性方面及如何模型化源数据内容和用户查询等方面存在着许多的不足。因此,本文提出了一种以XML为数据交换格式,使用XML Schema建立全局模型,Mediator集成模式的基于Web Service框架的异构数据库数据集成中间件HDIM。通过在分布式环境下建立一个公共的集成环境,屏蔽了各个异构数据源的平台、系统环境、内部数据结构等方面的异构性,对它们进行无缝连接,为用户提供一个统一和透明的访问接口,实现了对异构数据源间关联数据的访问和发布。本文主要研究内容如下:
1)提出异构数据源集成中间件HDIM体系结构的设计。提出并设计了以XML为共享数据的交换格式的模式异构数据库数据集成中间件HDIM。
2)将Web Service技术融入到异构数据集成的系统框架中,实现了应用系统前端和局部数据源包装的零维护。
3)关系模式到XML模式转换算法的设计和实现。通过对数据库关系模式和XML Schema分析,提出了合理有效的关系模式到XML Schema模式转换算法。
4)数据查询处理器和结果集成器的结构设计及算法流程;提出了查询分配算法,对基于GAV方法的查询分配算法在权限控制方面进行了改进。
With the rapid development of Internet, the network is rapidly becoming an important means of information dissemination and exchange, on the web a wealthy of information resources. To make an effective use of those data source, we need a unifie platform for data integration and visit.
The traditional way of data integration has far from the people’need of obtaining data.There are a lot of defects in dynamic adding or deleting data sources,supporting the interoperability among heterogeneous data source,the way of making mode of data source contents as a model and custom query and so on.Thus the paper proposes a kind of design and realizing program, which uses XML data transforming format, XML Schema to built a public model and Heterogeneous Data Integration Middleware (HDIM) and it is based on the framework of the Web Service.To set up a public integrated environment under distributed which shields all the differences in aspects of data source including the platform, system environment and internal data structure and so on. It provides a unified and transparent interface for all the users to implement the accession and publication of relative data among heterogeneous data sources. The followings are the main study of the content:
1)The design of the mediator of heterogeneous data source integration. Present and design HDIM, which is based on XML as shared data transforming format.
2)Using the technology of Web Service into the HDIM.It plays an effort that makes client side and the wrapper none of the maintaining.
3)The design and realization from the public model to XML model.Through the analysis of the public model of databases and XML Schema, the transform from relation schema to reasonable and effective XML schema is proposed.
4)The structure design and the arithmetic flow of the data inquiry processor and result integration processor.The inquiry assign arithmetic is presented. The inquiry assign base on GAV technology is improved in the aspect of the purview control.
引文
[1] 曹国法.企业信息化生产生孤岛的根源及解决方法分析. http://www.globrand.com/2004/09/22/20040922_13329_1.shtml
[2] 陈跃国,王京春.数据集成综述.计算机科学,2004,38(5):48-51
[3] 靳强勇,李冠宇,张俊.异构数据集成技术的发展和现状.计算机工程与应用,2002:38(11)
[4] 郭绍发.浅淡企业数据集成实践研究[J].计算机应用世界,2003,1-2
[5] 周锦涛.企业异构数据源集成.计算机世界,2005,(4):32
[6] Hector Garcia,Joachim Hammer,Kelly Ireland.Integrating and Accessing Heterogeneous Information Sources in TSIMMIS.1997.3,8(2):117-132
[7] The TSIMMIS Project.http://www-db.stanford.edu/tsimmis/
[8] 王宁,王能斌.异构数据源集成系统查询分解和优化的实现.软件学报,2000,11(2)
[9] Chaitan Baru,Amarnath Gupta,Bertram Ludascher.XML_Based XML Information mediator with MIX
[10] H.Gareia,Y.Papakonstantinou,et al.The TSIMMIS Projeet:Integration of heterogeneous information sources[J].Journal of Intelligent Information System,1997.3,8(2): 117-132
[11] 王宁.基于带根连通有向图的对象集成模型及代数.软件学报,1998,9(12):894-898
[12] Elliotte Rusty,W.Scott.XML 技术手册.北京:中国电力出版社.2001.11: 261-263
[13] 孙一中.XML 理论和应用基础.北京:北京邮电大学出版社,2000.5.
[14] 周生炳,宋浩,袁海洋等著.XML 从入门到精通.北京:电子工业出版社,2000
[15] 陈伟军.XML Schema 教程.http://www.w3pop.com/learn/index/f/6/c/30
[16] 李安渝.Web Service 技术与实现.北京:国防工业出版社,2003.25-30
[17] MikeJasnowski.XML 和 web 服务宝典(盖江南王勇等译).北京:电子工业出版社,2002.46-97
[18] 姜阳.基于 WebServices 的异构数据收集与分发平台的研究和实现[D].天津:天津工业大学,2007
[19] 柴晓路,梁宇路.Web Service 技术框架和应用.北京:电子工业出版社,2004-1.
[20] Scott Seely.SOAP:Cross Plaatform Web Service Development Using XML,PH PTR,2004
[21] 王伟达,孟兆兴.关系数据库与 XML 的双向传输机制与实现.计算机应用研究.2005
[22] 李媛.基于异构数据库复制技术的信息整合框架的研究与实现[D].北京:北京工业大学.2005
[23] 史东平 从EDI到WebService-看电子商务中电子商务中数据交换技术的发展.信息技术与信息化,2005,4:14-16
[24] Karli Watson,Christian Nagel.c#高级编程.北京:清华大学出版社 2005.7
[25] 徐洁磐.数据仓库与决策支持系统.北京:科学技术出版社,2005.6
[26] Richard Hull and GangZhou famework for supporting data integration Using the materalized and vitual approaches.In H.V.Jagadish and Inderpal Signh Mumiek,editors,Proceeding of ACM SIFMOD 1996 International Conference on Management of Data,Montreal,Canada,June1996
[27] 邵佩英.分布式数据库系统及其应用.北京:科学出版社,2000.6:3-5
[28] 张云勇.中间件技术原理与应用[M].北京:清华人学出版社,2004
[29] 易均,梁志勇.基于 XML 的虚拟数据库中间件的研究[J].计算机与数字工程,2004,32(5):86-88
[30] 陈敏.基于 XML 和 Java 的异构数据库集成的应用研究[D].武汉:武汉理大学,2006
[31] 智永锋,张骏.基于的数据库访问中间件设计与实现[J].计算机应用研究,2005.22(11):81-88
[32] 王爱东,张涛.XML 与数据库映射技术的研究.湘潭示范学报,2002.11-15
[33] RonaldBourret.XML and Database.http//www.Rpbourret.com/XML/2005-09
[34] Kristin Tufte,Gang He,Chun Zhang et al.Relational Database For Querying XML Documents: Limitations and Opportunities[C].Proceedings of the 25th VLDB Conference,Edinburgh, Scotland.2003:302-214
[35] 谢鸿强,董逸生.异构数据源的集成技术.工业控制计算机,2001,14(6):1-6
[36] 吴胜利,王能斌.异构分布式数据库系统中数据语义不一致的一种解决方法.计算机学报,2004:246-252
[37] Optimzing queries across diverse data source Koassmann,Edward Wimmers,Jun Yang VLDB(the Int.Colif.on Very large DataBases).1997
[38] Scaling AccessTo distributed heterogeneous data sources with DiseoA.Tomeasi, L.Raschid,PValduriez IEEE Transactions On Knowledge and Data Engineering.1998
[39] 李华飚,郭英奎.Java 中间件开发技术[M].北京:中国水利水电出版社,2005
[40] 吴万春.基于分布式数据库信息的查询[D].重庆:重庆大学,2006
[41] 马淑娇,李晓.异构数据库集成中的 XML 探讨[J].计算机应用研究,2005.94
[2] 陈跃国,王京春.数据集成综述.计算机科学,2004,38(5):48-51
[3] 靳强勇,李冠宇,张俊.异构数据集成技术的发展和现状.计算机工程与应用,2002:38(11)
[4] 郭绍发.浅淡企业数据集成实践研究[J].计算机应用世界,2003,1-2
[5] 周锦涛.企业异构数据源集成.计算机世界,2005,(4):32
[6] Hector Garcia,Joachim Hammer,Kelly Ireland.Integrating and Accessing Heterogeneous Information Sources in TSIMMIS.1997.3,8(2):117-132
[7] The TSIMMIS Project.http://www-db.stanford.edu/tsimmis/
[8] 王宁,王能斌.异构数据源集成系统查询分解和优化的实现.软件学报,2000,11(2)
[9] Chaitan Baru,Amarnath Gupta,Bertram Ludascher.XML_Based XML Information mediator with MIX
[10] H.Gareia,Y.Papakonstantinou,et al.The TSIMMIS Projeet:Integration of heterogeneous information sources[J].Journal of Intelligent Information System,1997.3,8(2): 117-132
[11] 王宁.基于带根连通有向图的对象集成模型及代数.软件学报,1998,9(12):894-898
[12] Elliotte Rusty,W.Scott.XML 技术手册.北京:中国电力出版社.2001.11: 261-263
[13] 孙一中.XML 理论和应用基础.北京:北京邮电大学出版社,2000.5.
[14] 周生炳,宋浩,袁海洋等著.XML 从入门到精通.北京:电子工业出版社,2000
[15] 陈伟军.XML Schema 教程.http://www.w3pop.com/learn/index/f/6/c/30
[16] 李安渝.Web Service 技术与实现.北京:国防工业出版社,2003.25-30
[17] MikeJasnowski.XML 和 web 服务宝典(盖江南王勇等译).北京:电子工业出版社,2002.46-97
[18] 姜阳.基于 WebServices 的异构数据收集与分发平台的研究和实现[D].天津:天津工业大学,2007
[19] 柴晓路,梁宇路.Web Service 技术框架和应用.北京:电子工业出版社,2004-1.
[20] Scott Seely.SOAP:Cross Plaatform Web Service Development Using XML,PH PTR,2004
[21] 王伟达,孟兆兴.关系数据库与 XML 的双向传输机制与实现.计算机应用研究.2005
[22] 李媛.基于异构数据库复制技术的信息整合框架的研究与实现[D].北京:北京工业大学.2005
[23] 史东平 从EDI到WebService-看电子商务中电子商务中数据交换技术的发展.信息技术与信息化,2005,4:14-16
[24] Karli Watson,Christian Nagel.c#高级编程.北京:清华大学出版社 2005.7
[25] 徐洁磐.数据仓库与决策支持系统.北京:科学技术出版社,2005.6
[26] Richard Hull and GangZhou famework for supporting data integration Using the materalized and vitual approaches.In H.V.Jagadish and Inderpal Signh Mumiek,editors,Proceeding of ACM SIFMOD 1996 International Conference on Management of Data,Montreal,Canada,June1996
[27] 邵佩英.分布式数据库系统及其应用.北京:科学出版社,2000.6:3-5
[28] 张云勇.中间件技术原理与应用[M].北京:清华人学出版社,2004
[29] 易均,梁志勇.基于 XML 的虚拟数据库中间件的研究[J].计算机与数字工程,2004,32(5):86-88
[30] 陈敏.基于 XML 和 Java 的异构数据库集成的应用研究[D].武汉:武汉理大学,2006
[31] 智永锋,张骏.基于的数据库访问中间件设计与实现[J].计算机应用研究,2005.22(11):81-88
[32] 王爱东,张涛.XML 与数据库映射技术的研究.湘潭示范学报,2002.11-15
[33] RonaldBourret.XML and Database.http//www.Rpbourret.com/XML/2005-09
[34] Kristin Tufte,Gang He,Chun Zhang et al.Relational Database For Querying XML Documents: Limitations and Opportunities[C].Proceedings of the 25th VLDB Conference,Edinburgh, Scotland.2003:302-214
[35] 谢鸿强,董逸生.异构数据源的集成技术.工业控制计算机,2001,14(6):1-6
[36] 吴胜利,王能斌.异构分布式数据库系统中数据语义不一致的一种解决方法.计算机学报,2004:246-252
[37] Optimzing queries across diverse data source Koassmann,Edward Wimmers,Jun Yang VLDB(the Int.Colif.on Very large DataBases).1997
[38] Scaling AccessTo distributed heterogeneous data sources with DiseoA.Tomeasi, L.Raschid,PValduriez IEEE Transactions On Knowledge and Data Engineering.1998
[39] 李华飚,郭英奎.Java 中间件开发技术[M].北京:中国水利水电出版社,2005
[40] 吴万春.基于分布式数据库信息的查询[D].重庆:重庆大学,2006
[41] 马淑娇,李晓.异构数据库集成中的 XML 探讨[J].计算机应用研究,2005.94