企业异构数据集成方案的研究与应用
摘要
随着全球经济的快速发展,企业环境也是有了很大的改变,昔日各种或是辉煌或是惨淡的系统如今也类似于废铁、鸡肋一样存放在企业信息化建设部门,几乎无人理睬。设计一种什么样的软件体系架构来适用在如此快速发展的环境中,同时还能将企业信息化历史中的那些“废铁”合理的利用,成为每个企业信息化建设必须考虑的头等大事。本文的研究重点是建立一个异构数据集成方案,为实现企业发展及其信息化建设的再一次腾飞做出其应有的贡献。
本文首先研究与分析当前国内外的一些异构数据集成技术,以及一些异构数据集成方案;研究与分析了当今特别流行的SOA思想体系架构的主要特点、其在技术上实现的特点、不同技术实现的区别;主要阐述了Web Services技术在建立SOA思想架构的独特之处;详细分析了当前比较流行的一种基于SOA思想的软件架构,即企业服务总线(Enterprise Service Bus,ESB)。
其次,借鉴SOA思想体系架构的优点和ESB在实际应用中的特点,在Web Services合成技术的基础上提出了一种异构数据系统的集成方案,在该方案中主要是利用无回溯反向链合成算法,动态地按照输入输出要求合成一个Web Services集合的执行方案。文中通过对无回溯反向链合成算法进行详细地研究与分析,对该合成算法在执行效率上进行了进一步地改进,使之具有更高的合成速度。最后,将改进后的基于Web Services合成技术的异构数据系统集成方案在制造型企业中进行了成功的应用。
应用实践表明:该系统有着标准的架构特点、良好的可扩展性,易于理解、易于开发。尤其还有着较强地自组织结构和简易的维护性。它将在企业发展及其信息化建设中发挥重要作用。
With the fast development of the world's economy, the circumstance of enterprises also had a very big change. No matter how it was useful or useless in the department of informatization construction, those applications are ignored now. It is very important for enterprises' informationization construction what kind of software should be designed to be suitable in the so fast development environment, and make use of those neglected application systems. It is established a plan for heterogenous data integration that do very important contribution to the corporations' development and construction of informationization.
Firstly, It is researched and analysed that some technology in heterogenous data integration in abroad and domestic and some cases on heterogeneous data integration; It is studied that the main Characteristic of the most popular software ideological system, which named SOA, as well as the characteristic on the different technology to realize it. It is mainly described that the characteristic which built the SOA system based on web services composite technology. Analysed a popular construction based SOA ideological system detailedly, which named Enterprise Service Bus.
Secondly, it is proposed a case that on heterogeneous data integration on the basis of Web Services integrating technology and reference framework of SOA ideology and the merits of ESB in application. A composition algorithm named non backtrack backward chaining was used in the case, and built a execute case for a collection of web services dynamically. The algorithm of non backtrack backward chaining was researched and analyzed detailedly. The algorithm was improved and further improved efficiency of the algorithm. Finally, the improved case was carried out in the manufacture enterprise and had a successful application.
The practice applying is indicated: the system has a standard structure, a good expansibility and easy to apprehension and design. Especially, it had a very good self-organization construction and simple maintenance. It will bring the important effect in the enterprise development and their informatization construction.
本文首先研究与分析当前国内外的一些异构数据集成技术,以及一些异构数据集成方案;研究与分析了当今特别流行的SOA思想体系架构的主要特点、其在技术上实现的特点、不同技术实现的区别;主要阐述了Web Services技术在建立SOA思想架构的独特之处;详细分析了当前比较流行的一种基于SOA思想的软件架构,即企业服务总线(Enterprise Service Bus,ESB)。
其次,借鉴SOA思想体系架构的优点和ESB在实际应用中的特点,在Web Services合成技术的基础上提出了一种异构数据系统的集成方案,在该方案中主要是利用无回溯反向链合成算法,动态地按照输入输出要求合成一个Web Services集合的执行方案。文中通过对无回溯反向链合成算法进行详细地研究与分析,对该合成算法在执行效率上进行了进一步地改进,使之具有更高的合成速度。最后,将改进后的基于Web Services合成技术的异构数据系统集成方案在制造型企业中进行了成功的应用。
应用实践表明:该系统有着标准的架构特点、良好的可扩展性,易于理解、易于开发。尤其还有着较强地自组织结构和简易的维护性。它将在企业发展及其信息化建设中发挥重要作用。
With the fast development of the world's economy, the circumstance of enterprises also had a very big change. No matter how it was useful or useless in the department of informatization construction, those applications are ignored now. It is very important for enterprises' informationization construction what kind of software should be designed to be suitable in the so fast development environment, and make use of those neglected application systems. It is established a plan for heterogenous data integration that do very important contribution to the corporations' development and construction of informationization.
Firstly, It is researched and analysed that some technology in heterogenous data integration in abroad and domestic and some cases on heterogeneous data integration; It is studied that the main Characteristic of the most popular software ideological system, which named SOA, as well as the characteristic on the different technology to realize it. It is mainly described that the characteristic which built the SOA system based on web services composite technology. Analysed a popular construction based SOA ideological system detailedly, which named Enterprise Service Bus.
Secondly, it is proposed a case that on heterogeneous data integration on the basis of Web Services integrating technology and reference framework of SOA ideology and the merits of ESB in application. A composition algorithm named non backtrack backward chaining was used in the case, and built a execute case for a collection of web services dynamically. The algorithm of non backtrack backward chaining was researched and analyzed detailedly. The algorithm was improved and further improved efficiency of the algorithm. Finally, the improved case was carried out in the manufacture enterprise and had a successful application.
The practice applying is indicated: the system has a standard structure, a good expansibility and easy to apprehension and design. Especially, it had a very good self-organization construction and simple maintenance. It will bring the important effect in the enterprise development and their informatization construction.
引文
[1]陈传波,张辉.基于XML和消息中间件的异构数据集成技术[J].计算机工程与科学,2004,26(9):67-70.
[2]鱼滨,郑娅峰.基于XML的异构系统集成框架的研究[J].计算机应用与软件,2005,22(7):14-15.
[3]袁月杨,麻丽莉.SOA&Web2.0—新商业语言.北京:清华大学出版社.2007
[4]王满红,陈荣华.SOA概念,技术和设计.北京:机械工业出版社.2006
[5]刘刚,余晖.利用WSDL和UDDI为公共Web Services建立统一接口[J].计算机应用研究,2003,20(5):150-152.
[6]张驰,周淑莉,吴健,胡正国.基于Web Services的异构组件互操作[J].计算机应用研究,2005,22(7):216-218.
[7]殷晓岚,付远彬,李京.企业数据集成模式的研究[J].计算机工程与应用,2002,38(12):253-255.
[8]胡松涛.基于XML的异构数据集成研究.哈尔滨工程大学,2005工学硕士学位论文
[9]陈晓雷.基于XML的异构数据库集成技术研究.华东师范大学,2005届工程硕士申请硕士学位论文
[10]熊海军,王保义,张少敏,等.基于XML的Web数据集成研究[J].华北电力大学学报,2004,5:70-73.
[11]李军怀,周明全,耿国华,张景.XML在异构数据集成中的应用研究[J].计算机应用,2002,9(22):18-24
[12]谢鸿强,董逸生.异构数据源的集成技术.工业控制计算机.2001.14(6):1-6.
[13]XML技术概述[Z].http://www.xml.org/.
[14]叶蕾,郭玲,胡建华.基于XML的异构数据集成领域的应用研究[J].吉林师范大学学报(自然科学版),2003,3:21-23.
[15]周园春,李淼,张健等.中间件技术综述.计算机工程与应用.2002:80-82.
[16]覃正,原欣伟,卢致杰等.面向服务的广义企业信息系统架构研究.计算机应用,2004,6(24):69-71
[17](美)Scott Steely著.杨涛,杨晓云,王建桥,高文雅等译.SOAP:XML跨平台Web Service开发技术[M]11机械工业出版社.2002.
[18]高鹏.基于CORBA的异构数据库集成研究:[硕士学位论文].广东:广东工业大学,2001
[19]郭永生.基于共享数据库的多源数据集成.微机发展,2004,(2):34
[20]刘桂斌.异构数据库的数据共享集成中间件技术研究:[硕士学位论文].陕西:西北工 业大学,2005
[21]贾长云.基于XML的异构数据库数据交换的研究与实现:[硕士学位论文].南京:河海大学,2005
[22]黄海.异构数据集成系统中的只能查询研究及实现,大连海事大学硕士论文,2004
[23]李鑫晶.关于网络安全身份认证技术的探讨.科技进步与对策,2002,(8):158-161
[24]胡彬华,李晓.异构分布式数据库系统集成的研究与实现.计算机应用研究,2002,(10):67-69
[25]胡亚平,李光泉.“基于XML技术的中小型企业电子商务数据集成方案”.计算机与现代化,2004,12
[26]黄成.基于Web服务的企业应用集成架构及引擎研究:[硕士学位论文].浙江大学.2005:10-13
[27]柴晓路,梁宇奇.Web Services技术、架构和应用[M].北京:电子工业出版社.2003:426-501
[28]顾宁,刘家茂,柴晓路.Web Services原理与研发实践[M].北京:机械工业出版社.2006
[29]Jennifer Widan,Data Management for XML Research Directions,IEEE Data Engineering Bulletin.22(3):44-52,Sept 2003
[30]W3C.Web Services Description Requirements[EB/OL].http://www.w3c.org/tr/2002/Wd2ws2desc2reqs220021028
[31]Judith Myerson.Web Services Architectures[M].Chicago:Tect Publisher,2002.
[32]Zhou Liangyu,Magi Rakesh.Design of distributed information systems for agile manufacturing virtual enterprises using CORBA and STEP standard[J].Journal of Manufacturing Systems,2002,21(1):14-31.
[33]Ed Tittel,Norbert Mikula,Ramesh Chandak."XML For DUMMIES".IDGBOOK Worldwide,Inc,1999
[34]Liu Jiamao,Cui Juntao,Gu Ning.Composing Web Services Dynamically and Semantically[C].IEEE International Conference on E-commerce Technology for Dynamic E-business,Beijing,China,2004-09-13.
[35]Blyth Andrew."An XML-based architecture to perform data integration and data unification in vulnerability assessments".Information Security Technical Report,April,2003:14-25P
[36]Ian Horrocks,Frank van Harmelen,Peter Patel-Schneider,etc.The revised language specification_darnl+oil,http://wwav.daml.org/2001/03/daml+oil,2001
[37]M.Dean,D.Connolly,F,van Harmelen,etc.Web Ontology Language(OWL)Reference Version 1.0.http://www.w3.org/TR/2002/WD-owl-ref-20021112/,2002.11
[38]Michael Champion.Chris Ferris Feric Newcomer and David Orchard.Web Services Architect Working Draft. http://www.w3.org/TR/2002AVD-ws-arch-20021114/,2002.11
[39] E. Christensen, F. Curbera, G. Meredith, etc. Web Services Description Language (WSDL) 1.1,2001. http://www.w3.org/TR/2001/NOTE-wsdl-20010315,2001
[40] UDDI. The UDDI technical white paper, 2000. http://www.uddi. org/
[41] F. Curbera, Y. Goland, J. Klein, etc. Business Process Execution Language for Web Services, Version 1.0, July 2001. http://www-106.ibm.com/developerworks/webservices/library/ws-bpel/,2001
[42] A. Ankolenkar, M. Burstein, J. R. Hobbs, etc. DAML-S: Web Service Description for the Semantic Web. In Proceedings of The First International Semantic Web Conference (ISWC), Sardinia (Italy), June 2002
[43] F. Casati, S. Ilnicki, and L. Jin. Adaptive and dynamic service composition in EFlow. In Proceedings of 12th International Conference on Advanced Information Systems Engineering(CAiSE), Stockholm, Sweden, June 2000
[44] D.Wu, E. Sirin, J. Hendler, D. Nau, and 8. Parsia. Automatic Web services composition using SHOP2. In Workshop on Planning for Web Services, Trento, Italy,June 2003
[45] E. Sirin, J. Hendler, and B. Parsia. Semi-automatic composition of Web services using semantic descriptions. In Proceedings of Web Services: Modeling, Architecture and Infrastructure workshop in conjunction with ICEIS2003,2002
[46] X. Su and J. Rao. A Survey of Automated Web Service Composition Methods. In Proceedings of First International Workshop on Semantic Web Services and Web Process Composition, July 2004
[47] Mikko Laukkanen and Heikki Helin. Composing Workflows of Semantic Web Services. In Proceedings of the Workshop on Web-Services and Agent-based Engineering, 2003
[48] K. Sivashanmugam, K. Verma, A. Sheth, and J. Miller. Adding Semantics to Web Services Standards. Intl. Conf. on Web Services, Las Vegas NV, June 2003
[49] J. Cardoso and A. Sheth. Semantic e-workflow composition. Journal of Intelligent Information Systems, 21(3):191-225,2003
[50] Francisca Losavio, Dinarle Omega, Maria Perez. Modeling EAI. Proceedings of the XXII International Conference of the Chilean Computer Science Society (SCCC'02).
[51]Naveen Erasala, David C Electronic Commerce World Yen, T.M. Rajkumar. Enterprise Application Integration in the Computer Standards&Interfaces 25 (2003) 69-82
[2]鱼滨,郑娅峰.基于XML的异构系统集成框架的研究[J].计算机应用与软件,2005,22(7):14-15.
[3]袁月杨,麻丽莉.SOA&Web2.0—新商业语言.北京:清华大学出版社.2007
[4]王满红,陈荣华.SOA概念,技术和设计.北京:机械工业出版社.2006
[5]刘刚,余晖.利用WSDL和UDDI为公共Web Services建立统一接口[J].计算机应用研究,2003,20(5):150-152.
[6]张驰,周淑莉,吴健,胡正国.基于Web Services的异构组件互操作[J].计算机应用研究,2005,22(7):216-218.
[7]殷晓岚,付远彬,李京.企业数据集成模式的研究[J].计算机工程与应用,2002,38(12):253-255.
[8]胡松涛.基于XML的异构数据集成研究.哈尔滨工程大学,2005工学硕士学位论文
[9]陈晓雷.基于XML的异构数据库集成技术研究.华东师范大学,2005届工程硕士申请硕士学位论文
[10]熊海军,王保义,张少敏,等.基于XML的Web数据集成研究[J].华北电力大学学报,2004,5:70-73.
[11]李军怀,周明全,耿国华,张景.XML在异构数据集成中的应用研究[J].计算机应用,2002,9(22):18-24
[12]谢鸿强,董逸生.异构数据源的集成技术.工业控制计算机.2001.14(6):1-6.
[13]XML技术概述[Z].http://www.xml.org/.
[14]叶蕾,郭玲,胡建华.基于XML的异构数据集成领域的应用研究[J].吉林师范大学学报(自然科学版),2003,3:21-23.
[15]周园春,李淼,张健等.中间件技术综述.计算机工程与应用.2002:80-82.
[16]覃正,原欣伟,卢致杰等.面向服务的广义企业信息系统架构研究.计算机应用,2004,6(24):69-71
[17](美)Scott Steely著.杨涛,杨晓云,王建桥,高文雅等译.SOAP:XML跨平台Web Service开发技术[M]11机械工业出版社.2002.
[18]高鹏.基于CORBA的异构数据库集成研究:[硕士学位论文].广东:广东工业大学,2001
[19]郭永生.基于共享数据库的多源数据集成.微机发展,2004,(2):34
[20]刘桂斌.异构数据库的数据共享集成中间件技术研究:[硕士学位论文].陕西:西北工 业大学,2005
[21]贾长云.基于XML的异构数据库数据交换的研究与实现:[硕士学位论文].南京:河海大学,2005
[22]黄海.异构数据集成系统中的只能查询研究及实现,大连海事大学硕士论文,2004
[23]李鑫晶.关于网络安全身份认证技术的探讨.科技进步与对策,2002,(8):158-161
[24]胡彬华,李晓.异构分布式数据库系统集成的研究与实现.计算机应用研究,2002,(10):67-69
[25]胡亚平,李光泉.“基于XML技术的中小型企业电子商务数据集成方案”.计算机与现代化,2004,12
[26]黄成.基于Web服务的企业应用集成架构及引擎研究:[硕士学位论文].浙江大学.2005:10-13
[27]柴晓路,梁宇奇.Web Services技术、架构和应用[M].北京:电子工业出版社.2003:426-501
[28]顾宁,刘家茂,柴晓路.Web Services原理与研发实践[M].北京:机械工业出版社.2006
[29]Jennifer Widan,Data Management for XML Research Directions,IEEE Data Engineering Bulletin.22(3):44-52,Sept 2003
[30]W3C.Web Services Description Requirements[EB/OL].http://www.w3c.org/tr/2002/Wd2ws2desc2reqs220021028
[31]Judith Myerson.Web Services Architectures[M].Chicago:Tect Publisher,2002.
[32]Zhou Liangyu,Magi Rakesh.Design of distributed information systems for agile manufacturing virtual enterprises using CORBA and STEP standard[J].Journal of Manufacturing Systems,2002,21(1):14-31.
[33]Ed Tittel,Norbert Mikula,Ramesh Chandak."XML For DUMMIES".IDGBOOK Worldwide,Inc,1999
[34]Liu Jiamao,Cui Juntao,Gu Ning.Composing Web Services Dynamically and Semantically[C].IEEE International Conference on E-commerce Technology for Dynamic E-business,Beijing,China,2004-09-13.
[35]Blyth Andrew."An XML-based architecture to perform data integration and data unification in vulnerability assessments".Information Security Technical Report,April,2003:14-25P
[36]Ian Horrocks,Frank van Harmelen,Peter Patel-Schneider,etc.The revised language specification_darnl+oil,http://wwav.daml.org/2001/03/daml+oil,2001
[37]M.Dean,D.Connolly,F,van Harmelen,etc.Web Ontology Language(OWL)Reference Version 1.0.http://www.w3.org/TR/2002/WD-owl-ref-20021112/,2002.11
[38]Michael Champion.Chris Ferris Feric Newcomer and David Orchard.Web Services Architect Working Draft. http://www.w3.org/TR/2002AVD-ws-arch-20021114/,2002.11
[39] E. Christensen, F. Curbera, G. Meredith, etc. Web Services Description Language (WSDL) 1.1,2001. http://www.w3.org/TR/2001/NOTE-wsdl-20010315,2001
[40] UDDI. The UDDI technical white paper, 2000. http://www.uddi. org/
[41] F. Curbera, Y. Goland, J. Klein, etc. Business Process Execution Language for Web Services, Version 1.0, July 2001. http://www-106.ibm.com/developerworks/webservices/library/ws-bpel/,2001
[42] A. Ankolenkar, M. Burstein, J. R. Hobbs, etc. DAML-S: Web Service Description for the Semantic Web. In Proceedings of The First International Semantic Web Conference (ISWC), Sardinia (Italy), June 2002
[43] F. Casati, S. Ilnicki, and L. Jin. Adaptive and dynamic service composition in EFlow. In Proceedings of 12th International Conference on Advanced Information Systems Engineering(CAiSE), Stockholm, Sweden, June 2000
[44] D.Wu, E. Sirin, J. Hendler, D. Nau, and 8. Parsia. Automatic Web services composition using SHOP2. In Workshop on Planning for Web Services, Trento, Italy,June 2003
[45] E. Sirin, J. Hendler, and B. Parsia. Semi-automatic composition of Web services using semantic descriptions. In Proceedings of Web Services: Modeling, Architecture and Infrastructure workshop in conjunction with ICEIS2003,2002
[46] X. Su and J. Rao. A Survey of Automated Web Service Composition Methods. In Proceedings of First International Workshop on Semantic Web Services and Web Process Composition, July 2004
[47] Mikko Laukkanen and Heikki Helin. Composing Workflows of Semantic Web Services. In Proceedings of the Workshop on Web-Services and Agent-based Engineering, 2003
[48] K. Sivashanmugam, K. Verma, A. Sheth, and J. Miller. Adding Semantics to Web Services Standards. Intl. Conf. on Web Services, Las Vegas NV, June 2003
[49] J. Cardoso and A. Sheth. Semantic e-workflow composition. Journal of Intelligent Information Systems, 21(3):191-225,2003
[50] Francisca Losavio, Dinarle Omega, Maria Perez. Modeling EAI. Proceedings of the XXII International Conference of the Chilean Computer Science Society (SCCC'02).
[51]Naveen Erasala, David C Electronic Commerce World Yen, T.M. Rajkumar. Enterprise Application Integration in the Computer Standards&Interfaces 25 (2003) 69-82