基于XML技术的钢铁企业异构系统集成研究与应用
|
摘要
对于企业而言,由于企业的收购和兼并、雇员的更替和政策的改变,以及许多其他的原因:如,企业所拥有的系统用不同的语言建立,运行在不同的软件平台上,针对不同的硬件等。拥有大规模而且各不相同的系统是很普遍的现象,而拥有统一的系统却很少见。随着信息技术的快速发展,各企业间竞争的日趋白热化,很多因素促使人们对信息系统提出更高的要求,这既是企业内部发展的需要也是企业适应外部环境的需要。因此需要企业的信息系统更为灵活和开放,以便能够共享集成彼此的不同的信息。但由于这些信息系统的架构,数据源的结构不尽相同,使得这些系统间的数据交换和集成遇到了障碍。在这种背景下,企业异构数据的应用集成成为了当今企业信息化建设的热点和难点之一。
为此,本文结合昆明钢铁集团信息化项目“昆钢钢产品力学性能检验系统”和先前已经上线的“昆钢QS系统”,研究了一些适合该企业的异构集成技术,并应用当中的一些技术实现了异构数据的共享、交换和集成,即以一种统一的数据模式描述各数据源中的数据,屏蔽它们的平台、数据结构等异构性,实现数据的无缝集成。
在本文所述的异构系统中,围绕异构系统集成等目标,我们在对课题进行深入详细的系统调研、文献资料收集和整理后,本着最优原则,提出了一种基于XML技术和中间件思想、结合Web Service及Socket套接字监听的数据集成系统总体设计框架。其中,消息中间件采用XML,事务处理中间件采用Web Service和Socket套接字监听,WEB应用服务器中间件采用Jboss和IIS,数据访问中间件则采用JDBC和ADO.NET。采用这样的框架是因为中间件思想构建的系统具有伸缩性好、解决复杂问题能力强、开发周期短、开发风险低等优点。而近几年发展迅速的XML技术具有自定义性及其可扩展性等优势,便于表达各种类型的数据,自然适合作为异构数据的描述语言,解决数据的统一接口问题,从而实现异构数据之间的整合;
系统的设计与实现充分考虑了企业的各种实际情况,除了满足基本的功能要求以外,在系统的构建上也是尽最大可能保证系统的通用性、灵活性、安全性及健壮性等。比如对于检验项目变更、新增产品等不确定因素,系统就有很好的通用性及可扩展性,出现这种情况时,系统不再需要硬编码,只需通过配置系统进行配置即可以运行;又如在网络异常情况时,系统提供了最小运行模式,从而可以保证生产的正常进行,使系统具有很好的健壮性。目前该系统正在试运行当中,它的研究与实现不仅可以在钢铁企业信息系统集成建设中提供借鉴,在其他制造行业当中也具有一定的现实意义和推广价值。
For corporations, the corporate mergers and acquisitions, employee turnover and policy changes, as well as many other reasons: for example, enterprises have a system set up with different languages, the software running on different platforms, different hardware etc... The possession of large scale system which is different from each other is very common, and unified system is very rare. With the rapid development of information technology and competition among enterprises is becoming increasingly intense, many factors have contributed to people's higher demand to information systems, and this is the needs of internal development of enterprises and also the adaptability to the external environment. Hence, to be able to share or integrate each other's different information, more flexible and open information systems of enterprise is desired. However, the information system's structure and the structure of data sources are different, so that these systems' data exchange and integration encounter obstacles. And all of this make the integration of enterprise heterogeneous data into the current construction of the enterprise information hot and difficult one.
To this end, this paper associate Kunming Iron and Steel Group information project" Kunming Iron and Steel Group 's mechanical properties testing system for products " and " Kunming Iron and Steel Group QS system" previously had been on the line ,studying some heterogeneous technologies which is suitable for the enterprise, and realizing the sharing, exchange and integration of heterogeneous data with Some of these technology, that is, describes the data in different data sources in a unified data model, shielding the heterogeneity of platform, data structure etc., realizing seamless integration of data.
In this paper, around the goal of integration of heterogeneous systems, after studying the subject in-depth, collecting and collating information literature, we put forward an integration system design framework which is based on XML technology with the middleware thinking and the combination of Web Service and Socket Monitoring in the optimal principle. In the system ,message middleware adopt XML、ADO.NET, transaction processing middleware adopt Web Service and Socket Monitoring, WEB application server middleware adopt JBOSS and IIS, data access middleware adopt JDBC. Choosing such a framework is because building a system that based on middleware thinking has many advantages, such as scalability, the great ability to resolve complex issues, short development cycle, low-risk and so on. And the rapid development of XML in recent years with the advantages likes self-definition, scalability, easy description to various types of data etc... And this makes it a suitable language to descript heterogeneous data, solve the data interface issue and realize the integration of heterogeneous data.
System design and implementation fully taken into account the various actual situation in the enterprises, In addition to satisfying the basic functional requirements, the building of the system is guaranteed to the maximum extent possible versatility, flexibility, security and robustness, etc.. Uncertain factors such as the test items change or new products appear, systems have good versatility and scalability, in such cases, the system is no longer required hard-coded, but only through the configuration of the system configuration that can run; and If anomalies in the network, the system provides a minimum operating mode, which can guarantee the normal production and make the system good robustness. At present it is in trial operation, its research and realization can not only provide iron and steel enterprises in the construction of integrated information systems for reference, in other manufacturing industries which also has practical significance and value.
为此,本文结合昆明钢铁集团信息化项目“昆钢钢产品力学性能检验系统”和先前已经上线的“昆钢QS系统”,研究了一些适合该企业的异构集成技术,并应用当中的一些技术实现了异构数据的共享、交换和集成,即以一种统一的数据模式描述各数据源中的数据,屏蔽它们的平台、数据结构等异构性,实现数据的无缝集成。
在本文所述的异构系统中,围绕异构系统集成等目标,我们在对课题进行深入详细的系统调研、文献资料收集和整理后,本着最优原则,提出了一种基于XML技术和中间件思想、结合Web Service及Socket套接字监听的数据集成系统总体设计框架。其中,消息中间件采用XML,事务处理中间件采用Web Service和Socket套接字监听,WEB应用服务器中间件采用Jboss和IIS,数据访问中间件则采用JDBC和ADO.NET。采用这样的框架是因为中间件思想构建的系统具有伸缩性好、解决复杂问题能力强、开发周期短、开发风险低等优点。而近几年发展迅速的XML技术具有自定义性及其可扩展性等优势,便于表达各种类型的数据,自然适合作为异构数据的描述语言,解决数据的统一接口问题,从而实现异构数据之间的整合;
系统的设计与实现充分考虑了企业的各种实际情况,除了满足基本的功能要求以外,在系统的构建上也是尽最大可能保证系统的通用性、灵活性、安全性及健壮性等。比如对于检验项目变更、新增产品等不确定因素,系统就有很好的通用性及可扩展性,出现这种情况时,系统不再需要硬编码,只需通过配置系统进行配置即可以运行;又如在网络异常情况时,系统提供了最小运行模式,从而可以保证生产的正常进行,使系统具有很好的健壮性。目前该系统正在试运行当中,它的研究与实现不仅可以在钢铁企业信息系统集成建设中提供借鉴,在其他制造行业当中也具有一定的现实意义和推广价值。
For corporations, the corporate mergers and acquisitions, employee turnover and policy changes, as well as many other reasons: for example, enterprises have a system set up with different languages, the software running on different platforms, different hardware etc... The possession of large scale system which is different from each other is very common, and unified system is very rare. With the rapid development of information technology and competition among enterprises is becoming increasingly intense, many factors have contributed to people's higher demand to information systems, and this is the needs of internal development of enterprises and also the adaptability to the external environment. Hence, to be able to share or integrate each other's different information, more flexible and open information systems of enterprise is desired. However, the information system's structure and the structure of data sources are different, so that these systems' data exchange and integration encounter obstacles. And all of this make the integration of enterprise heterogeneous data into the current construction of the enterprise information hot and difficult one.
To this end, this paper associate Kunming Iron and Steel Group information project" Kunming Iron and Steel Group 's mechanical properties testing system for products " and " Kunming Iron and Steel Group QS system" previously had been on the line ,studying some heterogeneous technologies which is suitable for the enterprise, and realizing the sharing, exchange and integration of heterogeneous data with Some of these technology, that is, describes the data in different data sources in a unified data model, shielding the heterogeneity of platform, data structure etc., realizing seamless integration of data.
In this paper, around the goal of integration of heterogeneous systems, after studying the subject in-depth, collecting and collating information literature, we put forward an integration system design framework which is based on XML technology with the middleware thinking and the combination of Web Service and Socket Monitoring in the optimal principle. In the system ,message middleware adopt XML、ADO.NET, transaction processing middleware adopt Web Service and Socket Monitoring, WEB application server middleware adopt JBOSS and IIS, data access middleware adopt JDBC. Choosing such a framework is because building a system that based on middleware thinking has many advantages, such as scalability, the great ability to resolve complex issues, short development cycle, low-risk and so on. And the rapid development of XML in recent years with the advantages likes self-definition, scalability, easy description to various types of data etc... And this makes it a suitable language to descript heterogeneous data, solve the data interface issue and realize the integration of heterogeneous data.
System design and implementation fully taken into account the various actual situation in the enterprises, In addition to satisfying the basic functional requirements, the building of the system is guaranteed to the maximum extent possible versatility, flexibility, security and robustness, etc.. Uncertain factors such as the test items change or new products appear, systems have good versatility and scalability, in such cases, the system is no longer required hard-coded, but only through the configuration of the system configuration that can run; and If anomalies in the network, the system provides a minimum operating mode, which can guarantee the normal production and make the system good robustness. At present it is in trial operation, its research and realization can not only provide iron and steel enterprises in the construction of integrated information systems for reference, in other manufacturing industries which also has practical significance and value.
引文
[1]王宇.现代企业管理模式的探讨.信息技术.2002年第11期:85-85
[2]樊重俊,刘芹,杨神曼.集团型企业信息技术战略规划.集团经济研究.2007年07Z期:23-24
[3]信息产业部计算机技术培训中心编著.计算机信息系统集成项目经理技术手册[M].电子工业出版社,2004.
[4]杨宏英,林长松.异构数据集成系统的应用模式与技术实现.微电子学与计算机.2006年 23卷 8期:70-72
[5]北京大学的CoXML.http://www.jyssti.gov.cn/bst/For_Print.ASP?ID=1725
[6]太极软件公司的XML信息集成系统-TaijiVEⅡhttp://www.primeton.com/about/read.php?id=303&his=1
[7]金易KAF/EAI系统 http://www.kingeasy.com.cn/news_view.asp?newsid=100
[8]1Z.G.Ivesetal.An Adaptive Query Execution System for Data Integration.ACM SIGMOD Conference on Management of Data,1999
[9]Microsoft.UDA.Available online at http://www.microsoft.com/china/sql/70/interopmigrate/Interopoverview .mspx
[10]IBM.DB2 Information Integrator.Available online at http://www.ibm.com/developerworks/cn/db2/library/techarticles/ii bigpicture/iibigpicture.html
[11]Sybase.Data Integration Suite.Available online at http://sybase.chinaunix.net/1/2007/0619/2.shtml
[12]Oracle.Fusion MiddleWare.Available online at http://www.oracle.com/technology/products/middleware/index.html
[13]异构面临的问题.http://www.haodf.net/softtech/erp/other/200609/118793.html
[14]Benoit Marchal.XML示例程序导学.杨洪涛,顾雷,郑震坤译.北京:清华大学出版社,2002
[15]萧仁惠 陈锦辉.JDBC数据库程序设计.北京:中国铁道出版社,2004
[16]Huang Lican,Wu Zhaohui,Pan Yunhe.Distributed heterogeneous inspecting system and its middleware-based solution.JOURNAL OF ZHEJIANG UNIVERSITY SCIENCE.2003,4(5):542-548
[17]Zhang Chengwen,Su Sen,Chen Junliang.GAMi:Genetic Algorithm-Based Middleware for QoS-Aware Web Services Selection.CHINESE OF JOURNAL ELECTRONICS.2007,16(3):537-542
[18]李璐,张广泉.消息中间件的体系结构研究.苏州大学学报:工科版.2007年27卷3期:10-14
[19]梁立新.项目实践精解:Java Web应用开发.北京:电子工业出版社,2007
[20]袁琳 李秉严.SGML、HTML、XML的比较.四川图书馆学报.2001年 3期:34-36
[21]DOUYuhong,ZHANGYaoxue,LIXing.An XML-based Software Component Description Method for Program Mining.CHINESE OF JOURNAL ELECTRONICS.2004,13(1):100-104
[22]刘红文.浅谈WebService技术.福建电脑.2007年3期:70,111
[23]Harvey M.Deitel等著,邱仲潘等译.Java Web服务高级教程.北京:机械工业出版社,2003
[24]江义华,林彩榆.Java完美经典.北京:中国铁道出版社,2004
[25]ZHANGChang-li SHENWei-zheng FANGJun-long.Using TCP / IP Programming to Realize the Communication among Different Network Platforms.JOURNAL OF NORTHEAST AGRICULTURAL UNIVERSITY.2004,11(1):77-79
[26]姬婧,杜瑞庆,刘志贺.浅谈Java中有连接的Socket通信机制.电脑知识与技术:学术交流.2007年4期:92-93
[27]马保国,王连锋,李华刚.XML在Socket方式实时数据交换中的应用.计算机技术与发展.2007年17卷5期.18-20,23
[28]曹大有,张斌.通过Java Socket建立连接类实现与Web服务器的交互操作.福建电脑.2007年1期:191-192
[29]渠本哲,张凝,王潜平.使用Java和XML实现数据移植.计算机技术与发展.2006年16卷9期:15-17
[30]秦玉杰 李革 黄柯棣.使用JDBC实现XML文档到Oracle9i数据库的存取.计算 机工程与设计.2005年26卷10期:2582-2584,2601
[31]孔祥盛,孙婧.Hibernate持久化中间件管理数据.内江科技.2007年28卷9期:142-143
[32]王钱,王蓉,张利.基于iBatis的通用数据持久层的研究与设计.微计算机信息.2007年04X期:172-173
[33]成培 李峰 王畅.连接池数据库访问技术深入研究.计算机工程与设计.2007年28卷3期:509-511
[34]谢俊,陈明,付嵘.基于Java的数据库连接池的研究与实现.中国科技信息.2007年4期:135-137
[35]张力文.Java的XML语法分析工具--JAXP.电子计算机.2001年2期:33-38
[36]黎楚 薛胜军 罗强.XML应用的关键:XML解析技术.电脑知识与技术:学术交流.2007年1期:187-189
[37]王永猛,夏士雄,王尚防.企业内部信息系统安全浅析.电脑知识与技术:学术交流.2007年3期:1353-1354
[38]熊聪聪,李伟.基于Java的DES加密算法.天津师范大学学报(自然科学版).2003年12月第四期
[39]梁雅,刘岚.基于Java卡DES及3DES算法的实现.武汉理工大学学报(信息与管理工程版).2006年11月第11期
[40]于帆,王振铎,王振辉.基于XML异构数据库集成中间件的设计与实现.计算机应用研究:2007年24卷9期:185-188
[41]邵秀丽,韩建彬,阎仲蹼.基于XML的异构数据源间数据交换的实现研究.南开大学学报:自然科学版.2007年40卷3期:9-14
[42]杨先娣 何宁 吴黎兵.中间件法解决异构数据集成问题.中国教育网络.2007年1期:62-64
[43]XIA Chengyi,LIU Zhongxin,CHEN Zengqiang,etc.Dynamic spreading behavior of homogeneous and heterogeneous networks.PROGRESS IN NATURAL SCIENCE.2007,17(3):358-365
[44]Yanxin Wang Kuihe Yang.Research and Realization of XML-based Heterogeneous Databases Integration.JOURNAL OF COMMUNICATION AND COMPUTER.2006,3(3):109-133
[45]ZENG Biqing CHEN Zhigang TAN Lu XIONG Ce.Scalable Data Assignment Algorithm of Parallel I/O for Distributed Heterogeneous Computing.JOURNAL OF COMMUNICATION AND COMPUTER.2005,2(3):51-55
[47]Lou,Yabin Tao,Fengmei Ma,Yuan.The Research of Heterogeneous Data Source Integration Method.Based on Ontology.2005,21(10x):119-121
[48]叶军,李志蜀,殷锋,等.Web Services在企业信息系统集成中应用架构的研究.计算机应用研究.2007年24卷6期:295-298
[49]张晓星 唐朝晖.企业多源异构数据库数据集成的研究.可编程控制器与工厂自动化(PLC FA):2007年3期:66-68,76
[2]樊重俊,刘芹,杨神曼.集团型企业信息技术战略规划.集团经济研究.2007年07Z期:23-24
[3]信息产业部计算机技术培训中心编著.计算机信息系统集成项目经理技术手册[M].电子工业出版社,2004.
[4]杨宏英,林长松.异构数据集成系统的应用模式与技术实现.微电子学与计算机.2006年 23卷 8期:70-72
[5]北京大学的CoXML.http://www.jyssti.gov.cn/bst/For_Print.ASP?ID=1725
[6]太极软件公司的XML信息集成系统-TaijiVEⅡhttp://www.primeton.com/about/read.php?id=303&his=1
[7]金易KAF/EAI系统 http://www.kingeasy.com.cn/news_view.asp?newsid=100
[8]1Z.G.Ivesetal.An Adaptive Query Execution System for Data Integration.ACM SIGMOD Conference on Management of Data,1999
[9]Microsoft.UDA.Available online at http://www.microsoft.com/china/sql/70/interopmigrate/Interopoverview .mspx
[10]IBM.DB2 Information Integrator.Available online at http://www.ibm.com/developerworks/cn/db2/library/techarticles/ii bigpicture/iibigpicture.html
[11]Sybase.Data Integration Suite.Available online at http://sybase.chinaunix.net/1/2007/0619/2.shtml
[12]Oracle.Fusion MiddleWare.Available online at http://www.oracle.com/technology/products/middleware/index.html
[13]异构面临的问题.http://www.haodf.net/softtech/erp/other/200609/118793.html
[14]Benoit Marchal.XML示例程序导学.杨洪涛,顾雷,郑震坤译.北京:清华大学出版社,2002
[15]萧仁惠 陈锦辉.JDBC数据库程序设计.北京:中国铁道出版社,2004
[16]Huang Lican,Wu Zhaohui,Pan Yunhe.Distributed heterogeneous inspecting system and its middleware-based solution.JOURNAL OF ZHEJIANG UNIVERSITY SCIENCE.2003,4(5):542-548
[17]Zhang Chengwen,Su Sen,Chen Junliang.GAMi:Genetic Algorithm-Based Middleware for QoS-Aware Web Services Selection.CHINESE OF JOURNAL ELECTRONICS.2007,16(3):537-542
[18]李璐,张广泉.消息中间件的体系结构研究.苏州大学学报:工科版.2007年27卷3期:10-14
[19]梁立新.项目实践精解:Java Web应用开发.北京:电子工业出版社,2007
[20]袁琳 李秉严.SGML、HTML、XML的比较.四川图书馆学报.2001年 3期:34-36
[21]DOUYuhong,ZHANGYaoxue,LIXing.An XML-based Software Component Description Method for Program Mining.CHINESE OF JOURNAL ELECTRONICS.2004,13(1):100-104
[22]刘红文.浅谈WebService技术.福建电脑.2007年3期:70,111
[23]Harvey M.Deitel等著,邱仲潘等译.Java Web服务高级教程.北京:机械工业出版社,2003
[24]江义华,林彩榆.Java完美经典.北京:中国铁道出版社,2004
[25]ZHANGChang-li SHENWei-zheng FANGJun-long.Using TCP / IP Programming to Realize the Communication among Different Network Platforms.JOURNAL OF NORTHEAST AGRICULTURAL UNIVERSITY.2004,11(1):77-79
[26]姬婧,杜瑞庆,刘志贺.浅谈Java中有连接的Socket通信机制.电脑知识与技术:学术交流.2007年4期:92-93
[27]马保国,王连锋,李华刚.XML在Socket方式实时数据交换中的应用.计算机技术与发展.2007年17卷5期.18-20,23
[28]曹大有,张斌.通过Java Socket建立连接类实现与Web服务器的交互操作.福建电脑.2007年1期:191-192
[29]渠本哲,张凝,王潜平.使用Java和XML实现数据移植.计算机技术与发展.2006年16卷9期:15-17
[30]秦玉杰 李革 黄柯棣.使用JDBC实现XML文档到Oracle9i数据库的存取.计算 机工程与设计.2005年26卷10期:2582-2584,2601
[31]孔祥盛,孙婧.Hibernate持久化中间件管理数据.内江科技.2007年28卷9期:142-143
[32]王钱,王蓉,张利.基于iBatis的通用数据持久层的研究与设计.微计算机信息.2007年04X期:172-173
[33]成培 李峰 王畅.连接池数据库访问技术深入研究.计算机工程与设计.2007年28卷3期:509-511
[34]谢俊,陈明,付嵘.基于Java的数据库连接池的研究与实现.中国科技信息.2007年4期:135-137
[35]张力文.Java的XML语法分析工具--JAXP.电子计算机.2001年2期:33-38
[36]黎楚 薛胜军 罗强.XML应用的关键:XML解析技术.电脑知识与技术:学术交流.2007年1期:187-189
[37]王永猛,夏士雄,王尚防.企业内部信息系统安全浅析.电脑知识与技术:学术交流.2007年3期:1353-1354
[38]熊聪聪,李伟.基于Java的DES加密算法.天津师范大学学报(自然科学版).2003年12月第四期
[39]梁雅,刘岚.基于Java卡DES及3DES算法的实现.武汉理工大学学报(信息与管理工程版).2006年11月第11期
[40]于帆,王振铎,王振辉.基于XML异构数据库集成中间件的设计与实现.计算机应用研究:2007年24卷9期:185-188
[41]邵秀丽,韩建彬,阎仲蹼.基于XML的异构数据源间数据交换的实现研究.南开大学学报:自然科学版.2007年40卷3期:9-14
[42]杨先娣 何宁 吴黎兵.中间件法解决异构数据集成问题.中国教育网络.2007年1期:62-64
[43]XIA Chengyi,LIU Zhongxin,CHEN Zengqiang,etc.Dynamic spreading behavior of homogeneous and heterogeneous networks.PROGRESS IN NATURAL SCIENCE.2007,17(3):358-365
[44]Yanxin Wang Kuihe Yang.Research and Realization of XML-based Heterogeneous Databases Integration.JOURNAL OF COMMUNICATION AND COMPUTER.2006,3(3):109-133
[45]ZENG Biqing CHEN Zhigang TAN Lu XIONG Ce.Scalable Data Assignment Algorithm of Parallel I/O for Distributed Heterogeneous Computing.JOURNAL OF COMMUNICATION AND COMPUTER.2005,2(3):51-55
[47]Lou,Yabin Tao,Fengmei Ma,Yuan.The Research of Heterogeneous Data Source Integration Method.Based on Ontology.2005,21(10x):119-121
[48]叶军,李志蜀,殷锋,等.Web Services在企业信息系统集成中应用架构的研究.计算机应用研究.2007年24卷6期:295-298
[49]张晓星 唐朝晖.企业多源异构数据库数据集成的研究.可编程控制器与工厂自动化(PLC FA):2007年3期:66-68,76