基于用户报表的概念数据模型快速建模方法研究
摘要
随着信息技术的迅猛发展,数据库技术已经渗透到经济和社会的各个领域,并已被公认为是信息资源开发、管理和服务最有效的手段之一。其中数据库设计作为建立数据库及其应用系统的基础和核心技术尤其得到了社会各界的广泛关注,并已成为数据库技术领域研究的重点内容。
按照规范化设计方法,数据库设计通常划分为需求分析、概念结构设计、逻辑结构设计、物理结构设计、数据库实施、运行和维护六个阶段。其中,概念结构设计是通过对用户需求进行综合、归纳与抽象,形成一个独立于具体数据库系统的概念数据模型的过程。作为联系现实世界与机器世界的桥梁和纽带,概念结构设计,尤其是概念数据建模的质量与效能直接决定了数据库系统建设的成败,因此在数据库设计中一直占有非常重要的地位。
本文针对目前概念数据建模主要采用手工设计方法,建模质量和效能过分依赖设计人员个人经验和水平的实际情况,提出了一种基于用户报表的概念数据模型快速建模方法,旨在通过对各类复杂用户报表共性结构和语义特征的分析,实现用户报表所蕴含实体及其数据结构信息的自动提取,并将其自动转化为E-R模型,以提高概念数据模型的建模效率。主要研究工作包括：复杂用户报表的规范化处理与统一形式化描述方法、用户报表与E-R模型的概念映射体系、用户报表数据项提取及分类算法、用户报表数据结构特征提取算法,以及用户报表数据结构特征到E-R模型的转换方法。在此基础之上,通过开发一个原型系统,对研究成果的正确性和有效性进行了初步验证。
概念数据模型自动化建模技术是一项极具挑战性的研究工作,由于时间及自身水平有限,论文研究工作尚缺乏深度,且存在很多不足之处,作者将在后续的研究过程中加以持续改进。
With the rapid development of information technology, database technology has permeated every realm of economy and society, and has been generally acknowledged as one of the most effective methods of the information resource development, management and service. As the foundation and core technology of building database and data base application system, database design has particularly drawn wide attention from various circles of society, and has become key research content in database technology field.
According to the standardized design, database design is usually divided into six stages, including requirement analysis, conceptual structure design, logical structure design, physical structure design, database implementation, operation and maintenance. Among them, conceptual structure design is the process forming a conceptual data model independent of a specific database system through synthesis, induction and abstraction of user requirements. As a bridge and link of the real world and the machine world, conceptual structure design, particularly the quality and efficacy of the conceptual data modeling determines the success or failure of the construction of database system. Therefore, conceptual structure design plays a very important role in the database design.
Aiming at the present situation that conceptual data modeling mainly by manual designing, and which quality and effectiveness over-reliance on designers' personal experience and standard, this paper proposes a rapid modeling method of conceptual data model based on user views. It can improve the efficiency of conceptual data modeling by analysis various complex common structural and semantic features, to realize the automatic extraction of entities implied in user views and their data structure information, and then convert to ER model automatically. Main research activities include:the normalized treatment of complex user views and unified formal description method, the concept mapping system between user views and E-R model, extraction and classification algorithm for data items of user views, and the conversion method from data structure features of user views to the ER model. On this basis, It preliminary verifies the accuracy and validity of research conducted by developing a prototype system.
Conceptual data model automated modeling technology is a challenging research work, due to time and own standard limited, this paper studies still lack depth and exist a great deal of insufficient, there will be continuous improvement in the follow-up research process.
按照规范化设计方法,数据库设计通常划分为需求分析、概念结构设计、逻辑结构设计、物理结构设计、数据库实施、运行和维护六个阶段。其中,概念结构设计是通过对用户需求进行综合、归纳与抽象,形成一个独立于具体数据库系统的概念数据模型的过程。作为联系现实世界与机器世界的桥梁和纽带,概念结构设计,尤其是概念数据建模的质量与效能直接决定了数据库系统建设的成败,因此在数据库设计中一直占有非常重要的地位。
本文针对目前概念数据建模主要采用手工设计方法,建模质量和效能过分依赖设计人员个人经验和水平的实际情况,提出了一种基于用户报表的概念数据模型快速建模方法,旨在通过对各类复杂用户报表共性结构和语义特征的分析,实现用户报表所蕴含实体及其数据结构信息的自动提取,并将其自动转化为E-R模型,以提高概念数据模型的建模效率。主要研究工作包括：复杂用户报表的规范化处理与统一形式化描述方法、用户报表与E-R模型的概念映射体系、用户报表数据项提取及分类算法、用户报表数据结构特征提取算法,以及用户报表数据结构特征到E-R模型的转换方法。在此基础之上,通过开发一个原型系统,对研究成果的正确性和有效性进行了初步验证。
概念数据模型自动化建模技术是一项极具挑战性的研究工作,由于时间及自身水平有限,论文研究工作尚缺乏深度,且存在很多不足之处,作者将在后续的研究过程中加以持续改进。
With the rapid development of information technology, database technology has permeated every realm of economy and society, and has been generally acknowledged as one of the most effective methods of the information resource development, management and service. As the foundation and core technology of building database and data base application system, database design has particularly drawn wide attention from various circles of society, and has become key research content in database technology field.
According to the standardized design, database design is usually divided into six stages, including requirement analysis, conceptual structure design, logical structure design, physical structure design, database implementation, operation and maintenance. Among them, conceptual structure design is the process forming a conceptual data model independent of a specific database system through synthesis, induction and abstraction of user requirements. As a bridge and link of the real world and the machine world, conceptual structure design, particularly the quality and efficacy of the conceptual data modeling determines the success or failure of the construction of database system. Therefore, conceptual structure design plays a very important role in the database design.
Aiming at the present situation that conceptual data modeling mainly by manual designing, and which quality and effectiveness over-reliance on designers' personal experience and standard, this paper proposes a rapid modeling method of conceptual data model based on user views. It can improve the efficiency of conceptual data modeling by analysis various complex common structural and semantic features, to realize the automatic extraction of entities implied in user views and their data structure information, and then convert to ER model automatically. Main research activities include:the normalized treatment of complex user views and unified formal description method, the concept mapping system between user views and E-R model, extraction and classification algorithm for data items of user views, and the conversion method from data structure features of user views to the ER model. On this basis, It preliminary verifies the accuracy and validity of research conducted by developing a prototype system.
Conceptual data model automated modeling technology is a challenging research work, due to time and own standard limited, this paper studies still lack depth and exist a great deal of insufficient, there will be continuous improvement in the follow-up research process.
引文
[1]萨师煊,王珊.数据库系统概论[M](第3版).北京：高等教育版社,2000.
[2]王杏林,曹晓东.概念建模[M].北京：国防工业出版社,2007.
[3]高复先.信息资源规划[M].北京：清华大学出版社,2002.
[4]James Martin, Clive Finkelstein. Information Engineering [M]. Carnforth, U.K.:Savant Institute,1981.
[5]William Durell. Data administration——A practical guide to successful data management[M]. New York:McGraw Hill,1984.
[6]李鹤.对于信息资源规划方法的进一步探讨[J].科技情报开发与经济,2007,17(17)：115-116.
[7]James Martin. Strategic data-planning methodologies[M]. Englewood Cliffs, New Jersey: Prentice-Hall,1982.
[8]陈骞,刘伟,孟庆久.信息资源规划中的主题数据库研究[J].情报杂志,2006,(2)：136-138.
[9]林毅奇.自动报表系统的设计与实现[D].福建：厦门大学,2008.
[10]祝亮.复杂通用报表模型的研究与实现[D].武汉：武汉科技大学,2007.
[11]张建富,吴志军,冯平法等.报表数据模型研究及系统设计[J].微计算机信息,2008,24(9)：1-3.
[12]熊晴海.电算化会计[M].成都：西南财经大学出版社,2007.
[13]杨国强,路萍,张志军.Erwin数据建模[M].北京：电子工业出版社,2004.
[14]易锋.概念模型的结构化表示[D].武汉：华中科技大学,2006.
[15]Terry Halpin, Tony Morgan. Conceptual Modeling:First Steps [J]. Information Modeling and Relational Databases (Second Edition),2008:59-108.
[16]梁正平,毋国庆,肖敬等.基于模型驱动的软件体系结构[J].计算机应用研究,2002,(11)：44-46.
[17][英]Ian Sommerville.软件工程[M].北京：机械工业出版社,2005.
[18]ER conferences:http://www.conceptualmodeling.org/.
[19]ER history:http://cs-exhibitions.uni-klu.ac.at/index.php?id=185.
[20]包海挺.ER模型的语义概念集合和表示法[J].科技情报开发与经济,2006,16(6)：217-219.
[21]Antonio Badia. Entity-relationship modeling revisited [J]. Sigmod Record,2004,33(1):77-82.
[22]牛莉.ORM数据库建模方法及其与传统方法的比较[J].邵阳学院学报,2007,4(2)：19-22.
[23]严金贵.基于E-R模型的多维数据建模方法研究[D].重庆：重庆大学,2006.
[24]S. Hartmann, A. Hoffmann, S. Link, et al. Axiomatizing functional dependencies in the higher-order entity-relationship model [J]. Inf. Process. Lett.,2003,87(3):133-137.
[25]S. Hartmann. Reasoning about participation constraints and Chen's constraints [A]. Proceedings of the 14th Australasian database conference [C],2003:105-113.
[26]王志英,葛世伦.面向角色的信息系统建模方法研究[J].计算机与数字工程,2006,34(4)：77-80.
[27]Terry Halpin. Microsoft's new database modeling tool:Part 2 [J]. Journal of Conceptual Modeling,2001,8(21), (online at www.orm.net).
[28][美]Terry Halpin.信息建模与关系数据库—从概念分析到逻辑设计[M].北京：电子工业出版社,2004.
[29]李俊平.IDEF1x语义建模方法及其在数据库设计中的应用[J].微计算机应用,2005,26(4)：455-458.
[30]IDEF1X data modeling method:http://www.idef.com/IDEF1x.htm.
[31]Andrew Kusiak, Terry Letsche, Armen Zakarian. Data modelling with IDEF1x [J]. International Journal of Computer Integrated Manufacturing,1997,10(6):470-486.
[32]朱宇.数据建模方法的比较与分析[J].计算机系统应用,2005,(7)：86-90.
[33]于海雯.UML数据库建模[J].信息与电脑(理论版),2009,(10)：90-91.
[34]梁玮.基于UML的面向对象建模方法研究[J].软件导刊,2009,8(1)：47-49.
[35]刘超,张莉.标准建模语言UML教程(第2版)[M].北京：航空航天大学出版社,2002.
[36]蒋韶生,张祖平,陈松乔.数据建模工具及其在决策支持系统中的应用[J].计算机工程与应用,2003,(10)：202-205.
[37]刘芳,徐雅君,梁娜.UML和建模工具Rational Rose的应用[J].计算机应用研究,2002,(11)：119-120.
[38]薛昌春.浅谈数据库建模方法与应用[J].电脑知识与技术,2007,(18)：1516-1517.
[39]王经卓,刘永生,丁兆奎等.关系数据库的建模技术研究[J].海工学院报,2002,1 1(2)：19-22.
[40]顾平.数据库设计工具PowerDesigner的研究与实践[J].计算机应用与软件,2004,21(11)：18-20.
[41]吴伟敏.UML建模工具的比较——ROSE, VisioPowerDesigner[J].现代计算机,2003,(6)：32-35.
[42]孟芸,任传成,姜坤等.数据库设计工具PowerDesigner正向工程的研究与实践[J].福建电脑,2007,(1)：170-171.
[43]叶忠杰.数据库概念模式及其设计[J].现代电子技术,2005,(24)：73-75.
[44]Cuneyd Firat. Conceptual modeling and conceptual analysis in HLA [A]. Proceedings of the fall 2000 Simulation Interoperability Workshop[C],2000:17-22..
[45]B. Thalheim. Entity-relationship modeling-Foundations of database technology [M]. Berlin: Springer,2000.
[46]高复先.信息资源规划系列(四)：数据标准与数据管理[J].中国教育网络,2006,(11)：58-62.
[47]高复先.信息资源规划系列(二)：信息资源规划的理论指导[J].中国教育网络,2006,(09)：62-64.
[48]李姝琳,孙德杰,史震东等.信息资源规划——IRP技术研究[J].中国水运(下半月),2008,(04)：230-231.
[49]E. Rahm, H. DoH. Data cleaning:problems and current approaches [J]. IEEE Data Engineering Bulletin,2000,23(4):3-13.
[50]吕景耀.数据清洗及XML技术在数字报刊中的研究与应用[D].北京：北京邮电大学,2009.
[51]梁文斌.数据仓库中数据清洗的研究与设计[D].江苏：苏州大学,2005.
[52]M. L. Lee, T. W. Ling, W. L. Lwo. Intelliclean:a knowledge-based intelligent datacleaner [A]. Proeeedings of the 6th ACM SIGKDD International Conference on Knowledge Diseovery and DataMing.Boston:AMCPress [C],2007:290-294.
[53]Dominik Lueebber, Udo Grimmer. Systematic Development of data mining based data quality tools [A]. Proceedings of the 29th VLDB [C],2003:548-559.
[54]王日芬,章成志,张蓓蓓等.数据清洗研究综述[J].现代图书情报技术,2007,(12)：50-56.
[55]李志宾.VBA语言在工程造价中的应用[J].科技情报开发与经济,2009,19(05)：1 13-114.
[56]张思聪.利用VBA技术实现对企业原有系统的数据整合及其应用[D].上海：复旦大学,2008.
[2]王杏林,曹晓东.概念建模[M].北京：国防工业出版社,2007.
[3]高复先.信息资源规划[M].北京：清华大学出版社,2002.
[4]James Martin, Clive Finkelstein. Information Engineering [M]. Carnforth, U.K.:Savant Institute,1981.
[5]William Durell. Data administration——A practical guide to successful data management[M]. New York:McGraw Hill,1984.
[6]李鹤.对于信息资源规划方法的进一步探讨[J].科技情报开发与经济,2007,17(17)：115-116.
[7]James Martin. Strategic data-planning methodologies[M]. Englewood Cliffs, New Jersey: Prentice-Hall,1982.
[8]陈骞,刘伟,孟庆久.信息资源规划中的主题数据库研究[J].情报杂志,2006,(2)：136-138.
[9]林毅奇.自动报表系统的设计与实现[D].福建：厦门大学,2008.
[10]祝亮.复杂通用报表模型的研究与实现[D].武汉：武汉科技大学,2007.
[11]张建富,吴志军,冯平法等.报表数据模型研究及系统设计[J].微计算机信息,2008,24(9)：1-3.
[12]熊晴海.电算化会计[M].成都：西南财经大学出版社,2007.
[13]杨国强,路萍,张志军.Erwin数据建模[M].北京：电子工业出版社,2004.
[14]易锋.概念模型的结构化表示[D].武汉：华中科技大学,2006.
[15]Terry Halpin, Tony Morgan. Conceptual Modeling:First Steps [J]. Information Modeling and Relational Databases (Second Edition),2008:59-108.
[16]梁正平,毋国庆,肖敬等.基于模型驱动的软件体系结构[J].计算机应用研究,2002,(11)：44-46.
[17][英]Ian Sommerville.软件工程[M].北京：机械工业出版社,2005.
[18]ER conferences:http://www.conceptualmodeling.org/.
[19]ER history:http://cs-exhibitions.uni-klu.ac.at/index.php?id=185.
[20]包海挺.ER模型的语义概念集合和表示法[J].科技情报开发与经济,2006,16(6)：217-219.
[21]Antonio Badia. Entity-relationship modeling revisited [J]. Sigmod Record,2004,33(1):77-82.
[22]牛莉.ORM数据库建模方法及其与传统方法的比较[J].邵阳学院学报,2007,4(2)：19-22.
[23]严金贵.基于E-R模型的多维数据建模方法研究[D].重庆：重庆大学,2006.
[24]S. Hartmann, A. Hoffmann, S. Link, et al. Axiomatizing functional dependencies in the higher-order entity-relationship model [J]. Inf. Process. Lett.,2003,87(3):133-137.
[25]S. Hartmann. Reasoning about participation constraints and Chen's constraints [A]. Proceedings of the 14th Australasian database conference [C],2003:105-113.
[26]王志英,葛世伦.面向角色的信息系统建模方法研究[J].计算机与数字工程,2006,34(4)：77-80.
[27]Terry Halpin. Microsoft's new database modeling tool:Part 2 [J]. Journal of Conceptual Modeling,2001,8(21), (online at www.orm.net).
[28][美]Terry Halpin.信息建模与关系数据库—从概念分析到逻辑设计[M].北京：电子工业出版社,2004.
[29]李俊平.IDEF1x语义建模方法及其在数据库设计中的应用[J].微计算机应用,2005,26(4)：455-458.
[30]IDEF1X data modeling method:http://www.idef.com/IDEF1x.htm.
[31]Andrew Kusiak, Terry Letsche, Armen Zakarian. Data modelling with IDEF1x [J]. International Journal of Computer Integrated Manufacturing,1997,10(6):470-486.
[32]朱宇.数据建模方法的比较与分析[J].计算机系统应用,2005,(7)：86-90.
[33]于海雯.UML数据库建模[J].信息与电脑(理论版),2009,(10)：90-91.
[34]梁玮.基于UML的面向对象建模方法研究[J].软件导刊,2009,8(1)：47-49.
[35]刘超,张莉.标准建模语言UML教程(第2版)[M].北京：航空航天大学出版社,2002.
[36]蒋韶生,张祖平,陈松乔.数据建模工具及其在决策支持系统中的应用[J].计算机工程与应用,2003,(10)：202-205.
[37]刘芳,徐雅君,梁娜.UML和建模工具Rational Rose的应用[J].计算机应用研究,2002,(11)：119-120.
[38]薛昌春.浅谈数据库建模方法与应用[J].电脑知识与技术,2007,(18)：1516-1517.
[39]王经卓,刘永生,丁兆奎等.关系数据库的建模技术研究[J].海工学院报,2002,1 1(2)：19-22.
[40]顾平.数据库设计工具PowerDesigner的研究与实践[J].计算机应用与软件,2004,21(11)：18-20.
[41]吴伟敏.UML建模工具的比较——ROSE, VisioPowerDesigner[J].现代计算机,2003,(6)：32-35.
[42]孟芸,任传成,姜坤等.数据库设计工具PowerDesigner正向工程的研究与实践[J].福建电脑,2007,(1)：170-171.
[43]叶忠杰.数据库概念模式及其设计[J].现代电子技术,2005,(24)：73-75.
[44]Cuneyd Firat. Conceptual modeling and conceptual analysis in HLA [A]. Proceedings of the fall 2000 Simulation Interoperability Workshop[C],2000:17-22..
[45]B. Thalheim. Entity-relationship modeling-Foundations of database technology [M]. Berlin: Springer,2000.
[46]高复先.信息资源规划系列(四)：数据标准与数据管理[J].中国教育网络,2006,(11)：58-62.
[47]高复先.信息资源规划系列(二)：信息资源规划的理论指导[J].中国教育网络,2006,(09)：62-64.
[48]李姝琳,孙德杰,史震东等.信息资源规划——IRP技术研究[J].中国水运(下半月),2008,(04)：230-231.
[49]E. Rahm, H. DoH. Data cleaning:problems and current approaches [J]. IEEE Data Engineering Bulletin,2000,23(4):3-13.
[50]吕景耀.数据清洗及XML技术在数字报刊中的研究与应用[D].北京：北京邮电大学,2009.
[51]梁文斌.数据仓库中数据清洗的研究与设计[D].江苏：苏州大学,2005.
[52]M. L. Lee, T. W. Ling, W. L. Lwo. Intelliclean:a knowledge-based intelligent datacleaner [A]. Proeeedings of the 6th ACM SIGKDD International Conference on Knowledge Diseovery and DataMing.Boston:AMCPress [C],2007:290-294.
[53]Dominik Lueebber, Udo Grimmer. Systematic Development of data mining based data quality tools [A]. Proceedings of the 29th VLDB [C],2003:548-559.
[54]王日芬,章成志,张蓓蓓等.数据清洗研究综述[J].现代图书情报技术,2007,(12)：50-56.
[55]李志宾.VBA语言在工程造价中的应用[J].科技情报开发与经济,2009,19(05)：1 13-114.
[56]张思聪.利用VBA技术实现对企业原有系统的数据整合及其应用[D].上海：复旦大学,2008.