“数字海洋”通用文档数据管理方法研究
|
摘要
通用的文档数据管理方法,是建立在通用理论基础上的一种复杂的组合技术方法,它可以克服传统文档数据管理模式灵活性差、不便于扩展等局限,满足“数字海洋”中多格式、多来源文档数据业务需求,解决“数字海洋”中多格式、多来源文档数据存储难、管理难等问题,并提高文档数据的管理效率和利用率。
本文结合“海洋数据体系规划和海洋数据仓库构建技术”(908-03-01)专题中的海洋数据仓库系统的总体结构设计研究内容,以构建通用性文档数据管理系统--底层“标准数据集”为主要目标,进行了通用文档数据管理方法和应用的研究。
(1)基于关系数据库理论、对象关系数据映射理论以及元数据理论,并考虑系统后期可扩展性和运行效能因素,设计了通用元数据驱动开发模型。
(2)基于该模型,利用分层架构的思想,将“数字海洋”中多格式、多来源文档数据的特点和存储管理需求,并融合分层架构各个层次的功能需求,深入分析出各个层次的展现功能;运用实体构建器工具,方便和灵活地实现上述功能。
(3)以“数字海洋”中“文档资料管理系统”为示范,展示了通用性文档数据管理方案强大的灵活性和扩展性。
本文提出的通用文档数据管理方案,具有以下特点:
(1)通用性。“数字海洋”中业务人员基于自身的业务背景和需求,灵活的定制数据库管理属性。
(2)可扩展性。实体构建器工具的开发满足了系统扩展性的需要,实现了管理属性动态更新。
(3)灵活性。多层架构中数据展示层、数据实体层和数据访问层的自动构建,不仅可以缩短专业数据库的平台建设周期,还大大降低开发成本和维护成本。
综上所述,该通用的文档数据管理方案可为“数字海洋”中多格式、多来源的文档数据管理提供强大的技术支持,并可大大提高海洋文档数据的管理效率和利用率。
Universal data management method is a complicated combination technique on the basis of common theory. It can overcome the flexibility difficulty and the limitation of expanding the management model. Further more, the new method fulfill the request of“Digital Ocean”, which are multi-format and multi-source, and makes it easy to store and management. Thus, with this new method, the efficiency of management and utilization are highly improved.
Based on the research of the structural design of the project --“Planning of the Marine Data System and constructing technology with the Marine Data Warehouse”(908-03-01), a universal data management method is designed toward the goal of constructing universal data management system.
(1) Design a new metadata motivated model with great flexibility and extension based on Object Relational database theory and Object Relational Mapping theory.
(2) With the thought of“hierarchy frame”, combine the management demand in the multi-format, multi-source data in "Digital Ocean" with the demand for building up each hierarchy, analyze the function of each level; Use the entity constructing tool and realize the function in a flexible way.
(3) Regard "Data Management System" of "Digital Ocean" as demonstration, show the convenient and effective management.
The characteristics of the universal management method are as follow:
(1) Universality. Facilitate data management according to different demand in "Digital Ocean ".
(2) Expansibility. When demand changes in the original attributes, it can be updated dynamically.
(3) Flexibility. The Data Interface Layer and The Data Entity Layer are created dynamically by customers’demand.
This new method will provide a strong technical support for the multi-format, multi-source data management in "Digital Ocean", and will greatly enhance the utilization of marine documentation.
本文结合“海洋数据体系规划和海洋数据仓库构建技术”(908-03-01)专题中的海洋数据仓库系统的总体结构设计研究内容,以构建通用性文档数据管理系统--底层“标准数据集”为主要目标,进行了通用文档数据管理方法和应用的研究。
(1)基于关系数据库理论、对象关系数据映射理论以及元数据理论,并考虑系统后期可扩展性和运行效能因素,设计了通用元数据驱动开发模型。
(2)基于该模型,利用分层架构的思想,将“数字海洋”中多格式、多来源文档数据的特点和存储管理需求,并融合分层架构各个层次的功能需求,深入分析出各个层次的展现功能;运用实体构建器工具,方便和灵活地实现上述功能。
(3)以“数字海洋”中“文档资料管理系统”为示范,展示了通用性文档数据管理方案强大的灵活性和扩展性。
本文提出的通用文档数据管理方案,具有以下特点:
(1)通用性。“数字海洋”中业务人员基于自身的业务背景和需求,灵活的定制数据库管理属性。
(2)可扩展性。实体构建器工具的开发满足了系统扩展性的需要,实现了管理属性动态更新。
(3)灵活性。多层架构中数据展示层、数据实体层和数据访问层的自动构建,不仅可以缩短专业数据库的平台建设周期,还大大降低开发成本和维护成本。
综上所述,该通用的文档数据管理方案可为“数字海洋”中多格式、多来源的文档数据管理提供强大的技术支持,并可大大提高海洋文档数据的管理效率和利用率。
Universal data management method is a complicated combination technique on the basis of common theory. It can overcome the flexibility difficulty and the limitation of expanding the management model. Further more, the new method fulfill the request of“Digital Ocean”, which are multi-format and multi-source, and makes it easy to store and management. Thus, with this new method, the efficiency of management and utilization are highly improved.
Based on the research of the structural design of the project --“Planning of the Marine Data System and constructing technology with the Marine Data Warehouse”(908-03-01), a universal data management method is designed toward the goal of constructing universal data management system.
(1) Design a new metadata motivated model with great flexibility and extension based on Object Relational database theory and Object Relational Mapping theory.
(2) With the thought of“hierarchy frame”, combine the management demand in the multi-format, multi-source data in "Digital Ocean" with the demand for building up each hierarchy, analyze the function of each level; Use the entity constructing tool and realize the function in a flexible way.
(3) Regard "Data Management System" of "Digital Ocean" as demonstration, show the convenient and effective management.
The characteristics of the universal management method are as follow:
(1) Universality. Facilitate data management according to different demand in "Digital Ocean ".
(2) Expansibility. When demand changes in the original attributes, it can be updated dynamically.
(3) Flexibility. The Data Interface Layer and The Data Entity Layer are created dynamically by customers’demand.
This new method will provide a strong technical support for the multi-format, multi-source data management in "Digital Ocean", and will greatly enhance the utilization of marine documentation.
引文
[1]吴桑云,刘宝银.中国海湾信息系统基础[M].北京:海洋出版社,2007:9-13
[2] Scott W. Ambler. Agile Database Techniques: Effective Strategies for the Agile Software Developer. [M].John Wiley &Sons, 2003
[3] Martin Fowler. Patterns of Enterprise Application Architecture. [M].Addison-Wesley Professional, 2002
[4]王成良,杨祥凌.对象模型向关系数据库模式映射的策略及其应用.计算机工程,2004,30(1):155-157
[5]张虹,郑会颂. UML中的类模式在关系数据库中的映射及其实现.南京邮电学院学报,2005,25(3):73-77
[6]元数据概述,http://msdn2.microsoft.com/zh-cn/library/xcd8txaw(VS.80).aspx
[7]袁满. POSC数据模型与我国石油工业数据标准化,大庆石油学院,2005
[8]袁满,郭宝祥,孙永东.元数据驱动的个性化查询工具设计与实现.计算机工程与应用,2007
[9]郭志红.元数据的多角度透视,上海交通大学情报研究所,2005
[10]我国近海海洋综合调查与评价专项开始发挥作用,http://www.gov.cn
[11] Erich Gamma, Richard Helm. Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley Professional, 2000
[12]岳建伟,钟耳顺.元数据驱动的土地信息系统可复用构建研究.中国科学院地理科学与资源研究所,2006.
[13]王晓武.基于需求共性、数据字典和重用构件的应用系统开发方法.总后勤部司令,2003
[14] Nbear主页,http://nbear.org/
[15]国家海洋基础信息网络,http://water.nstl.gov.cn/MirrorResources/3787/
[16]郭禾,陈锋.一个有较高可适用性的通用企业信息管理系统模型.小型微型计算机系统,2004.
[17]李中学,李生林.基于领域构件的开发平台设计与实现.计算机应用,2000
[18]李生林,李中学.信息系统自动生成技术.后勤工程学院学报,1998
[19] Hernandez, Michael J. Database Design for Mere Mortals: A Hands-On Guide to Relational Database Design, Second Edition. Addison-Wesley Professional. 2003
[20] Alistair Cockburn. Writing Effective Use Cases.Addison-Wesley Professional,2000
[21]马劲松,徐寿成等.数字海洋虚拟水下数字地形实现的关键技术.南京大学, 2007
[22]国家海洋局908专项办公室.海洋底质调查技术规范.北京:海洋出版社,2006
[23]章任群.基于地理控件的海域使用管理信息系统框架研究,青岛:中国海洋大学,2003
[24] George M. Maracas.敖富江译.数据仓库、挖掘和可视化核心概念.北京:清华大学出版社,2004
[25]何铮,陈志刚.对象/关系映射框架的研究与应用.计算机工程与应用,2003.39(26):188-191
[26] Paul Turley,Dan Wood著.刘颖译.SQL Server 2005 Transat-SQL编程入门经典.北京:清华大学出版社,2007
[28] Steve Adolph,Paul Bramble.Patterns for Effective Use Cases .Addison Wesley Professional,2002
[29] Rebecca Wirfs-Brock,Alan McKean著.倪硕,陈师译.对象设计.北京:人民邮电出版社,2006
[30] Jason T. Roff.张瑜,杨继萍等译.UML基础教程.北京:清华大学出版社,2004
[31] Craig Larman.姚淑珍,李虎等译.UML和模式应用.北京:机械出版社,2002
[32]冯士筰,李凤歧,李少青著.海洋科学导论.北京:高等教育出版社,1999
[33]中国海洋信息网.http://www.coi.gov.cn/
[34]国家海洋局.http://www.soa.gov.cn/hyjww/index.htm
[35]邱岩.组件技术及其分析比较.计算机工程与应用,2003
[36]叶向东,陈国生.构建“数字海洋”实施海陆统筹.太平洋学报,2007
[37]王亚明,郭峰,向阳霞.软件复用技术及其开发方法.北京广播电视大学学报,2007
[38]焦金丹,胡金柱等.基于软件复用的领域分析和建模研究.微电子学与计算机,2006
[39] Riordan, Rebecca M. Designing Effective Database Systems. Addison-Wesley Professional. 2005
[40] K. Mori, H. Ihara, Y. Suzuki, K. Kawano, M. Koizumi, M. Orimo, K. Nakai, H. Nakanishi.Autonomous decentralized software structure and its application.Proc. FJCC, pp., Dallas, TX, 1986: 1056–1063
[41] Cheung KH, Nadkarni PM, Shin DG. A metadata approach to query interoperation between molecular biology databases. Yale University School of Medicine, 1998
[42] Sungwon Jung, Stephen Perkins, Yang Zhong, Sakti Pramanik, John Beaman. A new data model for biological classification. Comput. Appl. Biosci. 1995:11: 237 - 246
[43] E. Bazin, L. Duret, S. Penel, and N. Galtier. Polymorphix: a sequence polymorphism database. Nucleic Acids Res., 2005:33(suppl_1): D481 - D484
[44] Jung-Ho Ahn , Hyoung-Joo Kim. Dynamic SEOF: An Adaptable Object Prefetch Policy for Object-oriented Database Systems. Seoul National University, 1998
[45] G. Weiss. Multiagent System: A Modern Approach to Distributed Artificial Intelligence. MIT Press, 1999
[46] F. S. Zahran. A universal data model holder for data dictionary systems. The Computer Journal, 1981
[47] I. Ahmed. Towards the next level of abstraction, the autonomous decentralized system—An overview. Stud. Inf. Control. 2004. Vol.13 (no.4): 295–304
[48] Ghosh D, Locker J. In Transcription Factors: Essential Data. J Wiley and Sons, Chichester UK. 1996:82-104.
[49] F. F. Land. Evaluation of systems goals in determining a design strategy for a computer based information system. The Computer Journal, 1976: 19: 290 - 294
[50] K.G. Kulkarni, M.P. Atkinson. EFDM: Extended Functional Data Model. The ComputerJournal, 1986:29: 38 - 46
[51] N.A. Duffie, R. Chitturi, and J. Mou. Fault-tolerant hierarchical control of heterogeneous manufacturing system entities. J. Manufacturing Systems. 1988. Vol.7 (no.4):315–328
[52] L. Zhao, S.A. Roberts. An Object-Oriented Data Model for Database Modelling Implementation and Access. The Computer Journal. 1988. 31: 116 - 124
[53] P. Remagnino, A.I Shihab, G.A Jones. Distributed intelligence for a multi-agent visual surveillance. Pattern Recognit. 2004. Vol.37 (no.4): 675–689
[54] Dong-Guk Shin, Changhwan Lee, Jinghui Zhang, Kenneth E. Rudd, Claire M. Berg. Redesigning, implementing and integrating Escherichia coli genome software tools with an object-oriented database system. University of Connecticut. 1992
[55] T. D. Kimura, W. D. Gillett, and J. R. Cox. A Design of a Data Model Based on Abstraction of Symbols. The Computer Journal. 1985. 28: 298– 308
[2] Scott W. Ambler. Agile Database Techniques: Effective Strategies for the Agile Software Developer. [M].John Wiley &Sons, 2003
[3] Martin Fowler. Patterns of Enterprise Application Architecture. [M].Addison-Wesley Professional, 2002
[4]王成良,杨祥凌.对象模型向关系数据库模式映射的策略及其应用.计算机工程,2004,30(1):155-157
[5]张虹,郑会颂. UML中的类模式在关系数据库中的映射及其实现.南京邮电学院学报,2005,25(3):73-77
[6]元数据概述,http://msdn2.microsoft.com/zh-cn/library/xcd8txaw(VS.80).aspx
[7]袁满. POSC数据模型与我国石油工业数据标准化,大庆石油学院,2005
[8]袁满,郭宝祥,孙永东.元数据驱动的个性化查询工具设计与实现.计算机工程与应用,2007
[9]郭志红.元数据的多角度透视,上海交通大学情报研究所,2005
[10]我国近海海洋综合调查与评价专项开始发挥作用,http://www.gov.cn
[11] Erich Gamma, Richard Helm. Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley Professional, 2000
[12]岳建伟,钟耳顺.元数据驱动的土地信息系统可复用构建研究.中国科学院地理科学与资源研究所,2006.
[13]王晓武.基于需求共性、数据字典和重用构件的应用系统开发方法.总后勤部司令,2003
[14] Nbear主页,http://nbear.org/
[15]国家海洋基础信息网络,http://water.nstl.gov.cn/MirrorResources/3787/
[16]郭禾,陈锋.一个有较高可适用性的通用企业信息管理系统模型.小型微型计算机系统,2004.
[17]李中学,李生林.基于领域构件的开发平台设计与实现.计算机应用,2000
[18]李生林,李中学.信息系统自动生成技术.后勤工程学院学报,1998
[19] Hernandez, Michael J. Database Design for Mere Mortals: A Hands-On Guide to Relational Database Design, Second Edition. Addison-Wesley Professional. 2003
[20] Alistair Cockburn. Writing Effective Use Cases.Addison-Wesley Professional,2000
[21]马劲松,徐寿成等.数字海洋虚拟水下数字地形实现的关键技术.南京大学, 2007
[22]国家海洋局908专项办公室.海洋底质调查技术规范.北京:海洋出版社,2006
[23]章任群.基于地理控件的海域使用管理信息系统框架研究,青岛:中国海洋大学,2003
[24] George M. Maracas.敖富江译.数据仓库、挖掘和可视化核心概念.北京:清华大学出版社,2004
[25]何铮,陈志刚.对象/关系映射框架的研究与应用.计算机工程与应用,2003.39(26):188-191
[26] Paul Turley,Dan Wood著.刘颖译.SQL Server 2005 Transat-SQL编程入门经典.北京:清华大学出版社,2007
[28] Steve Adolph,Paul Bramble.Patterns for Effective Use Cases .Addison Wesley Professional,2002
[29] Rebecca Wirfs-Brock,Alan McKean著.倪硕,陈师译.对象设计.北京:人民邮电出版社,2006
[30] Jason T. Roff.张瑜,杨继萍等译.UML基础教程.北京:清华大学出版社,2004
[31] Craig Larman.姚淑珍,李虎等译.UML和模式应用.北京:机械出版社,2002
[32]冯士筰,李凤歧,李少青著.海洋科学导论.北京:高等教育出版社,1999
[33]中国海洋信息网.http://www.coi.gov.cn/
[34]国家海洋局.http://www.soa.gov.cn/hyjww/index.htm
[35]邱岩.组件技术及其分析比较.计算机工程与应用,2003
[36]叶向东,陈国生.构建“数字海洋”实施海陆统筹.太平洋学报,2007
[37]王亚明,郭峰,向阳霞.软件复用技术及其开发方法.北京广播电视大学学报,2007
[38]焦金丹,胡金柱等.基于软件复用的领域分析和建模研究.微电子学与计算机,2006
[39] Riordan, Rebecca M. Designing Effective Database Systems. Addison-Wesley Professional. 2005
[40] K. Mori, H. Ihara, Y. Suzuki, K. Kawano, M. Koizumi, M. Orimo, K. Nakai, H. Nakanishi.Autonomous decentralized software structure and its application.Proc. FJCC, pp., Dallas, TX, 1986: 1056–1063
[41] Cheung KH, Nadkarni PM, Shin DG. A metadata approach to query interoperation between molecular biology databases. Yale University School of Medicine, 1998
[42] Sungwon Jung, Stephen Perkins, Yang Zhong, Sakti Pramanik, John Beaman. A new data model for biological classification. Comput. Appl. Biosci. 1995:11: 237 - 246
[43] E. Bazin, L. Duret, S. Penel, and N. Galtier. Polymorphix: a sequence polymorphism database. Nucleic Acids Res., 2005:33(suppl_1): D481 - D484
[44] Jung-Ho Ahn , Hyoung-Joo Kim. Dynamic SEOF: An Adaptable Object Prefetch Policy for Object-oriented Database Systems. Seoul National University, 1998
[45] G. Weiss. Multiagent System: A Modern Approach to Distributed Artificial Intelligence. MIT Press, 1999
[46] F. S. Zahran. A universal data model holder for data dictionary systems. The Computer Journal, 1981
[47] I. Ahmed. Towards the next level of abstraction, the autonomous decentralized system—An overview. Stud. Inf. Control. 2004. Vol.13 (no.4): 295–304
[48] Ghosh D, Locker J. In Transcription Factors: Essential Data. J Wiley and Sons, Chichester UK. 1996:82-104.
[49] F. F. Land. Evaluation of systems goals in determining a design strategy for a computer based information system. The Computer Journal, 1976: 19: 290 - 294
[50] K.G. Kulkarni, M.P. Atkinson. EFDM: Extended Functional Data Model. The ComputerJournal, 1986:29: 38 - 46
[51] N.A. Duffie, R. Chitturi, and J. Mou. Fault-tolerant hierarchical control of heterogeneous manufacturing system entities. J. Manufacturing Systems. 1988. Vol.7 (no.4):315–328
[52] L. Zhao, S.A. Roberts. An Object-Oriented Data Model for Database Modelling Implementation and Access. The Computer Journal. 1988. 31: 116 - 124
[53] P. Remagnino, A.I Shihab, G.A Jones. Distributed intelligence for a multi-agent visual surveillance. Pattern Recognit. 2004. Vol.37 (no.4): 675–689
[54] Dong-Guk Shin, Changhwan Lee, Jinghui Zhang, Kenneth E. Rudd, Claire M. Berg. Redesigning, implementing and integrating Escherichia coli genome software tools with an object-oriented database system. University of Connecticut. 1992
[55] T. D. Kimura, W. D. Gillett, and J. R. Cox. A Design of a Data Model Based on Abstraction of Symbols. The Computer Journal. 1985. 28: 298– 308