网络化工业组态软件实时数据库研究与实现
|
摘要
实时数据库是网络化测控系统的核心软件之一,其在自动控制、通信、电力、证券交易等行业都有着广泛的应用市场,但国内的实时数据库目前没有商业化产品,实时数据库一般作为应用系统的一部分,国外的实时数据库价格昂贵,一般用户消费不起,而网络化测控技术是近几年刚刚兴起的一门新兴的测控技术,对实时数据库又提出了新的要求。为此,研究开发一种适合网络化测控的实时数据库就显得格外的重要和必要。论文围绕网络化工业组态软件实时数据库进行了研究和开发,主要的研究工作如下:
1.论述了国内外实时数据库研究现状,在深入分析其原理与结构的基础上,结合网络化测控自身特点,设计了一种适合网络化工业组态软件的实时数据库体系结构;
2.研究了实时数据库的物理数据组织以及索引技术,分析了顺序索引、Hash索引、B树索引、AVL树索引、T树索引,并进行了性能比较,通过比较选择T树作为索引结构;
3.在研究实时事务调度和并发控制的基础之上,得出了同时考虑实时事务和数据截止期的调度机制;详细论述和讨论了两段锁和乐观并发控制机制,并对两种机制进行了比较,提出了一种新的并发控制算法:区分只读事务(单独处理只读事务)算法即SA算法,通过实验得出,SA算法在只读事务占主导地位的系统中,可以很好的改善系统的并发控制性能;
4.基于μC /OS?ΙΙ实现了实时数据库系统,并实现了一种网络化测控系统。具体实现方法是在μC /OS?ΙΙ上移植uC/FS文件系统,采用μIP作为TCP/IP通信协议,构建了Web服务器实现与客户端的实时通信;同时,在客户端开发了相应的监控组态软件,以保证对实时数据的现场监控。
本文设计开发的网络化组态软件实时数据库已在实验室的网络化测控系统中得到了应用。通过实验表明,本文设计的组态软件实时数据库系统是可行的,这为实时数据库系统的应用又提供了一种工程实现方案。
Real-time database is one of the core software in networked measure and control system, it has widely used market in automatic control、communication、electric power、stock trading and so on, but the domestic real-time database has no commercial products at present, real-time database usually used as one part of application systems, the foreign real-time database is so much expensive that the general users can’t afford it, however, networked measure and control technology is a new measure and control technology which has come up for only few years, it poses a new require to the real-time database. So research and develop real-time database systems which is adapt to networked measure and control is very important and necessary. This thesis is mainly about the research and development of Real-Time database of supervisory control and data acquisition configuration software, main research works are as follow:
First: Discussed the internal and external real-time database research situation, on the base of deep analyze, integrate with characteristic of the networked measure and control, and engage networked industrial supervisory control and data acquisition configuration software and real-time research and design;
Second:Research the physical data organization and the index technology of the real-time database, analysis sequence index、Hash index、B-Tree index、T-Tree index, and with the comparance of the common indexes each other, choose the T-Tree as index structure;
Third: On the based of research of the real-time transaction schedule and concurrency control, give out a schedule mechanism which consider the deadline of transaction and data simultaneously; detail elaborate and discussion 2PL and OCC concurrency control mechanism, and compared the two mechanisms, raised a new concurrency control algorithm: distinguish read only transactions (separate handle read only transactions) algorithm, that is, SA algorithm, by means of experiment concludes that SA algorithm in the systems which read only transactions predominant, can improve the concurrency control performance;
Forth: Based on theμC /OS?ΙΙrealized the real-time system, and at the same time realized the networked measure and control system. The detailed realized methods are: transplant the uC/FS to theμC /OS?ΙΙ,usingμIP as the TCP/IP communication protocol , construct the Web server to reallize the real-time communication to the client; and develop supervisory control and data acquisition configurat ion software in the client to real-time supervisory control industrial spot.
The networked supervisory control and data acquisition configurat ion software with real-time database has been applied in our networked measure and control laboratory. The experiment shows that the design of networked supervisory control and data acquisition configurat ion software with real-time database in this thesis is feasible, so this provides another engeneering realization method of the application of the real-time database.
1.论述了国内外实时数据库研究现状,在深入分析其原理与结构的基础上,结合网络化测控自身特点,设计了一种适合网络化工业组态软件的实时数据库体系结构;
2.研究了实时数据库的物理数据组织以及索引技术,分析了顺序索引、Hash索引、B树索引、AVL树索引、T树索引,并进行了性能比较,通过比较选择T树作为索引结构;
3.在研究实时事务调度和并发控制的基础之上,得出了同时考虑实时事务和数据截止期的调度机制;详细论述和讨论了两段锁和乐观并发控制机制,并对两种机制进行了比较,提出了一种新的并发控制算法:区分只读事务(单独处理只读事务)算法即SA算法,通过实验得出,SA算法在只读事务占主导地位的系统中,可以很好的改善系统的并发控制性能;
4.基于μC /OS?ΙΙ实现了实时数据库系统,并实现了一种网络化测控系统。具体实现方法是在μC /OS?ΙΙ上移植uC/FS文件系统,采用μIP作为TCP/IP通信协议,构建了Web服务器实现与客户端的实时通信;同时,在客户端开发了相应的监控组态软件,以保证对实时数据的现场监控。
本文设计开发的网络化组态软件实时数据库已在实验室的网络化测控系统中得到了应用。通过实验表明,本文设计的组态软件实时数据库系统是可行的,这为实时数据库系统的应用又提供了一种工程实现方案。
Real-time database is one of the core software in networked measure and control system, it has widely used market in automatic control、communication、electric power、stock trading and so on, but the domestic real-time database has no commercial products at present, real-time database usually used as one part of application systems, the foreign real-time database is so much expensive that the general users can’t afford it, however, networked measure and control technology is a new measure and control technology which has come up for only few years, it poses a new require to the real-time database. So research and develop real-time database systems which is adapt to networked measure and control is very important and necessary. This thesis is mainly about the research and development of Real-Time database of supervisory control and data acquisition configuration software, main research works are as follow:
First: Discussed the internal and external real-time database research situation, on the base of deep analyze, integrate with characteristic of the networked measure and control, and engage networked industrial supervisory control and data acquisition configuration software and real-time research and design;
Second:Research the physical data organization and the index technology of the real-time database, analysis sequence index、Hash index、B-Tree index、T-Tree index, and with the comparance of the common indexes each other, choose the T-Tree as index structure;
Third: On the based of research of the real-time transaction schedule and concurrency control, give out a schedule mechanism which consider the deadline of transaction and data simultaneously; detail elaborate and discussion 2PL and OCC concurrency control mechanism, and compared the two mechanisms, raised a new concurrency control algorithm: distinguish read only transactions (separate handle read only transactions) algorithm, that is, SA algorithm, by means of experiment concludes that SA algorithm in the systems which read only transactions predominant, can improve the concurrency control performance;
Forth: Based on theμC /OS?ΙΙrealized the real-time system, and at the same time realized the networked measure and control system. The detailed realized methods are: transplant the uC/FS to theμC /OS?ΙΙ,usingμIP as the TCP/IP communication protocol , construct the Web server to reallize the real-time communication to the client; and develop supervisory control and data acquisition configurat ion software in the client to real-time supervisory control industrial spot.
The networked supervisory control and data acquisition configurat ion software with real-time database has been applied in our networked measure and control laboratory. The experiment shows that the design of networked supervisory control and data acquisition configurat ion software with real-time database in this thesis is feasible, so this provides another engeneering realization method of the application of the real-time database.
引文
[1]刘云生.现代数据库技术[M].北京:国防工业出版社,2001.3
[2]张志檀.实时数据库原理及应用[M].北京:中国石化出版社,2001.9
[3]马国华.监控组态软件及其应用[M].北京:清华大学出版社,2004.3
[4]刘云生.实时数据库系统[J].计算机科学,1994,21(3):42-46
[5] Piotr Krzyzagorski.http://www.edbt2000.uni-konstanz.de/phd-workshop/papers/Krzyzagorski
[6] K.Ramamritham.Real-Time Databases, Internatioanal Journal of Distributed and Parallel Databases, February, 1996
[7]吴健.实时数据库概述[J].测控技术,1999,18(9):7-10
[8]刘云生,卢炎生,王道忠.实时数据库系统(RTDBS)及其特征[J].华中理工大学学报,1994,22(6):66-70
[9]何鹏举,陈明,段磊强等.基于嵌入式Web服务器的远程视频监控系统[J].测控技术,2004,23(6):62-63
[10]刘云生,易岚,余利平.一个实时数据模型[J].小型微型计算机系统,2000,21(5):549-522
[11]张河.组态实时数据库索引机制的研究与实现[硕士论文].长沙:中南大学,2008
[12]薛竹飙.实时内存数据库关键技术的研究与实现:[硕士论文].南京:东南大学.2006
[13]何煜.组态软件实时数据库的研究[硕士论文].天津:天津大学,2004
[14]傅磊,戴冠中.基于以太网的异构网络化控制系统设计[J].计算机测量与控制,2005,13(11):1253-1256
[15]谷国栋.内存数据库相关技术的研究与分析[J].电脑知识与技术,2007.9,5-6
[16]刘云生,吴绍春,李国徽等.一种实时内存数据库组织与管理方法[J].计算机研究与发展,1998,35(5):469-473
[17]吴少春,程世旭,张心怡.实时数据特征与数据的安置及交换策略[J].江汉石油学院学报,1999,21(2):44-46
[18]王洪海,潘朝华.内存数据库的数据结构分析[J].现代电力电子技术,2004:96-98
[19]武波.实时内存数据库的设计与实现[硕士论文].杭州:浙江大学,2005
[20]严蔚敏,吴伟民.数据结构(C语言版)[M].北京:清华大学出版社,2002
[21] Luo WenBin.Hashing via Finite Field [J].Information Sciences, 2006, 176(17):2553-2566
[22]周伟明.多任务下的数据结构与算法[M].武汉:华中科技大学出版社,2006
[23]袁培森.内存数据库的设计与实现[硕士论文].南京:南京航空航天大学.2006
[24] Tobin J.Lehman, Michael J.Carey.A study of Index Structures for Main Memory Database Management Systems, Proceedings of the Twelfth International Conference on very Large Data Bases,Kyoto,August,1986:294-303
[25]王珊,萨师煊.数据库系统概论[M].北京:高等教育出版社,2006
[26]夏家莉.嵌入式实时数据库系统的事务模型及其处理技术[M].北京:经济管理出版社,2004
[27]邵佩英,张坤龙译.数据库系统基础[M].北京:人民邮电出版社,2002
[28] Jeffrey D.Unman and Jennifer Widom.A first course in database systems. Upper Saddle River, N.J: Prentice Hall: c1997.25-26
[29]葛俊杰.实时内存数据库的事务调度与数据恢复研究:[硕士论文].青岛:青岛大学,2007
[30]刘云生、李国徽.实时数据库数据特征对事务处理的影响[J].计算机研究与发展,1999,36(8):364-368
[31]陈传波、王桦.实时数据库的事务调度研究[J].计算机应用,2005,25(9):2004-2006
[32]韩凯、王京春.实时数据库调度策略综述[J].计算机工程与应用,2004,32:172-176
[33] Kuo T,Mok A K,SSP:A semantics-based protocol for real-time data access. In: IEEE Proc of the Real-Time Systems Symposium. North Carolina, 1993 76-86
[34]王珊,肖艳芹,刘大为等.内存数据库关键技术研究[J].计算机应用,2007,27(10):2353-2357
[35]王永炎.实时事务并发控制算法优化[博士论文].北京:中国科学院软件研究所,2004
[36] ABBOTT R,CARLIA-MOLNA H.Scheduling Real-time transactions A performance evaluations on Database Systems[J].ACM Transactions on Database Systems 1992,513-558
[37]王能斌.数据库系统原理[M].北京:电子工业出版社,2000
[38]祁鑫、王文海.实时数据库系统并发控制机制综述[J].计算机技术,2006,33(1):47-50
[39] C.M.Krishna, Kang G.Shin.Real-time Systems [M].Beijing: Tsinghua University Press, 2002
[40] R.Abbott and H.Garcia-Molia.Scheduling Real-time Transactions: A Performance Evaluation.ACM Transaction on Database Systems, 17(3):513-560, 1992
[41]罗琼,张立臣.实时数据库的并发控制算法[J].计算机应用研究,2005,8(39):39-42
[42] J.R.Haritsa, M.J.Carey, and M.Livny.Dynamic Real-time Optimistic Concurrency Control. Proceedings of the IEEE Real-Time Systems Symposium, 94-103, December 1990
[43] J.Lee.Concurrency Control Algorithms for Real-Time Database Systems. PhD thesis. Faculty of the School of Engineering and Applied Science, University of Virginia, January 1994
[44] J.R.Harisa, M.J.Carey and M.Livny. Data Access Scheduling in Firm Real-Time Database Systems. Journal of Real-Time Systems, 4:203-241, 1992
[45] J.R.Harisa, M.J.Carey and M.Livny.Dynamic Real-Time Optimistic Concurrency Control. Proceedings of 11th Real-Time Systems Symposium, 1990b:94-103
[46]李国徽,刘云生.实时数据库并发控制[J].小型微型计算机系统,2001,22(12):1501-1503
[47] H.Garcia-Molina, G.Wiederhold.Read-only Transactions in a distributed database.ACM Transactions on Database Systems 1982, 7(2):209-234
[48] T.W.Kuo, Y.T.Kao, L.shu, A two-version approach for real-time concurrency control and recovery, Procceeding of the Third IEEE International High Assurance Systems Engineering Symposium,1998
[49]傅磊,戴冠中.网络化控制系统的研究综述[J].计算机工程与应用,2005.25:221-225
[50]何鹏举,戴冠中.嵌入式Web网络传感器的实时数据采集方法[J].传感器技术学报,2006,19(6):2743-2745
[51]何鹏举,戴冠中.分布式远程网络化智能测控系统研究[J].微电子学与计算机,2007,24(8):177-179
[52]何鹏举,戴冠中,傅磊等.远程网络化测控系统研究与实现[J] .微电子学与计算机,2006,23(7):196-202
[53] JEAN J.LABROSSE著.邵贝贝译.μC/OS-II—源码公开的实时嵌入式操作系统[M].北京:中国电力出版社,2001
[54]陈是知.μC/OS-II内核分析、移植与驱动程序开发[M].北京:人民邮电出版社,2007
[55] Micrium Technoliogies Corporation.uC/FS User & Reference manual.www.micrium.com
[56] AdamDunkels.TheμIP Embeded TCP/IP Stack Reference Manual. www.sics.se
[57]鄢化彪.远程网络化测控系统设计与研究[硕士论文].赣州:江西理工大学,2005
[58]赵宁.嵌入式Web网络传感器软件系统的研究与设计[硕士论文].西安:西北工业大学,2005
[59]贺涛.C++Builder网络编程[M].北京:清华大学出版社,2002
[60]杨宗志.C++Builder数据库程序设计[M].北京:清华大学出版社,2004
[2]张志檀.实时数据库原理及应用[M].北京:中国石化出版社,2001.9
[3]马国华.监控组态软件及其应用[M].北京:清华大学出版社,2004.3
[4]刘云生.实时数据库系统[J].计算机科学,1994,21(3):42-46
[5] Piotr Krzyzagorski.http://www.edbt2000.uni-konstanz.de/phd-workshop/papers/Krzyzagorski
[6] K.Ramamritham.Real-Time Databases, Internatioanal Journal of Distributed and Parallel Databases, February, 1996
[7]吴健.实时数据库概述[J].测控技术,1999,18(9):7-10
[8]刘云生,卢炎生,王道忠.实时数据库系统(RTDBS)及其特征[J].华中理工大学学报,1994,22(6):66-70
[9]何鹏举,陈明,段磊强等.基于嵌入式Web服务器的远程视频监控系统[J].测控技术,2004,23(6):62-63
[10]刘云生,易岚,余利平.一个实时数据模型[J].小型微型计算机系统,2000,21(5):549-522
[11]张河.组态实时数据库索引机制的研究与实现[硕士论文].长沙:中南大学,2008
[12]薛竹飙.实时内存数据库关键技术的研究与实现:[硕士论文].南京:东南大学.2006
[13]何煜.组态软件实时数据库的研究[硕士论文].天津:天津大学,2004
[14]傅磊,戴冠中.基于以太网的异构网络化控制系统设计[J].计算机测量与控制,2005,13(11):1253-1256
[15]谷国栋.内存数据库相关技术的研究与分析[J].电脑知识与技术,2007.9,5-6
[16]刘云生,吴绍春,李国徽等.一种实时内存数据库组织与管理方法[J].计算机研究与发展,1998,35(5):469-473
[17]吴少春,程世旭,张心怡.实时数据特征与数据的安置及交换策略[J].江汉石油学院学报,1999,21(2):44-46
[18]王洪海,潘朝华.内存数据库的数据结构分析[J].现代电力电子技术,2004:96-98
[19]武波.实时内存数据库的设计与实现[硕士论文].杭州:浙江大学,2005
[20]严蔚敏,吴伟民.数据结构(C语言版)[M].北京:清华大学出版社,2002
[21] Luo WenBin.Hashing via Finite Field [J].Information Sciences, 2006, 176(17):2553-2566
[22]周伟明.多任务下的数据结构与算法[M].武汉:华中科技大学出版社,2006
[23]袁培森.内存数据库的设计与实现[硕士论文].南京:南京航空航天大学.2006
[24] Tobin J.Lehman, Michael J.Carey.A study of Index Structures for Main Memory Database Management Systems, Proceedings of the Twelfth International Conference on very Large Data Bases,Kyoto,August,1986:294-303
[25]王珊,萨师煊.数据库系统概论[M].北京:高等教育出版社,2006
[26]夏家莉.嵌入式实时数据库系统的事务模型及其处理技术[M].北京:经济管理出版社,2004
[27]邵佩英,张坤龙译.数据库系统基础[M].北京:人民邮电出版社,2002
[28] Jeffrey D.Unman and Jennifer Widom.A first course in database systems. Upper Saddle River, N.J: Prentice Hall: c1997.25-26
[29]葛俊杰.实时内存数据库的事务调度与数据恢复研究:[硕士论文].青岛:青岛大学,2007
[30]刘云生、李国徽.实时数据库数据特征对事务处理的影响[J].计算机研究与发展,1999,36(8):364-368
[31]陈传波、王桦.实时数据库的事务调度研究[J].计算机应用,2005,25(9):2004-2006
[32]韩凯、王京春.实时数据库调度策略综述[J].计算机工程与应用,2004,32:172-176
[33] Kuo T,Mok A K,SSP:A semantics-based protocol for real-time data access. In: IEEE Proc of the Real-Time Systems Symposium. North Carolina, 1993 76-86
[34]王珊,肖艳芹,刘大为等.内存数据库关键技术研究[J].计算机应用,2007,27(10):2353-2357
[35]王永炎.实时事务并发控制算法优化[博士论文].北京:中国科学院软件研究所,2004
[36] ABBOTT R,CARLIA-MOLNA H.Scheduling Real-time transactions A performance evaluations on Database Systems[J].ACM Transactions on Database Systems 1992,513-558
[37]王能斌.数据库系统原理[M].北京:电子工业出版社,2000
[38]祁鑫、王文海.实时数据库系统并发控制机制综述[J].计算机技术,2006,33(1):47-50
[39] C.M.Krishna, Kang G.Shin.Real-time Systems [M].Beijing: Tsinghua University Press, 2002
[40] R.Abbott and H.Garcia-Molia.Scheduling Real-time Transactions: A Performance Evaluation.ACM Transaction on Database Systems, 17(3):513-560, 1992
[41]罗琼,张立臣.实时数据库的并发控制算法[J].计算机应用研究,2005,8(39):39-42
[42] J.R.Haritsa, M.J.Carey, and M.Livny.Dynamic Real-time Optimistic Concurrency Control. Proceedings of the IEEE Real-Time Systems Symposium, 94-103, December 1990
[43] J.Lee.Concurrency Control Algorithms for Real-Time Database Systems. PhD thesis. Faculty of the School of Engineering and Applied Science, University of Virginia, January 1994
[44] J.R.Harisa, M.J.Carey and M.Livny. Data Access Scheduling in Firm Real-Time Database Systems. Journal of Real-Time Systems, 4:203-241, 1992
[45] J.R.Harisa, M.J.Carey and M.Livny.Dynamic Real-Time Optimistic Concurrency Control. Proceedings of 11th Real-Time Systems Symposium, 1990b:94-103
[46]李国徽,刘云生.实时数据库并发控制[J].小型微型计算机系统,2001,22(12):1501-1503
[47] H.Garcia-Molina, G.Wiederhold.Read-only Transactions in a distributed database.ACM Transactions on Database Systems 1982, 7(2):209-234
[48] T.W.Kuo, Y.T.Kao, L.shu, A two-version approach for real-time concurrency control and recovery, Procceeding of the Third IEEE International High Assurance Systems Engineering Symposium,1998
[49]傅磊,戴冠中.网络化控制系统的研究综述[J].计算机工程与应用,2005.25:221-225
[50]何鹏举,戴冠中.嵌入式Web网络传感器的实时数据采集方法[J].传感器技术学报,2006,19(6):2743-2745
[51]何鹏举,戴冠中.分布式远程网络化智能测控系统研究[J].微电子学与计算机,2007,24(8):177-179
[52]何鹏举,戴冠中,傅磊等.远程网络化测控系统研究与实现[J] .微电子学与计算机,2006,23(7):196-202
[53] JEAN J.LABROSSE著.邵贝贝译.μC/OS-II—源码公开的实时嵌入式操作系统[M].北京:中国电力出版社,2001
[54]陈是知.μC/OS-II内核分析、移植与驱动程序开发[M].北京:人民邮电出版社,2007
[55] Micrium Technoliogies Corporation.uC/FS User & Reference manual.www.micrium.com
[56] AdamDunkels.TheμIP Embeded TCP/IP Stack Reference Manual. www.sics.se
[57]鄢化彪.远程网络化测控系统设计与研究[硕士论文].赣州:江西理工大学,2005
[58]赵宁.嵌入式Web网络传感器软件系统的研究与设计[硕士论文].西安:西北工业大学,2005
[59]贺涛.C++Builder网络编程[M].北京:清华大学出版社,2002
[60]杨宗志.C++Builder数据库程序设计[M].北京:清华大学出版社,2004