微型数据库引擎的研究
摘要
数据库技术是信息系统的核心和基础,它的出现极大的促进了计算机应用向各行各业的渗透。数据库技术的出现正是为了满足人们对管理庞大的信息资源并加以有效的利用的需求。对于仿真系统而言,如何对海量仿真数据进行有效的存储和读取是仿真系统中一个重要的方面,它直接影响到仿真系统的性能和应用面。目前的一些商业数据库虽然实现的功能很强大,但是往往与系统平台结合比较紧密,并且封装也比较麻烦,这就限制了仿真系统的应用面。因此,为了满足仿真平台的应用需求,开发出一套与平台无关的数据库引擎具有很重要的意义。
本文根据仿真系统的应用需求来设计数据库系统,最主要的是实现跨平台和运行时的系统开销,使得数据库系统在任何平台下都能够运行。基于这个思想的指导下,设计并实现了一个通用的可以运行于不同操作系统平台的基于文件系统的小型数据库系统。
本文的主要工作包括对数据库系统特点及发展趋势进行分析,并完成了数据库管理系统的体系结构设计及数据的组织结构设计,对数据库系统的索引结构进行了讨论和研究,在文件的格式设计上则采用UTF-8的形式来编码。
本文从编译原理入手,在研究编译过程及相关知识的基础上,研究了数据库查询语言SQL从底层数据结构到上层语法分析的实现过程。在对SQL语言解释时使用LEX和Lemon工具软件。
在虚拟机的解释器模块设计中借鉴了Java虚拟机的思想,使用栈式的设计方法简单并快速地实现解释器,并对虚拟机实现的关键技术进行了探讨和研究,并分析了虚拟机执行SQL语言的步骤。
本文针对用户对查询效率要求较高的特点,引进了SQL预处理器,对预处理器的功能进行了描述,同时也对容易出现的SQL语句错误进行了定义,以及对SQL语言实现的几个重要方面做了论述。
本文在数据安全性和共享方面引进了锁机制来保证事务的可串行性调度。采用Socket实现了简单的网络通信,同时对用户的标识与鉴别进行了探讨。
Database technology is the core and base of the information system and it greatly advances the penetration of computer technology into other disciplines.The presence of database technology intends to satisfy the people's needs to manage the abundant information resources and to make good use of them.In regards to simulation system,how to store and read the simulation data effectively is of great significance due to the huge volume of the data to be managed,and it can directly affect the performance and application of the simulation system.At present,there are meny Database have powerful function,But a Database more closely integrated with the platform and the encapsulation is comparatively inconvenient,which limits the application range of simulation systems.Therefore,the development of a micro-database engine to meet specific applications of simulation platform becomes significative.
This paper designs database system according to the requirement of the application of the simulation system,and ensure its cross-platform operation.A platform independent,file system based minitype database system was implemented based on this idea.
The main job of this article includes the analysis of the characteristics and developmental tendency,the design of the distributed and organized structure,the specified discussion and exploration of the structure index,and on the format design of the document using UTF-8 to code.
This article is based on the Principle of compiler.After considered the process and theories of the complier,the article realized a basic structure used in DBMS and a SQL syntax analyzer as well,and explain the SQL language using software of the LEX and the Lemon.
The thought of Java virtual machine has profited in the virtual machine interpreter Module design.The stack design method can help to implement the interpretor fast and easily,and the key technique in implementing the virtual machine is discussed and explored,and analyzed the step of the performance of SQL language with virtual Machine.
This article aims at the request of the customer to have search with a higher efficiency,so indraught a preprocessor of SQL,carrying on a description to the function of the preprocessor,and the common mistakes of the SQL sentences were defined.Meanwhile,the key aspects of implementing the SQL language were discussed.
For security and share of the data,the lock scheme technique was employed to ensure the serializability of the events.Socket technology was used to achieve simple network communication.The identification and discrimination of the user was also discussed.
本文根据仿真系统的应用需求来设计数据库系统,最主要的是实现跨平台和运行时的系统开销,使得数据库系统在任何平台下都能够运行。基于这个思想的指导下,设计并实现了一个通用的可以运行于不同操作系统平台的基于文件系统的小型数据库系统。
本文的主要工作包括对数据库系统特点及发展趋势进行分析,并完成了数据库管理系统的体系结构设计及数据的组织结构设计,对数据库系统的索引结构进行了讨论和研究,在文件的格式设计上则采用UTF-8的形式来编码。
本文从编译原理入手,在研究编译过程及相关知识的基础上,研究了数据库查询语言SQL从底层数据结构到上层语法分析的实现过程。在对SQL语言解释时使用LEX和Lemon工具软件。
在虚拟机的解释器模块设计中借鉴了Java虚拟机的思想,使用栈式的设计方法简单并快速地实现解释器,并对虚拟机实现的关键技术进行了探讨和研究,并分析了虚拟机执行SQL语言的步骤。
本文针对用户对查询效率要求较高的特点,引进了SQL预处理器,对预处理器的功能进行了描述,同时也对容易出现的SQL语句错误进行了定义,以及对SQL语言实现的几个重要方面做了论述。
本文在数据安全性和共享方面引进了锁机制来保证事务的可串行性调度。采用Socket实现了简单的网络通信,同时对用户的标识与鉴别进行了探讨。
Database technology is the core and base of the information system and it greatly advances the penetration of computer technology into other disciplines.The presence of database technology intends to satisfy the people's needs to manage the abundant information resources and to make good use of them.In regards to simulation system,how to store and read the simulation data effectively is of great significance due to the huge volume of the data to be managed,and it can directly affect the performance and application of the simulation system.At present,there are meny Database have powerful function,But a Database more closely integrated with the platform and the encapsulation is comparatively inconvenient,which limits the application range of simulation systems.Therefore,the development of a micro-database engine to meet specific applications of simulation platform becomes significative.
This paper designs database system according to the requirement of the application of the simulation system,and ensure its cross-platform operation.A platform independent,file system based minitype database system was implemented based on this idea.
The main job of this article includes the analysis of the characteristics and developmental tendency,the design of the distributed and organized structure,the specified discussion and exploration of the structure index,and on the format design of the document using UTF-8 to code.
This article is based on the Principle of compiler.After considered the process and theories of the complier,the article realized a basic structure used in DBMS and a SQL syntax analyzer as well,and explain the SQL language using software of the LEX and the Lemon.
The thought of Java virtual machine has profited in the virtual machine interpreter Module design.The stack design method can help to implement the interpretor fast and easily,and the key technique in implementing the virtual machine is discussed and explored,and analyzed the step of the performance of SQL language with virtual Machine.
This article aims at the request of the customer to have search with a higher efficiency,so indraught a preprocessor of SQL,carrying on a description to the function of the preprocessor,and the common mistakes of the SQL sentences were defined.Meanwhile,the key aspects of implementing the SQL language were discussed.
For security and share of the data,the lock scheme technique was employed to ensure the serializability of the events.Socket technology was used to achieve simple network communication.The identification and discrimination of the user was also discussed.
引文
[1]Stonebrkaer,M.andJ.M.Hellerstem,Readings in Datbase Systems,Morgan Kuamfallll,1998
[2]J.D.Ullman and J.Widom,A First Course in Database Systems,Prentice-Hall,Englewood Cliffs NJ.1997
[3]Heetor Graeia-Molina,Jeffery D.Ullman,Jennifer Widom:《数据库系统全书》[M].机械工业出版.2003
[4]R.G.G.Cattell,Object Data Management,Addison-Wesley,Reading MA,1994
[5]John Toigo,The Holy Grail of Data Storage Management.Prentice Hall,2000
[6]李丽霞,微型数据库引擎的研究.[硕士毕业论文].2006
[7]http://www.utf-8.com/
[8]邹乐天.内存数据库索引技术研究[J].电脑与信息技术,2007,(15)30-32
[9]Kim S Larsen,Rolf Fagerberg.B-Trees with Relaxed Balance.Proceedings of the 9~(th)International Conference on Parallel Processing Symposium,1995
[10]王萍.B-树的性能分析及其在数据搜索中的应用[J].浙江海洋学院学报(自然科学版),2005.24(1):80-82
[11]Kim S Larsen,Rolf Fagerberg.B-Trees with Relaxed Balance.Proceedings of the 9 th International Conference on Parallel Processing.SymPosium,1995:196-202
[12]乐晓波,吴晓红.一种提B-树存贮利用率的有效算法[J].微电子学与计算机,1994.8:30-32
[13]姚卿达,杨桂祯,张俊欣.RFN-B+树索引文件及其有效性[J].软件学报,1998,9(11):25-27
[14]胡九龙,赵捧未.数据检索中索引技术研究.科技情报开发与经济.2004.14(1):210-211
[15]J.T.Robinson,The KD-Btree:a search structure for large multidimensional dynamic indexes,Proc.ACM SIGMOD intl.conf.on Management of Data,1981,pp:507-518
[16]D.E.Knuth,The Art of Computer Programming,Vol.Ⅲ,Sorting and Searching,Third Edtion,Addison-Wesley,Reading MA,1998
[17]S.Arya,D.M.Mount,N.S.Netanyahu,R.Silverman,and A.Y.Wu,An Optimal Algorithm for Approximate Nearest Neighbor Searching in Fixed Dimensions[J].J.Assoc.Comput.Mach.45,No6.1998:891-923
[18]萨师煊,王珊.数据库系统概论(第三版).北京:高等教育出版社,2002
[19]Levine,J.R.等著,杨作梅等译.Lex与Yaee(第二版)[M].机械工业出版社,2003年1月第1版.122-163
[20]蒋立源.《编译原理》[M].西北工业大学出版社.1993
[21]金成植.编译程序构造原理和实现技术,北京:高等教育出版社,2000
[22]Aho,Alrfed V,Ravi Sehti,and Jerffey D.Ullman.ComPilers:principles,Techniques and Tools.Addison-Wesley.1986
[23]K.C.Louden.编译原理及实践.第1版.冯博琴.北京:机械工业出版社,1997.412-450
[24]Joe Celko.SQL for Smarties:Advanced SQL Programming.Morgan Kaufmann,2000
[25]Raghu Ramakrishnan,Johannes Gehrke.Database Management System,(2rid Edition)[M].北京:清华大学出版社,2002
[26]王振辉,吴广茂.SQL查询语句优化研究[J].计算机应用,2005,(12):207-209
[27]王晓东,曹庆华,王卓.DBZ数据库查询优化策略[J].现代电子技术,2006,(10):92-95
[28]谷震离.关系数据库查询优化方法研究[J].微计算机信息,2006,(22):161-164
[29]马琳,罗铁坚,宋进壳.一种基于Web的虚拟机[J].计算机工程,2005(5):127-128
[30]E.Miranda.BrouHaHa-A Portable Smalltalk Interpreter.ACM SIGPLAN Notices,1987,22(12):354-365
[31]BillVenners著,曹晓钢,蒋靖译.深入JAVA虚拟机,Second Edition机械工业出版社,2003
[32]王立冬,张凯.Java虚拟机分析.北京理工大学学报,2002,22(1):60-63
[33]探矽工作室著.深入嵌入式Java虚拟机[M].北京:中国铁道出版社,2003
[34]BillBlunden著,杨晓杨晓云王建桥张玉厅译,虚拟机的设计与实现一C/C++,机械工业出版社,2002
[35]嵌入式数据库系统查询机制研究与实现.[硕士毕业论文].2005
[36]H.F.Korth,"Locking primitives in a database system,"J.ACM 30:1(1983),pp.55-79
[37]严蔚敏,吴伟民.“数据结构(C语言版)”.清华大学出版社,1996
[38]K.P.Eswaran,J.N.Gray,R.A.Lorie,and I.L.Traiger,"The notions of consistency and predicate locks in a database system",Comm.ACM 19:11(1976),pp.624-633
[39]A.Thompson,"Concurrency control:methods,performance,and analysis",Computing Surveys 30:1(1998),pp.170-231
[40]Raghu Ramakfihnan,Johannes Gehrke."Database management systems",MCGraw-Hill,2000
[41]DOUGLAS E.COMER,DAVID L.STEVENS(著),赵刚,林瑶,蒋慧等(译).用TCP/进行网际互联第三卷:客户-服务器编程与应用(LINUX/POSIX套接字版),北京:电子工业出版社,2001
[42]魏传瑾,李清宝,白燕.网络终端信息交换安全机制研究与实现[J].微计算机信息,2005.21(5):224-225
[43]清宏计算机工作室.Visual C++编程技巧(网络与数据库篇).北京:机械工业出版社.2001.134-267
[2]J.D.Ullman and J.Widom,A First Course in Database Systems,Prentice-Hall,Englewood Cliffs NJ.1997
[3]Heetor Graeia-Molina,Jeffery D.Ullman,Jennifer Widom:《数据库系统全书》[M].机械工业出版.2003
[4]R.G.G.Cattell,Object Data Management,Addison-Wesley,Reading MA,1994
[5]John Toigo,The Holy Grail of Data Storage Management.Prentice Hall,2000
[6]李丽霞,微型数据库引擎的研究.[硕士毕业论文].2006
[7]http://www.utf-8.com/
[8]邹乐天.内存数据库索引技术研究[J].电脑与信息技术,2007,(15)30-32
[9]Kim S Larsen,Rolf Fagerberg.B-Trees with Relaxed Balance.Proceedings of the 9~(th)International Conference on Parallel Processing Symposium,1995
[10]王萍.B-树的性能分析及其在数据搜索中的应用[J].浙江海洋学院学报(自然科学版),2005.24(1):80-82
[11]Kim S Larsen,Rolf Fagerberg.B-Trees with Relaxed Balance.Proceedings of the 9 th International Conference on Parallel Processing.SymPosium,1995:196-202
[12]乐晓波,吴晓红.一种提B-树存贮利用率的有效算法[J].微电子学与计算机,1994.8:30-32
[13]姚卿达,杨桂祯,张俊欣.RFN-B+树索引文件及其有效性[J].软件学报,1998,9(11):25-27
[14]胡九龙,赵捧未.数据检索中索引技术研究.科技情报开发与经济.2004.14(1):210-211
[15]J.T.Robinson,The KD-Btree:a search structure for large multidimensional dynamic indexes,Proc.ACM SIGMOD intl.conf.on Management of Data,1981,pp:507-518
[16]D.E.Knuth,The Art of Computer Programming,Vol.Ⅲ,Sorting and Searching,Third Edtion,Addison-Wesley,Reading MA,1998
[17]S.Arya,D.M.Mount,N.S.Netanyahu,R.Silverman,and A.Y.Wu,An Optimal Algorithm for Approximate Nearest Neighbor Searching in Fixed Dimensions[J].J.Assoc.Comput.Mach.45,No6.1998:891-923
[18]萨师煊,王珊.数据库系统概论(第三版).北京:高等教育出版社,2002
[19]Levine,J.R.等著,杨作梅等译.Lex与Yaee(第二版)[M].机械工业出版社,2003年1月第1版.122-163
[20]蒋立源.《编译原理》[M].西北工业大学出版社.1993
[21]金成植.编译程序构造原理和实现技术,北京:高等教育出版社,2000
[22]Aho,Alrfed V,Ravi Sehti,and Jerffey D.Ullman.ComPilers:principles,Techniques and Tools.Addison-Wesley.1986
[23]K.C.Louden.编译原理及实践.第1版.冯博琴.北京:机械工业出版社,1997.412-450
[24]Joe Celko.SQL for Smarties:Advanced SQL Programming.Morgan Kaufmann,2000
[25]Raghu Ramakrishnan,Johannes Gehrke.Database Management System,(2rid Edition)[M].北京:清华大学出版社,2002
[26]王振辉,吴广茂.SQL查询语句优化研究[J].计算机应用,2005,(12):207-209
[27]王晓东,曹庆华,王卓.DBZ数据库查询优化策略[J].现代电子技术,2006,(10):92-95
[28]谷震离.关系数据库查询优化方法研究[J].微计算机信息,2006,(22):161-164
[29]马琳,罗铁坚,宋进壳.一种基于Web的虚拟机[J].计算机工程,2005(5):127-128
[30]E.Miranda.BrouHaHa-A Portable Smalltalk Interpreter.ACM SIGPLAN Notices,1987,22(12):354-365
[31]BillVenners著,曹晓钢,蒋靖译.深入JAVA虚拟机,Second Edition机械工业出版社,2003
[32]王立冬,张凯.Java虚拟机分析.北京理工大学学报,2002,22(1):60-63
[33]探矽工作室著.深入嵌入式Java虚拟机[M].北京:中国铁道出版社,2003
[34]BillBlunden著,杨晓杨晓云王建桥张玉厅译,虚拟机的设计与实现一C/C++,机械工业出版社,2002
[35]嵌入式数据库系统查询机制研究与实现.[硕士毕业论文].2005
[36]H.F.Korth,"Locking primitives in a database system,"J.ACM 30:1(1983),pp.55-79
[37]严蔚敏,吴伟民.“数据结构(C语言版)”.清华大学出版社,1996
[38]K.P.Eswaran,J.N.Gray,R.A.Lorie,and I.L.Traiger,"The notions of consistency and predicate locks in a database system",Comm.ACM 19:11(1976),pp.624-633
[39]A.Thompson,"Concurrency control:methods,performance,and analysis",Computing Surveys 30:1(1998),pp.170-231
[40]Raghu Ramakfihnan,Johannes Gehrke."Database management systems",MCGraw-Hill,2000
[41]DOUGLAS E.COMER,DAVID L.STEVENS(著),赵刚,林瑶,蒋慧等(译).用TCP/进行网际互联第三卷:客户-服务器编程与应用(LINUX/POSIX套接字版),北京:电子工业出版社,2001
[42]魏传瑾,李清宝,白燕.网络终端信息交换安全机制研究与实现[J].微计算机信息,2005.21(5):224-225
[43]清宏计算机工作室.Visual C++编程技巧(网络与数据库篇).北京:机械工业出版社.2001.134-267