空间数据库性能调整与优化
|
摘要
随着数据库技术在生产、生活和社会各个层面日益广泛的应用和推广,对数据库管理系统管理数据的能力和效率的要求也越来越高。在现有软硬件资源基础上,如何充分发挥数据库管理系统潜能、全面优化并提升应用型数据库操作效能不仅可以节约系统运行成本,而且能够保障数据库的安全、稳定和效率。事实上,效能调整与优化已成为数据库,特别是空间数据库应用研究的重要课题。
本文以汾渭盆地地裂缝地面沉降灾害空间数据库建设为例,借鉴现有数据库性能调整与优化研究成果,结合建库实际,将空间数据库存储优化、Oracle 10g内存参数和安全参数调整、地图服务发布等作为主要研究内容,以期通过实验研究找到提高空间数据库性能调整与优化的一般策略和方法。据此,本文取得如下研究成果：
1、对于矢量数据,采用要素类的数据组织形式直接存储在SDE Geodatabase模型中以减少Oracle数据库存储空间。对于栅格数据,根据其不同数据类型特点,设置入库时各自的数据压缩方法和压缩率、数据重采样和金字塔级数等参数,确定数字高程模型采用栅格数据集,数字正射影像采用栅格目录表的数据组织形式。
2、利用Oracle自带的性能优化与监测工具,根据内存参数活动统计信息,参照相关性能评价指标,适时调整与优化系统全局区和程序全局区参数。同时,调整空间数据库系统安全性参数,启用空间数据库归档模式以保障该空间数据库的安全、稳定和效率。
3、利用ArcGIS Server将地图文档发布为两类地图服务：一类是缓存地图服务,主要是将地图服务转化为PNG或JPEG数据类型的同时设置瓦片级数,对每级栅格数据进行切片并将其保存在服务器的缓存路径下以加速数据显示；一类是动态地图服务,主要是根据各图层多级比例尺显示范围设置以增强地图显示效果。两者均为WebGIS调用地图提供URL地址,避免访问后台空间数据库。
With the database technology widespread application in the production, life and all levels of society, it puts forward higher requirements to manage data on the capacity and efficiency by database management system. Based on the existing hardware and software resources, how to make the potential of database management system, fully optimize and enhance the operational effectiveness of the application database, can not only save operating costs, but also protect the database'security, stability and efficiency. In fact, performance tuning and optimization has become an important research subject in database, especially in spatial database applications.
Taking the ground fissures and land subsidence disaster spatial database in Fen-wei Basin as the research object, referencing the existing research results in the database performance optimization and adjustment, and combined with the actual situation of the database construction, the paper will take space database storage optimization, Oracle lOg memory and safety parameters adjustment, map service issued as the main research contents, in order to find the general adjustment and optimization strategy and method to improve space database performance. Accordingly, the paper made the research results:
Firstly, in order to reduce Oracle storage space, vector data as the feature class directly stored in the SDE Geodatabase model. According to different raster data types, Digital Elevation Model stored in raster dataset, and Digital Orthophoto Model stored in raster catalog after setting compression method and compression ratio, data re-sampling and pyramids series parameters.
Secondly, using Oracle own performance optimization and monitoring tools, according to the statistical information of the memory parameters'activities, and referencing certain performance evaluation index, we timely adjust and optimize the system global area and program global area parameters. Meanwhile, we also adjust space database system security parameters, opening space database archivelog model to safeguard the spatial database' security, stability and efficiency.
Thirdly, map document are issued for two kinds of maps service by Using the ArcGIS Server:one kind is cache maps service. When change map service into PNG or JPEG data types, set tile levels, and then slice the grid data according to each tile level, storing in the Server's cache path to accelerate data shows; One kind is dynamic map service. It mainly enhances map display effect by setting each layer multistage scale display range. Both of them provide URL for WebGIS using map services, avoiding access spatial database backstage.
本文以汾渭盆地地裂缝地面沉降灾害空间数据库建设为例,借鉴现有数据库性能调整与优化研究成果,结合建库实际,将空间数据库存储优化、Oracle 10g内存参数和安全参数调整、地图服务发布等作为主要研究内容,以期通过实验研究找到提高空间数据库性能调整与优化的一般策略和方法。据此,本文取得如下研究成果：
1、对于矢量数据,采用要素类的数据组织形式直接存储在SDE Geodatabase模型中以减少Oracle数据库存储空间。对于栅格数据,根据其不同数据类型特点,设置入库时各自的数据压缩方法和压缩率、数据重采样和金字塔级数等参数,确定数字高程模型采用栅格数据集,数字正射影像采用栅格目录表的数据组织形式。
2、利用Oracle自带的性能优化与监测工具,根据内存参数活动统计信息,参照相关性能评价指标,适时调整与优化系统全局区和程序全局区参数。同时,调整空间数据库系统安全性参数,启用空间数据库归档模式以保障该空间数据库的安全、稳定和效率。
3、利用ArcGIS Server将地图文档发布为两类地图服务：一类是缓存地图服务,主要是将地图服务转化为PNG或JPEG数据类型的同时设置瓦片级数,对每级栅格数据进行切片并将其保存在服务器的缓存路径下以加速数据显示；一类是动态地图服务,主要是根据各图层多级比例尺显示范围设置以增强地图显示效果。两者均为WebGIS调用地图提供URL地址,避免访问后台空间数据库。
With the database technology widespread application in the production, life and all levels of society, it puts forward higher requirements to manage data on the capacity and efficiency by database management system. Based on the existing hardware and software resources, how to make the potential of database management system, fully optimize and enhance the operational effectiveness of the application database, can not only save operating costs, but also protect the database'security, stability and efficiency. In fact, performance tuning and optimization has become an important research subject in database, especially in spatial database applications.
Taking the ground fissures and land subsidence disaster spatial database in Fen-wei Basin as the research object, referencing the existing research results in the database performance optimization and adjustment, and combined with the actual situation of the database construction, the paper will take space database storage optimization, Oracle lOg memory and safety parameters adjustment, map service issued as the main research contents, in order to find the general adjustment and optimization strategy and method to improve space database performance. Accordingly, the paper made the research results:
Firstly, in order to reduce Oracle storage space, vector data as the feature class directly stored in the SDE Geodatabase model. According to different raster data types, Digital Elevation Model stored in raster dataset, and Digital Orthophoto Model stored in raster catalog after setting compression method and compression ratio, data re-sampling and pyramids series parameters.
Secondly, using Oracle own performance optimization and monitoring tools, according to the statistical information of the memory parameters'activities, and referencing certain performance evaluation index, we timely adjust and optimize the system global area and program global area parameters. Meanwhile, we also adjust space database system security parameters, opening space database archivelog model to safeguard the spatial database' security, stability and efficiency.
Thirdly, map document are issued for two kinds of maps service by Using the ArcGIS Server:one kind is cache maps service. When change map service into PNG or JPEG data types, set tile levels, and then slice the grid data according to each tile level, storing in the Server's cache path to accelerate data shows; One kind is dynamic map service. It mainly enhances map display effect by setting each layer multistage scale display range. Both of them provide URL for WebGIS using map services, avoiding access spatial database backstage.
引文
[1]崔静,卫敏丽.中国首次发布综合自然灾害风险“警示图”[EB/OL]. http://ww.mep.gov.cn/zhxx/hjyw/201105/t20110512_210577.htm,2011-05-12/05-13
[2]杨军,李瑞军.3S技术在地质灾害监测中的应用[J].科技信息,2008(33)
[3]冯会玲.2010年地质灾害损失60年来最重国土系统痛定思痛[EB/OL]. http://finance.jrj.com.cn/2010/11/0611478502264.shtml,2010-11-06/2011-05-13
[4]贺秀全.山西省地面沉降与地裂缝调查报告[R].山西：山西省地质环境监测中心,2009
[5]Edward Whalen. SQL Server 2000性能调整技术指南[M].武欣,何畅,罗云峰等译.北京：机械工业出版社,2002
[6]Robert Bellman, Irene Grief. Database Performance Optimization and Business Communications Review[M]. Capacity Planning,1997
[7]Steve Adrien DeLuca. Microsoft SQL Server 7'性能优化[M].蒋蕊,王炎,王磊等译.北京：机械工业出版社,2000
[8]冯登国.计算机通信网络安全[M].北京：清华大学出版社,2001：56-66
[9]邹俊.基于Oracle数据库系统性能调整与优化研究[D].南昌：江西财经大学,2006
[10]孙莹,刘红星.综述地质灾害数据库网络发布机制[J].科技在线,2008,33
[11]李斌.地裂缝地面沉降灾害管理信息系统开发及应用研究[D].西安：长安大学,2009
[12]郭敏,郭靖.Oracle lOg数据库性能优化的研究[J].武汉理工大学学报,2005,27(10)
[13]马妮.ArcSDE for Oracle lOg内存调优实践[A].www.cehuiwang.com GIS论文
[14]刘俊明,孙培基,朱德海.基于Oracle的林业应用影响数据库设计方案探讨[J].林业科学,2006,42(1)
[15]邓雪请,张永生,李波等.基于Oracle 9i Spatial的海量空间影像数据管理[J].测绘学院学报,2003,20(2)
[16]张永生,巩凡超,刘军等.高分辨率遥感卫星应用——成像模型、处理方法及应用技术[M].北京：科学出版社,2004
[17]王兴玲.Oracle 10g影像数据库的设计及应用模式分析[J].遥感技术与应用,2006,21 (5)
[18]陶冶宇,马东洋,徐青等.基于Oracle多分辨率遥感影像数据库的设计[J].测绘学院学报,2005,22(2)
[19]邢超,李斌.ArcGIS学习指南——ArcToolboox[M].北京：科学出版社,2010.09
[20]孙风栋,闫海珍.Oracle lOg数据库性能优化与调整[J].计算技术与发展,2009,19(2)
[21]魏亚楠,宋义秋.Oracle数据库应用系统的性能优化[J].制造业自动化,2010,32(8)
[22]王辉.Oracle数据库的性能调整与优化——以中日合作项目林火监测系统为应用实例[J].林业资源管理,2003,12(6)
[23]何正国,杜娟.ArcGIS Server开发从入门到精通[M].北京：人民邮电出版社,2010.06
[24]陈明,罗德安.基于ArcGIS Server的校园WEBGIS系统的设计与实现[J].测绘,2008,31(6)
[25]李欣,罗琦,李春华Oracle数据库性能的优化设计[J].郑州大学学报(理学版),2007,39(3)
[26]黄登山,陈大克,葛峰等.基于Oracle lOg Spatial的栅格数据存储、管理及关键技术[J].桂林工学院学报,2005,25(3)
[27]肖若辉.JPEG2000与JPEG的区别及其实践应用[J].电脑开发与应用,2009,2(9)
[28]戴小平.Oracle 9i数据库性能调整与优化[J].安徽工业大学学报,2006,23(3)
[29]王晓春,赵霁,张岩. Windows平台上的Oracle数据库的系统性能优化[J].石油工业计算机应用,2003,11(4)
[30]王祖亮,郭勇.空间数据库的性能优化探讨[J].测绘技术装备,2010,12(1)
[31]马妮,李维功. Arcsde for Oracle优化实践[J].测绘通报,2007,10
[32]刘博.Oracle数据库性能调整与优化[D].大连：大连理工大学,2007
[33]宋海平.大型应用系统中数据库性能优化的研究[D].武汉：武汉理工大学,2007
[34]ESRI中国(北京)培训中心ArcGIS轻松入门教程——ArcGIS Server[Z].ESRI中国(北京)有限公司,2008,03
[35]David Simmen, Eugene Shekita, Timothy Malkemus. Fundamental Techniques for Oracle Optimization[M].ACM,1996
[2]杨军,李瑞军.3S技术在地质灾害监测中的应用[J].科技信息,2008(33)
[3]冯会玲.2010年地质灾害损失60年来最重国土系统痛定思痛[EB/OL]. http://finance.jrj.com.cn/2010/11/0611478502264.shtml,2010-11-06/2011-05-13
[4]贺秀全.山西省地面沉降与地裂缝调查报告[R].山西：山西省地质环境监测中心,2009
[5]Edward Whalen. SQL Server 2000性能调整技术指南[M].武欣,何畅,罗云峰等译.北京：机械工业出版社,2002
[6]Robert Bellman, Irene Grief. Database Performance Optimization and Business Communications Review[M]. Capacity Planning,1997
[7]Steve Adrien DeLuca. Microsoft SQL Server 7'性能优化[M].蒋蕊,王炎,王磊等译.北京：机械工业出版社,2000
[8]冯登国.计算机通信网络安全[M].北京：清华大学出版社,2001：56-66
[9]邹俊.基于Oracle数据库系统性能调整与优化研究[D].南昌：江西财经大学,2006
[10]孙莹,刘红星.综述地质灾害数据库网络发布机制[J].科技在线,2008,33
[11]李斌.地裂缝地面沉降灾害管理信息系统开发及应用研究[D].西安：长安大学,2009
[12]郭敏,郭靖.Oracle lOg数据库性能优化的研究[J].武汉理工大学学报,2005,27(10)
[13]马妮.ArcSDE for Oracle lOg内存调优实践[A].www.cehuiwang.com GIS论文
[14]刘俊明,孙培基,朱德海.基于Oracle的林业应用影响数据库设计方案探讨[J].林业科学,2006,42(1)
[15]邓雪请,张永生,李波等.基于Oracle 9i Spatial的海量空间影像数据管理[J].测绘学院学报,2003,20(2)
[16]张永生,巩凡超,刘军等.高分辨率遥感卫星应用——成像模型、处理方法及应用技术[M].北京：科学出版社,2004
[17]王兴玲.Oracle 10g影像数据库的设计及应用模式分析[J].遥感技术与应用,2006,21 (5)
[18]陶冶宇,马东洋,徐青等.基于Oracle多分辨率遥感影像数据库的设计[J].测绘学院学报,2005,22(2)
[19]邢超,李斌.ArcGIS学习指南——ArcToolboox[M].北京：科学出版社,2010.09
[20]孙风栋,闫海珍.Oracle lOg数据库性能优化与调整[J].计算技术与发展,2009,19(2)
[21]魏亚楠,宋义秋.Oracle数据库应用系统的性能优化[J].制造业自动化,2010,32(8)
[22]王辉.Oracle数据库的性能调整与优化——以中日合作项目林火监测系统为应用实例[J].林业资源管理,2003,12(6)
[23]何正国,杜娟.ArcGIS Server开发从入门到精通[M].北京：人民邮电出版社,2010.06
[24]陈明,罗德安.基于ArcGIS Server的校园WEBGIS系统的设计与实现[J].测绘,2008,31(6)
[25]李欣,罗琦,李春华Oracle数据库性能的优化设计[J].郑州大学学报(理学版),2007,39(3)
[26]黄登山,陈大克,葛峰等.基于Oracle lOg Spatial的栅格数据存储、管理及关键技术[J].桂林工学院学报,2005,25(3)
[27]肖若辉.JPEG2000与JPEG的区别及其实践应用[J].电脑开发与应用,2009,2(9)
[28]戴小平.Oracle 9i数据库性能调整与优化[J].安徽工业大学学报,2006,23(3)
[29]王晓春,赵霁,张岩. Windows平台上的Oracle数据库的系统性能优化[J].石油工业计算机应用,2003,11(4)
[30]王祖亮,郭勇.空间数据库的性能优化探讨[J].测绘技术装备,2010,12(1)
[31]马妮,李维功. Arcsde for Oracle优化实践[J].测绘通报,2007,10
[32]刘博.Oracle数据库性能调整与优化[D].大连：大连理工大学,2007
[33]宋海平.大型应用系统中数据库性能优化的研究[D].武汉：武汉理工大学,2007
[34]ESRI中国(北京)培训中心ArcGIS轻松入门教程——ArcGIS Server[Z].ESRI中国(北京)有限公司,2008,03
[35]David Simmen, Eugene Shekita, Timothy Malkemus. Fundamental Techniques for Oracle Optimization[M].ACM,1996