文物遗址环境监测数据服务系统设计与开发
|
摘要
文物遗址是人类文化传承的重要形式,具有重要的历史、科学和艺术价值,对其加以保护意义深远。文物遗址容易受到微气象环境如温度、湿度、某些气体浓度等的影响,因此对文物遗址的环境进行监测是文物保护的重要辅助手段。目前文物遗址环境监测技术,多采用通用的环境监测数据处理系统,不能有效地对文物遗址环境监测数据进行管理和展示。此外,这些通用的环境监测软件存在只适用于专业用户、数据利用率不高、数据共享不充分等缺点。
本论文提出了一个文物遗址环境监测数据服务系统,作为文物遗址环境监测系统的一个重要组成部分,实现了对环境监测数据,人流量数据、网络管理数据的实时解析、自动处理、可靠存储和综合展示。
文物遗址环境监测数据服务系统包括数据采集服务、基于Web的综合展示服务两个子系统。数据采集服务系统与环境监测数据汇集终端通讯,解析汇聚终端传送的数据,同时,针对综合展示系统的实际需要,对数据进行误差修正、极值统计等预处理,将解析和处理结果存入数据库中。为防止因网络拥塞、供电故障、数据库故障等导致的数据丢失,设计可靠的通讯协议与汇聚终端通讯;为实现监测数据类型可灵活变化和系统的可扩展性,设计规范可扩展的数据包协议和数据解析DLL接口;为保证系统的稳定性,设计WatchDog监测程序,对数据采集服务进行监视,做到出现故障时自动恢复。在基于Web的综合展示系统中,针对不同用户提供不同的展示形式:对于环境监测专业人员,一方面设计实时数据显示,以便文物遗址部门能针对监测数据做出及时的保护决策;另一方面提供历史数据查询,以便环境监测人员进行数据统计和分析;同时提供系统拓扑图和运行情况监测,以便更好地进行系统维护。对于普通游客,以大屏幕形式实时展示整个文物遗址环境状况的监测结果,以达到宣传文物保护的作用。此外,考虑到环境监测系统数据量庞大,可能达到几千万条记录,并且每天可能递增几十万条到几百万条,利用中间表,水平分割表等数据库优化技术和Web缓存技术,使展示系统既能满足环境监测系统实时性的要求,又做到界面友好。
本文对文物遗址环境监测数据服务器进行了实际测试,如数据采集服务系统可靠性、数据解析处理效率、以及数据量庞大时,综合展示系统页面的响应速度等。实践证明,本系统达到了预定的目标。此外,本系统还在敦煌莫高窟进行了实际安装和实施,反馈良好。
Culture heritage, as a form of the continuation of human civilization, is of important historical, scientific and artistic value, and should be properly protected. Generally speaking, culture heritages are subject to some micro-weather conditions, such as temperature, humidity, the concentration of certain gases. So monitoring environment in culture heritages is an important supplementary means of heritages conservation. At present, most environmental monitoring technologies of culture heritage adopt generic environmental monitoring data processing software, which can not manage and display data effectively. These systems have much shortcoming, such as they apply only to professional users, the data is not efficiently utilized and difficult shared.
This paper presents an environmental monitoring data service system for culture heritage. As an important part of the environmental monitoring for culture heritage, it can real-time analysis, automated process and comprehensive display the environmental monitoring data, people flow data and network management data.
The whole system includes a data gathering server and a Web-based comprehensive display service system. The data gathering service system communicates with the data convergence terminal in environmental monitoring system, analysis the data sent from the terminals, and processes data in order to meet the need of comprehensive display system, then deposited the results to the database. In order to prevent data loss, which may be caused by network congestion, power failure, database failures or others, a reliable protocol to communication with data convergence terminal is designed. Meanwhile, scalable agreements of data packets and data analysis DLL interface are designed so as to make monitoring data types can be changed flexibly and the system can be extended conveniently. Besides, to ensure the stability of the system, WatchDog procedure is developed, which is to monitor the data gathering server, automatically restore the server when it failed. In the comprehensive display service system, we design different display forms for different users. For environmental monitoring professionals, not only real-time data show is designed, so the cultural heritage departments can make timely decisions for conservation. But also historical data query is provided for data statistics and analysis. Besides, system topology and performance monitoring are also provided in order to maintenance system easily. For ordinary tourists, we use large screen displayers to show monitoring results of culture heritage environments for heritage conservation propaganda. In addition, taking into the huge amount of data in environmental monitoring system, the middle table, partition table and other related database technologies and Web cache technology are used to optimize system performance, which makes the display service system not only meet the requirement of real-time for environmental monitoring system, but also be friendly interface.
Finally, we test the data service system for environmental monitoring in cultural heritage, including the reliability of data gathering server, the efficiency of data analysis and processing, and the page response latency in comprehensive system when there are a large amount of data. Testing results prove that the system achieved the desired goal. In addition, the system were also actual installed and used in Dunhuang Mogao Grottoes, and received well feedback.
本论文提出了一个文物遗址环境监测数据服务系统,作为文物遗址环境监测系统的一个重要组成部分,实现了对环境监测数据,人流量数据、网络管理数据的实时解析、自动处理、可靠存储和综合展示。
文物遗址环境监测数据服务系统包括数据采集服务、基于Web的综合展示服务两个子系统。数据采集服务系统与环境监测数据汇集终端通讯,解析汇聚终端传送的数据,同时,针对综合展示系统的实际需要,对数据进行误差修正、极值统计等预处理,将解析和处理结果存入数据库中。为防止因网络拥塞、供电故障、数据库故障等导致的数据丢失,设计可靠的通讯协议与汇聚终端通讯;为实现监测数据类型可灵活变化和系统的可扩展性,设计规范可扩展的数据包协议和数据解析DLL接口;为保证系统的稳定性,设计WatchDog监测程序,对数据采集服务进行监视,做到出现故障时自动恢复。在基于Web的综合展示系统中,针对不同用户提供不同的展示形式:对于环境监测专业人员,一方面设计实时数据显示,以便文物遗址部门能针对监测数据做出及时的保护决策;另一方面提供历史数据查询,以便环境监测人员进行数据统计和分析;同时提供系统拓扑图和运行情况监测,以便更好地进行系统维护。对于普通游客,以大屏幕形式实时展示整个文物遗址环境状况的监测结果,以达到宣传文物保护的作用。此外,考虑到环境监测系统数据量庞大,可能达到几千万条记录,并且每天可能递增几十万条到几百万条,利用中间表,水平分割表等数据库优化技术和Web缓存技术,使展示系统既能满足环境监测系统实时性的要求,又做到界面友好。
本文对文物遗址环境监测数据服务器进行了实际测试,如数据采集服务系统可靠性、数据解析处理效率、以及数据量庞大时,综合展示系统页面的响应速度等。实践证明,本系统达到了预定的目标。此外,本系统还在敦煌莫高窟进行了实际安装和实施,反馈良好。
Culture heritage, as a form of the continuation of human civilization, is of important historical, scientific and artistic value, and should be properly protected. Generally speaking, culture heritages are subject to some micro-weather conditions, such as temperature, humidity, the concentration of certain gases. So monitoring environment in culture heritages is an important supplementary means of heritages conservation. At present, most environmental monitoring technologies of culture heritage adopt generic environmental monitoring data processing software, which can not manage and display data effectively. These systems have much shortcoming, such as they apply only to professional users, the data is not efficiently utilized and difficult shared.
This paper presents an environmental monitoring data service system for culture heritage. As an important part of the environmental monitoring for culture heritage, it can real-time analysis, automated process and comprehensive display the environmental monitoring data, people flow data and network management data.
The whole system includes a data gathering server and a Web-based comprehensive display service system. The data gathering service system communicates with the data convergence terminal in environmental monitoring system, analysis the data sent from the terminals, and processes data in order to meet the need of comprehensive display system, then deposited the results to the database. In order to prevent data loss, which may be caused by network congestion, power failure, database failures or others, a reliable protocol to communication with data convergence terminal is designed. Meanwhile, scalable agreements of data packets and data analysis DLL interface are designed so as to make monitoring data types can be changed flexibly and the system can be extended conveniently. Besides, to ensure the stability of the system, WatchDog procedure is developed, which is to monitor the data gathering server, automatically restore the server when it failed. In the comprehensive display service system, we design different display forms for different users. For environmental monitoring professionals, not only real-time data show is designed, so the cultural heritage departments can make timely decisions for conservation. But also historical data query is provided for data statistics and analysis. Besides, system topology and performance monitoring are also provided in order to maintenance system easily. For ordinary tourists, we use large screen displayers to show monitoring results of culture heritage environments for heritage conservation propaganda. In addition, taking into the huge amount of data in environmental monitoring system, the middle table, partition table and other related database technologies and Web cache technology are used to optimize system performance, which makes the display service system not only meet the requirement of real-time for environmental monitoring system, but also be friendly interface.
Finally, we test the data service system for environmental monitoring in cultural heritage, including the reliability of data gathering server, the efficiency of data analysis and processing, and the page response latency in comprehensive system when there are a large amount of data. Testing results prove that the system achieved the desired goal. In addition, the system were also actual installed and used in Dunhuang Mogao Grottoes, and received well feedback.
引文
[1]陶世安.让石窟艺术宝库祛病延年http://culture.people.com.cn/GB/70658/70889/4848857.html
[2]杨洪泽,文朝阳,艾江波.环境监测站水质监测数据库应用系统研究[J].铁路劳动安全与环保.2000,27(4):260-262.
[3]王合生.环境监测信息化建设分析--走中国式环境监测信息化建设道路.环境监测管理与技术,2006,第18卷第5期:1-2.
[4]吴明华.地表水源热泵在重庆地区的工程应用研究.硕士学位论文,重庆大学,2007.
[5]文新宇,黄萍,谭亚翎,邓志强等.环境监测数据管理系统简介--以湖南省为例.环境监测.2006,第25卷第2期:54-55.
[6]罗华君.环境数据管理系统在环境监测中的应用[J].云南环境科学.2001,20(1):55-58.
[7]吴萍.利用缓存技术对教学培训系统的性能优化.硕士学位论文.东华大学,2006.
[8]彭利云,利用缓存技术提高WEB应用程序的效率.萍乡高等专科学校学报.2005,第4期:69-70.
[9]艾志国,刘萍,涂亚平.基于Web应用程序中的数据缓存技术初探.计算机与信息科技.2006,81-82.
[10]ASP.NET2.0缓存技术简介http://www.xker.com/edu/dev/102/06615110247993.html
[11]Joshua Eichom深入理解AJAX--基于JavaScript的RIA开发[M].陈宗恒,徐锋译.人民邮电出版社,2006:112-140.
[12]王时绘,陈志雄,朱荣利.ASP.NET AJAX在Web开发中的应用.计算机与信息科技.2006,48-49.
[13]谭建平.Web网站系统性能优化研究及其应用.硕士学位论文.重庆大学,2007
[14]Jesse James Carr.Ajax:A New Approach to Web Applications[EB/OL].http://adaptivepath.com/publications/essays/archives/000385.php
[15]黄云.基于AJAX的四川省防灾减灾综合信息系统的设计与实现.硕士学位论 文.电子科技大学,2007
[16]水晶报表--最彻底的本土化.http://e.chinabyte.com/100/2091600.shtml
[17]张庆文.林业电子政务系统管理决策分析数据环境建立研究.硕士学位论文.北京林业大学,2006.
[18]统计图近代件netCharting和ZedGraph的比较http://www.cnblogs.com/yqy542006/archive/2008/03/13/1103724.html
[19]孙吉赟,方明,顾燕伟.多维数据图形显示中ZedGraph控件的应用.电脑开发与应用.2008,第21卷第3期:55-56.
[20].NET控件ZedGraph使用帮助http://www.cnblogs.com/Endink/archive/2006/01/11/315612.aspx
[21]W.Richard Stevens.UNIX网络编程第一卷:套接口API(第三版).施振川译.29-30.
[22]刘小俊,涂春霞.VB和VC混合编程技术应用实例.计算机控制、监控与管理.2006,第6期:78-79.
[23]林乐杰.科研管理信息系统中数据库的设计与实现.硕士学位论文..北京化工大学,2006.
[24]尹永顺.MS SQLServer中大量数据表的查询优化.计算机系统应用.2005,第2期:79-81.
[25]数据库优化设计方案http://database.csdn.net/page/db6443cc-732a-48bb-a223-49858f6cca95.
[26]赵亮,基于Web平台的工作流管理系统的改进研究.硕士学位论文.西安电子科技大学,2007.
[27]王安莉.基于Web的医院信息系统.硕士学位论文.中南大学,2007.
[28]陈小奎.井下人员定位管理系统数据库设计及优化.能源技术与管理,2007,第6期:133-134.
[29]曾帆.基于WebGIS空间数据发布服务的研究与应用.硕士学位论文.山东科技大学,2007.
[30]于雅丽.基于对象池与数据缓存技术的Web-OLAP系统.硕士学位论文.南京航空航天大学,2007.
[31]杨宏伟,华艳辉.关于页面对客户端分辨率自适应策略的研究.商场现代化2007,第493期:104-105.
[32]李俊奎,王元珍.可重写循环滑动窗口:面向高效的在线数据流处理.计算机科学.2007,Vol.34-12.
[2]杨洪泽,文朝阳,艾江波.环境监测站水质监测数据库应用系统研究[J].铁路劳动安全与环保.2000,27(4):260-262.
[3]王合生.环境监测信息化建设分析--走中国式环境监测信息化建设道路.环境监测管理与技术,2006,第18卷第5期:1-2.
[4]吴明华.地表水源热泵在重庆地区的工程应用研究.硕士学位论文,重庆大学,2007.
[5]文新宇,黄萍,谭亚翎,邓志强等.环境监测数据管理系统简介--以湖南省为例.环境监测.2006,第25卷第2期:54-55.
[6]罗华君.环境数据管理系统在环境监测中的应用[J].云南环境科学.2001,20(1):55-58.
[7]吴萍.利用缓存技术对教学培训系统的性能优化.硕士学位论文.东华大学,2006.
[8]彭利云,利用缓存技术提高WEB应用程序的效率.萍乡高等专科学校学报.2005,第4期:69-70.
[9]艾志国,刘萍,涂亚平.基于Web应用程序中的数据缓存技术初探.计算机与信息科技.2006,81-82.
[10]ASP.NET2.0缓存技术简介http://www.xker.com/edu/dev/102/06615110247993.html
[11]Joshua Eichom深入理解AJAX--基于JavaScript的RIA开发[M].陈宗恒,徐锋译.人民邮电出版社,2006:112-140.
[12]王时绘,陈志雄,朱荣利.ASP.NET AJAX在Web开发中的应用.计算机与信息科技.2006,48-49.
[13]谭建平.Web网站系统性能优化研究及其应用.硕士学位论文.重庆大学,2007
[14]Jesse James Carr.Ajax:A New Approach to Web Applications[EB/OL].http://adaptivepath.com/publications/essays/archives/000385.php
[15]黄云.基于AJAX的四川省防灾减灾综合信息系统的设计与实现.硕士学位论 文.电子科技大学,2007
[16]水晶报表--最彻底的本土化.http://e.chinabyte.com/100/2091600.shtml
[17]张庆文.林业电子政务系统管理决策分析数据环境建立研究.硕士学位论文.北京林业大学,2006.
[18]统计图近代件netCharting和ZedGraph的比较http://www.cnblogs.com/yqy542006/archive/2008/03/13/1103724.html
[19]孙吉赟,方明,顾燕伟.多维数据图形显示中ZedGraph控件的应用.电脑开发与应用.2008,第21卷第3期:55-56.
[20].NET控件ZedGraph使用帮助http://www.cnblogs.com/Endink/archive/2006/01/11/315612.aspx
[21]W.Richard Stevens.UNIX网络编程第一卷:套接口API(第三版).施振川译.29-30.
[22]刘小俊,涂春霞.VB和VC混合编程技术应用实例.计算机控制、监控与管理.2006,第6期:78-79.
[23]林乐杰.科研管理信息系统中数据库的设计与实现.硕士学位论文..北京化工大学,2006.
[24]尹永顺.MS SQLServer中大量数据表的查询优化.计算机系统应用.2005,第2期:79-81.
[25]数据库优化设计方案http://database.csdn.net/page/db6443cc-732a-48bb-a223-49858f6cca95.
[26]赵亮,基于Web平台的工作流管理系统的改进研究.硕士学位论文.西安电子科技大学,2007.
[27]王安莉.基于Web的医院信息系统.硕士学位论文.中南大学,2007.
[28]陈小奎.井下人员定位管理系统数据库设计及优化.能源技术与管理,2007,第6期:133-134.
[29]曾帆.基于WebGIS空间数据发布服务的研究与应用.硕士学位论文.山东科技大学,2007.
[30]于雅丽.基于对象池与数据缓存技术的Web-OLAP系统.硕士学位论文.南京航空航天大学,2007.
[31]杨宏伟,华艳辉.关于页面对客户端分辨率自适应策略的研究.商场现代化2007,第493期:104-105.
[32]李俊奎,王元珍.可重写循环滑动窗口:面向高效的在线数据流处理.计算机科学.2007,Vol.34-12.