DEMETER卫星数据格式解析与数据入库效率研究
|
摘要
该文旨在解译DEMETER卫星载荷的二进制数据格式,并实现海量电磁数据导入ORACLE数据库的入库技术,为高效分析卫星数据和研究地震-电磁效应奠定基础。考虑到海量数据入库耗时太长,因此基于入库效率提出了3种不同的数据入库方法,并采用C和OO4O(Oracle Objects for OLE)接口编程实现。从入库耗时和后续科学分析的便利性对3种入库方法的效率进行比较和分析,采用最优方案建立了Demeter卫星数据库,为后期基于Oracle的高效数据读取和分析提供了技术依据。
DEMETER(Detection of Electro-Magnetic Emissions Transmitted from Earthquake Regions)is a micro-satellite,intending to collect electromagnetic data for promoting the research on seismic-electromagnetic effects.In this paper,the binary data structure of sixteen payloads on DEMETER was analyzed in detail and the optimal database structure for constructing huge-volume database in Oracle was proposed,and this study established the base for doing research on seismic-electromagnetic effects efficiently.Considering the vast time consumed in the data-into-database process,the authors developed three algorithms for uncompressing tar files of DEMETER data and inserting them into database,and programmed them based on C and OO4O.Then their performances and efficiency were well compared and analyzed in terms of the time consumed and the convenience of data analysis,and the optimal algorithm was found out.Finally the database for DEMETER was set up,providing technical base for reading data from Oracle database and doing data mining on huge-volume electro-magnetic data efficiently in future.
DEMETER(Detection of Electro-Magnetic Emissions Transmitted from Earthquake Regions)is a micro-satellite,intending to collect electromagnetic data for promoting the research on seismic-electromagnetic effects.In this paper,the binary data structure of sixteen payloads on DEMETER was analyzed in detail and the optimal database structure for constructing huge-volume database in Oracle was proposed,and this study established the base for doing research on seismic-electromagnetic effects efficiently.Considering the vast time consumed in the data-into-database process,the authors developed three algorithms for uncompressing tar files of DEMETER data and inserting them into database,and programmed them based on C and OO4O.Then their performances and efficiency were well compared and analyzed in terms of the time consumed and the convenience of data analysis,and the optimal algorithm was found out.Finally the database for DEMETER was set up,providing technical base for reading data from Oracle database and doing data mining on huge-volume electro-magnetic data efficiently in future.
引文
[1]PARROT M.The micro-satellite DEMETER[J].Geodynam-ics,2002(33):535-541.
[2]朱荣,杨冬梅,荆凤,等.DEMETER卫星观测到的云南普洱地震前的电离层扰动[J].地震学报,2008(1):76-81.
[3]LAGOUTTE D,BROCHOT J Y,CARVALHO D,et al.DE-METER Microsatellite Scientific Mission Center Data ProductDescription[R].Laboratoire de Physique et Chimie de L′envir-onnement Centre National de la Recherche Scientifique,2006.
[4]欧阳新艳.地震地磁卫星观测物理量简介[J].国际地震动态,2007(4):55-58.
[5]汤吉,赵国泽,陈小斌,等.地震电磁卫星荷载及现状[J].地球物理学进展,2007,22(3):679-686.
[6]LONEY K.张立浩,尹志军(译).Oracle Database 10g完全参考手册[M].北京:清华大学出版社,2008.
[7]蒋建平,何新华.基于Oracle数据库OO4O技术的应用研究[J].计算机工程与设计,2004,25(11):1996-1998.
[8]李良,柴毅,王道斌.基于.NET的Oracle BLOB数据高效存取方法[J].计算机工程,2008,34(20):64-65.
[2]朱荣,杨冬梅,荆凤,等.DEMETER卫星观测到的云南普洱地震前的电离层扰动[J].地震学报,2008(1):76-81.
[3]LAGOUTTE D,BROCHOT J Y,CARVALHO D,et al.DE-METER Microsatellite Scientific Mission Center Data ProductDescription[R].Laboratoire de Physique et Chimie de L′envir-onnement Centre National de la Recherche Scientifique,2006.
[4]欧阳新艳.地震地磁卫星观测物理量简介[J].国际地震动态,2007(4):55-58.
[5]汤吉,赵国泽,陈小斌,等.地震电磁卫星荷载及现状[J].地球物理学进展,2007,22(3):679-686.
[6]LONEY K.张立浩,尹志军(译).Oracle Database 10g完全参考手册[M].北京:清华大学出版社,2008.
[7]蒋建平,何新华.基于Oracle数据库OO4O技术的应用研究[J].计算机工程与设计,2004,25(11):1996-1998.
[8]李良,柴毅,王道斌.基于.NET的Oracle BLOB数据高效存取方法[J].计算机工程,2008,34(20):64-65.
版权所有：© 2023 中国地质图书馆 中国地质调查局地学文献中心