面向LAMOST的天体光谱数据仓库系统设计与实现
|
摘要
数据仓库是一种有效的数据存储工具,OLAP是面向数据仓库的数据分析和知识提取的有效工具。本文以国家重大科学工程为背景,对LAMOST的天体光谱数据仓库系统进行了研究,对提高天文数据的利用效率、发现天文数据隐藏的知识具有重要实际意义。主要研究工作如下:
1、对面向LAMOST的天体光谱数据仓库系统进行了需求分析,给出了系统业务流程图、数据流图和小字典。
2、LAMOST天体光谱数据仓库系统的总体设计,给出了系统的实现目标、软件的处理流程、软件的流程图、软件的体系结构、功能模块图,并且将各个模块的具体功能进行了规划。
3、天体光谱数据仓库系统的数据结构设计,给出了数据仓库结构的概念模型和物理模型,以及对星表的设计、星表之间的关系,以及数据仓库的多维立方体,包括Star多维立方体和Galaxy多维立方体。
4、天体光谱数据仓库系统的主要功能详细设计,包括系统运行设计、模块函数等功能模块,以及在函数中采用各种算法、系统出错时的处理手段。
5、天体光谱数据仓库系统的实现。采用SQL Server2000、Analysis services和VB6.0作为开发工具,构建了天体光谱数据仓库系统和多维立方体(Star,Galaxy),实现了天体光谱的显示与OLAP操作。运行与测试结果表明,系统是稳定的、高效的和可行的。
Data Warehouse is an effective tool for storage of data, and OLAP is an tool for data analysis and knowledge extraction. These techniques had be successfully applied in many areas ,such as information indexing and knowledge discovery et al. The topic of this thesis aims at establishing the Data Warehouse system for LAMOST project. The system will be used to improve the efficiency of the data usage, discover knowledge hidden in astronomical data. The main work includes as follows:
First, demand analysis for LAMOST Spectra Data Warehouse System is gived. Business flow chart,data flow chart and dictionary are given.
Second, general design for LAMOST Spectra Data Warehouse System is gived, which includes the implementation aim of the system, software processing flow, software architecture, functional block diagram. Detailed function of each modular is defined. Third, data structure of the system is designed. Concept and physical model of the data warehouse structure,star catalogue and the relationship of catalogues are given. The multi-dimension cube of the data warehouse,including Star multi-dimension cube and Galaxy multi-dimension cube, is also gived too.
Fourth, main functions of the system are designed, including system running, modular function,different algorithm in each function , error and accident process et al.
Fifth, by using SQL Server2000, Analysis services and VB6.0 as the development tools, the LAMOST spectra data warehouse system and multi-dimension cub for stars and galaxies are constructed, and spectral display and OLAP operation are implemented. The running and testing results show the system is robust, high efficient and feasible.
1、对面向LAMOST的天体光谱数据仓库系统进行了需求分析,给出了系统业务流程图、数据流图和小字典。
2、LAMOST天体光谱数据仓库系统的总体设计,给出了系统的实现目标、软件的处理流程、软件的流程图、软件的体系结构、功能模块图,并且将各个模块的具体功能进行了规划。
3、天体光谱数据仓库系统的数据结构设计,给出了数据仓库结构的概念模型和物理模型,以及对星表的设计、星表之间的关系,以及数据仓库的多维立方体,包括Star多维立方体和Galaxy多维立方体。
4、天体光谱数据仓库系统的主要功能详细设计,包括系统运行设计、模块函数等功能模块,以及在函数中采用各种算法、系统出错时的处理手段。
5、天体光谱数据仓库系统的实现。采用SQL Server2000、Analysis services和VB6.0作为开发工具,构建了天体光谱数据仓库系统和多维立方体(Star,Galaxy),实现了天体光谱的显示与OLAP操作。运行与测试结果表明,系统是稳定的、高效的和可行的。
Data Warehouse is an effective tool for storage of data, and OLAP is an tool for data analysis and knowledge extraction. These techniques had be successfully applied in many areas ,such as information indexing and knowledge discovery et al. The topic of this thesis aims at establishing the Data Warehouse system for LAMOST project. The system will be used to improve the efficiency of the data usage, discover knowledge hidden in astronomical data. The main work includes as follows:
First, demand analysis for LAMOST Spectra Data Warehouse System is gived. Business flow chart,data flow chart and dictionary are given.
Second, general design for LAMOST Spectra Data Warehouse System is gived, which includes the implementation aim of the system, software processing flow, software architecture, functional block diagram. Detailed function of each modular is defined. Third, data structure of the system is designed. Concept and physical model of the data warehouse structure,star catalogue and the relationship of catalogues are given. The multi-dimension cube of the data warehouse,including Star multi-dimension cube and Galaxy multi-dimension cube, is also gived too.
Fourth, main functions of the system are designed, including system running, modular function,different algorithm in each function , error and accident process et al.
Fifth, by using SQL Server2000, Analysis services and VB6.0 as the development tools, the LAMOST spectra data warehouse system and multi-dimension cub for stars and galaxies are constructed, and spectral display and OLAP operation are implemented. The running and testing results show the system is robust, high efficient and feasible.
引文
[1] 刘兴景. 数据仓库、数据挖掘技术与方法研究及在 DSS 中的应用[D],同济大学博士论文,2003
[2] Tony Bain 等. SQL Server 2000 数据仓库与 Analysis Services[M],北京:中国电力出版社,2003
[3] W.H.Inmon.数据仓库[M],北京:机械工业出版社,2003
[4] Deutsch,M. Verification and Validation[C]. In:Software Engineering (R.Jensen and C.Tonies, eds.) Prentice-Hall,1979,pp:329-408
[5] 李会贤,桑健,罗阿理等. 基于 MYSQL / LINUX 的 LAMOST 数据库设计与实现[J],天文研究与技术,2005,3(1):56-63
[6] 何思文. 基于SQL Server 2000的数据仓库的实现[J],科技?技术,2004,5:36-37
[7] 张彦霞,赵永恒,崔辰州. 天文学中的数据挖掘和知识发现[J],天文研究与技术,2002,20(4):312-323
[8] 蒋良孝,蔡之华.基于数据仓库的数据挖掘研究[J],计算技术与自动化,2003,22(3):102-105
[9] 彭朝海.基于数据仓库的决策支持系统[J],四川工业学院学报,2003,22(3):74-76
[10] 赵梅芳,罗阿理,吴福朝等.基于自适应径向基神经网络的类星体自动识别方法[J],光谱学与光谱分析,2006,26(2):15-20
[11] 张健楠.确定恒星表面有效温度的曲面拟合方法[J],天文研究与技术,2004,1(4):249-258
[12] 刘中田,吴福朝,罗阿里等. 基于卷积型小波包变换的谱线自动提取方法. 光谱学与光谱分析, 2006,26(2):372-376
[13] J.Tonry, M.Davis. A survey of galaxy redshifts. I - Data reduction techniques, AJ, 1979, 84(2):1511-1520
[14] 杨金福,吴福朝,罗阿理等.基于覆盖算法的天体光谱自动分类[J],模式识别与人工智能,2006,19(3):368-374
[15] 刘中田,吴福朝,罗阿里等. 基于卷积型小波包变换的谱线自动提取方法, 光谱学与光谱分析, 2005,26(6):372-376
[16] LAMOST 二维光纤光谱处理程序 1.0 版技术报告, 中国科学技术大学信号统计处理研究室,2005.8
[17] M.Dessauges-Zavadsky,et al. Spectral classification of emission-line galaxies. Astronomy and Astrophusics,2000,35(5):89-98
[18] I.Csabai, A. J.Connolly, A. S.Szalay, T. Budavári. Reconstructing Galaxy Spectral Energy Distributions from Broadband Photometry. The Astronomical Journal, 2000, 119(1):69-78
[19] 姜江.PowerDdsigner 数据库系统分析设计与应用 [M],北京:电子工业出版社, 2004
[20] 刘蓉,段福庆,罗阿理.一种基于交叉相关的类星体的红移测量方法[J],光谱学与光谱分析,2005,25(7):1155-1157
[21] 石柱. 软件工程标准手册[M], 北京:中国标准出版社,2004
[22] A-Li Luo, Yan-Xia Zhang, Yong-Heng Zhao. Design and implementation of The spectra reduction and analysis software for LAMOST Telescope. Proc. SPIE 5496,PP:756-764
[2] Tony Bain 等. SQL Server 2000 数据仓库与 Analysis Services[M],北京:中国电力出版社,2003
[3] W.H.Inmon.数据仓库[M],北京:机械工业出版社,2003
[4] Deutsch,M. Verification and Validation[C]. In:Software Engineering (R.Jensen and C.Tonies, eds.) Prentice-Hall,1979,pp:329-408
[5] 李会贤,桑健,罗阿理等. 基于 MYSQL / LINUX 的 LAMOST 数据库设计与实现[J],天文研究与技术,2005,3(1):56-63
[6] 何思文. 基于SQL Server 2000的数据仓库的实现[J],科技?技术,2004,5:36-37
[7] 张彦霞,赵永恒,崔辰州. 天文学中的数据挖掘和知识发现[J],天文研究与技术,2002,20(4):312-323
[8] 蒋良孝,蔡之华.基于数据仓库的数据挖掘研究[J],计算技术与自动化,2003,22(3):102-105
[9] 彭朝海.基于数据仓库的决策支持系统[J],四川工业学院学报,2003,22(3):74-76
[10] 赵梅芳,罗阿理,吴福朝等.基于自适应径向基神经网络的类星体自动识别方法[J],光谱学与光谱分析,2006,26(2):15-20
[11] 张健楠.确定恒星表面有效温度的曲面拟合方法[J],天文研究与技术,2004,1(4):249-258
[12] 刘中田,吴福朝,罗阿里等. 基于卷积型小波包变换的谱线自动提取方法. 光谱学与光谱分析, 2006,26(2):372-376
[13] J.Tonry, M.Davis. A survey of galaxy redshifts. I - Data reduction techniques, AJ, 1979, 84(2):1511-1520
[14] 杨金福,吴福朝,罗阿理等.基于覆盖算法的天体光谱自动分类[J],模式识别与人工智能,2006,19(3):368-374
[15] 刘中田,吴福朝,罗阿里等. 基于卷积型小波包变换的谱线自动提取方法, 光谱学与光谱分析, 2005,26(6):372-376
[16] LAMOST 二维光纤光谱处理程序 1.0 版技术报告, 中国科学技术大学信号统计处理研究室,2005.8
[17] M.Dessauges-Zavadsky,et al. Spectral classification of emission-line galaxies. Astronomy and Astrophusics,2000,35(5):89-98
[18] I.Csabai, A. J.Connolly, A. S.Szalay, T. Budavári. Reconstructing Galaxy Spectral Energy Distributions from Broadband Photometry. The Astronomical Journal, 2000, 119(1):69-78
[19] 姜江.PowerDdsigner 数据库系统分析设计与应用 [M],北京:电子工业出版社, 2004
[20] 刘蓉,段福庆,罗阿理.一种基于交叉相关的类星体的红移测量方法[J],光谱学与光谱分析,2005,25(7):1155-1157
[21] 石柱. 软件工程标准手册[M], 北京:中国标准出版社,2004
[22] A-Li Luo, Yan-Xia Zhang, Yong-Heng Zhao. Design and implementation of The spectra reduction and analysis software for LAMOST Telescope. Proc. SPIE 5496,PP:756-764