林业资源数据集群的快速索引设计
|
摘要
设计一种快速索引以管理分布存储的林业资源数据,通过大量独立数据节点共同负载数据请求,减少数据访问过程的互斥,实现了空间与属性数据的分布式存储并行访问.实验结果表明,基于目前的应用服务器集群,应用该快速索引方法,能以较低的改进成本提高整个数据集群的快速统计和更新能力.
This paper describes the design of a fast index for distributed storage of forestry resource data.According to the load data request of a large number of independent data nodes to reduce the mutual exclusion during data access,parallel access was realized for distributed storage of spatial and attributive data.Based on the common application server cluster,this fast index can be used by making the minor modifications of data access process so as to improve the performance of statistics and update of the whole data cluster with low cost.
This paper describes the design of a fast index for distributed storage of forestry resource data.According to the load data request of a large number of independent data nodes to reduce the mutual exclusion during data access,parallel access was realized for distributed storage of spatial and attributive data.Based on the common application server cluster,this fast index can be used by making the minor modifications of data access process so as to improve the performance of statistics and update of the whole data cluster with low cost.
引文
[1]ZHANG Dong-you,ZANG Shu-ying,FENG Zhong-ke.Design of Forestry Geographic Information Public Service Platform in Heilongjiang Province[J].Journal of Beijing Forestry University,2007,29(Suppl 2):26-30.(张冬有,臧淑英,冯仲科.黑龙江省林业地理信息公共服务平台设计[J].北京林业大学学报,2007,29(增刊2):26-30.)
[2]PANG Li-feng,TANG Xiao-ming,LIU Peng-ju.Development of the Provincial Forestry Information Sharing Platform Based on WebGIS[J].Journal of Northwest Forestry University,2011,26(2):180-184.(庞丽峰,唐小明,刘鹏举.基于WebGIS省级林业信息共享平台的研发[J].西北林学院学报,2011,26(2):180-184.)
[3]TIAN Bo,DING Li-xia,ZHOU Yun-xuan,et al.Construction of a Multi-layered Distributed Forestry Information Service Platform[J].Journal of Zhejiang Forestry College,2006,23(4):429-434.(田波,丁丽霞,周云轩,等.多层分布式林业信息服务平台的构建[J].浙江林学院学报,2006,23(4):429-434.)
[4]FENG Tie,CHAI Sheng,ZHANG Jia-chen,et al.Approach of Dynamic Change Impact Analysis on Software Architecture[J].Journal of Jilin University:Engineering and Technology Edition,2011,41(2):458-462.(冯铁,柴胜,张家晨,等.一种软件体系结构动态变动影响分析方法[J].吉林大学学报:工学版,2011,41(2):458-462.)
[5]ZHANG Xu,LI Zeng-yuan,DENG Guang,et al.Research and Implementation on Digital Forestry Platform[J].Scientia Silvae Sinicae,2006,42(Suppl 1):37-40.(张旭,李增元,邓广,等.数字林业平台技术研究与实现[J].林业科学,2006,42(增刊1):37-40.)
[6]Kamel I,Faloutsos C.Parallel R-Trees[C]//Proceedings of the 1992ACM SIGMOD International Conference on Management of Data.New York:ACM Press,1992:195-204.
[7]FU Xiao-dong,WANG Ding-xing,ZHENG Wei-min.GPR-Tree:A Global Parallel Index Structure for Multiattribute Declustering on Cluster of Workstations[C]//Proceedings on Advances in Parallel and Distributed Computing.Piscataway:IEEE Computer Society,1997:300-306.
[8]ZUO Chao-shu,LIU Xin-song,CHEN Xiao-hui,et al.DPslR+:A Distributed and Parallel Spatial Index Tree Based on Dynamic Spatial Slot[J].Computer Science,2006,33(2):121-126.(左朝树,刘心松,陈小辉,等.DPslR+:一种基于动态空间槽的分布式并行空间索引树[J].计算机科学,2006,33(2):121-126.)
[9]CHEN Zhan-long,WU Xin-cai,XIE Zhong,et al.GSHR-Tree:A Spatial Index Tree Based on Dynamic Spatial Slot and Hash Table in Grid Environments[J].Earth Science(Journal of China University of Geosciences),2010,35(3):463-470.(陈占龙,吴信才,谢忠,等.GSHR-Tree:一种基于动态空间槽和哈希表的网格环境下的空间索引树[J].地球科学(中国地质大学学报),2010,35(3):463-470.)
[10]CONG Li,ZHANG Hai-lin,LIU Yi,et al.Particle Swarm Optimized Game Theory for Resource Allocation in Cooperative Networks[J].Journal of Jilin University:Engineering and Technology Edition,2012,42(1):207-212.(丛犁,张海林,刘毅,等.基于粒子群优化的协作网络资源分配的博弈策略[J].吉林大学学报:工学版,2012,42(1):207-212.)
[11]Lawder J K,King P J H.Using Space-Filling Curves for Multidimensional Indexing[C]//Proceedings of the 17th British National Conference on Databases:Advances in Databases.London:Springer,2000:20-25.
[12]YU Bo,HAO Zhong-xiao.Research of Distributed and Parallel Spatial Index Mechanism Based on DPR-Tree[J].Computer Technology and Development,2010,20(6):39-42.(于波,郝忠孝.基于DPR树的分布式并行空间索引机制的研究[J].计算机技术与发展,2010,20(6):39-42.)
[13]Breinholt G,Schierz C.Generating Hilberts Space-Filling Curve by Recursion[J].ACM Transactions on Mathematical Software,1998,24(2):184-189.
[14]Kamel I,Faloutsos C.Hilbert R-Tree:An Improved R-Tree Using Fractals[C]//Proceedings of the 20th International Conference on Very Large Data Bases.San Francisco:Morgan Kaufmann Publisher Inc,1994:500-509.
[2]PANG Li-feng,TANG Xiao-ming,LIU Peng-ju.Development of the Provincial Forestry Information Sharing Platform Based on WebGIS[J].Journal of Northwest Forestry University,2011,26(2):180-184.(庞丽峰,唐小明,刘鹏举.基于WebGIS省级林业信息共享平台的研发[J].西北林学院学报,2011,26(2):180-184.)
[3]TIAN Bo,DING Li-xia,ZHOU Yun-xuan,et al.Construction of a Multi-layered Distributed Forestry Information Service Platform[J].Journal of Zhejiang Forestry College,2006,23(4):429-434.(田波,丁丽霞,周云轩,等.多层分布式林业信息服务平台的构建[J].浙江林学院学报,2006,23(4):429-434.)
[4]FENG Tie,CHAI Sheng,ZHANG Jia-chen,et al.Approach of Dynamic Change Impact Analysis on Software Architecture[J].Journal of Jilin University:Engineering and Technology Edition,2011,41(2):458-462.(冯铁,柴胜,张家晨,等.一种软件体系结构动态变动影响分析方法[J].吉林大学学报:工学版,2011,41(2):458-462.)
[5]ZHANG Xu,LI Zeng-yuan,DENG Guang,et al.Research and Implementation on Digital Forestry Platform[J].Scientia Silvae Sinicae,2006,42(Suppl 1):37-40.(张旭,李增元,邓广,等.数字林业平台技术研究与实现[J].林业科学,2006,42(增刊1):37-40.)
[6]Kamel I,Faloutsos C.Parallel R-Trees[C]//Proceedings of the 1992ACM SIGMOD International Conference on Management of Data.New York:ACM Press,1992:195-204.
[7]FU Xiao-dong,WANG Ding-xing,ZHENG Wei-min.GPR-Tree:A Global Parallel Index Structure for Multiattribute Declustering on Cluster of Workstations[C]//Proceedings on Advances in Parallel and Distributed Computing.Piscataway:IEEE Computer Society,1997:300-306.
[8]ZUO Chao-shu,LIU Xin-song,CHEN Xiao-hui,et al.DPslR+:A Distributed and Parallel Spatial Index Tree Based on Dynamic Spatial Slot[J].Computer Science,2006,33(2):121-126.(左朝树,刘心松,陈小辉,等.DPslR+:一种基于动态空间槽的分布式并行空间索引树[J].计算机科学,2006,33(2):121-126.)
[9]CHEN Zhan-long,WU Xin-cai,XIE Zhong,et al.GSHR-Tree:A Spatial Index Tree Based on Dynamic Spatial Slot and Hash Table in Grid Environments[J].Earth Science(Journal of China University of Geosciences),2010,35(3):463-470.(陈占龙,吴信才,谢忠,等.GSHR-Tree:一种基于动态空间槽和哈希表的网格环境下的空间索引树[J].地球科学(中国地质大学学报),2010,35(3):463-470.)
[10]CONG Li,ZHANG Hai-lin,LIU Yi,et al.Particle Swarm Optimized Game Theory for Resource Allocation in Cooperative Networks[J].Journal of Jilin University:Engineering and Technology Edition,2012,42(1):207-212.(丛犁,张海林,刘毅,等.基于粒子群优化的协作网络资源分配的博弈策略[J].吉林大学学报:工学版,2012,42(1):207-212.)
[11]Lawder J K,King P J H.Using Space-Filling Curves for Multidimensional Indexing[C]//Proceedings of the 17th British National Conference on Databases:Advances in Databases.London:Springer,2000:20-25.
[12]YU Bo,HAO Zhong-xiao.Research of Distributed and Parallel Spatial Index Mechanism Based on DPR-Tree[J].Computer Technology and Development,2010,20(6):39-42.(于波,郝忠孝.基于DPR树的分布式并行空间索引机制的研究[J].计算机技术与发展,2010,20(6):39-42.)
[13]Breinholt G,Schierz C.Generating Hilberts Space-Filling Curve by Recursion[J].ACM Transactions on Mathematical Software,1998,24(2):184-189.
[14]Kamel I,Faloutsos C.Hilbert R-Tree:An Improved R-Tree Using Fractals[C]//Proceedings of the 20th International Conference on Very Large Data Bases.San Francisco:Morgan Kaufmann Publisher Inc,1994:500-509.