一种面向金融应用的海量分布式关系数据库
|
摘要
提出了一种面向金融应用的海量分布式数据库架构CBase,该架构融合了关系数据库和非关系型数据库的优点,既支持关系查询和跨行跨表的事务处理,又支持数据的分布式存储和节点的快速扩展.系统改进了现有分布式数据库单点故障的问题,具有较高的吞吐率和快速的响应时间,已经在银行业务中得到实际应用.实践证明:该数据库可满足金融业务对于大数据存储和查询的性能需求.
A new distributed database architecture was proposed for financial applications,CBase,whose architecture integrates the advantages of relational databases and non-relational databases.It not only supports relational query and cross-row,cross-table transaction processing,but also supports the distributed storage of data and the rapid expansion of nodes.The system improves the problem of single point failure in current distributed databases,and can process massive transactions in parallel rapidly,which has been put into practical application in the bank business.Practice has proved that the database can meet the performance requirements of financial services for large data storage and query.
A new distributed database architecture was proposed for financial applications,CBase,whose architecture integrates the advantages of relational databases and non-relational databases.It not only supports relational query and cross-row,cross-table transaction processing,but also supports the distributed storage of data and the rapid expansion of nodes.The system improves the problem of single point failure in current distributed databases,and can process massive transactions in parallel rapidly,which has been put into practical application in the bank business.Practice has proved that the database can meet the performance requirements of financial services for large data storage and query.
引文
[1]CHANG F,DEAN J,GHEMAWAT S,et al.Bigtable:a distributed storage system for structured data[J].Acm Transactions on Computer Systems,2008,26(2):1-26.
[2]DECANDIA G,HASTORUN D,JAMPANI M,et al.Dynamo:Amazon's highly available key-value store[C]//Proc of ACM Sigops Symposium on Operating Systems Principles.Washington:ACM,2007:205-220.
[3]BEAVER D,KUMAR S,LI H C,et al.Finding a needle in Haystack:Facebook's photo storage[C]//Proc of Usenix Conference on Operating Systems Design and Implementation.Vancouver:USENIX,2010:47-60.
[4]LAKSHMAN A,MALIK P.Cassandra:a decentralized structured storage system[J].Acm Sigops Operating Systems Review,2010,44(2):35-40.
[5]杨振坤.Ocean Base的关系数据库体系结构[J].华东师范大学学报:自然科学版,2014(5):141-148.
[6]ANDREWS M.The MemSQL query optimizer:a modern optimizer for real-time analytics in a distributed database[J].Proceedings of the VLDB Endowment,2016,9(13):1401-1412.
[7]RAO J,SHEKITA E J,TATA S,et al.Using Paxos to build a scalable,consistent,and highly available datastore[J].Proceedings of the VLDB Endowment,2011,4(4):243-254.
[8]BAILIS P,FEKETE A,HELLERSTEIN J M,et al.Scala-ble atomic visibility with RAMP transactions[J].Acm Tr-ansactions on Database Systems,2014,41(3):27-38.
[9]裴欧亚,刘文洁,李战怀,等.一种面向海量分布式数据库的嵌套查询策略[J].华东师范大学学报:自然科学版,2014(5):271-280.
[10]刘文洁,陈震,李战怀.一种面向海量分布式数据库的游标构造方法[J].西北工业大学学报,2017,35(4):718-723.
[11]樊秋实,周敏奇,周傲英.基线与增量数据分离架构下的分布式连接算法[J].计算机学报,2016,39(10):2102-2113.
[12]高锦涛,李战怀,杜洪涛,等.一种面向分布式数据库的基于剪枝的并行排序合并连接策略[J/OL].[2018-02-27].https://doi.org/10.13328/j.
[2]DECANDIA G,HASTORUN D,JAMPANI M,et al.Dynamo:Amazon's highly available key-value store[C]//Proc of ACM Sigops Symposium on Operating Systems Principles.Washington:ACM,2007:205-220.
[3]BEAVER D,KUMAR S,LI H C,et al.Finding a needle in Haystack:Facebook's photo storage[C]//Proc of Usenix Conference on Operating Systems Design and Implementation.Vancouver:USENIX,2010:47-60.
[4]LAKSHMAN A,MALIK P.Cassandra:a decentralized structured storage system[J].Acm Sigops Operating Systems Review,2010,44(2):35-40.
[5]杨振坤.Ocean Base的关系数据库体系结构[J].华东师范大学学报:自然科学版,2014(5):141-148.
[6]ANDREWS M.The MemSQL query optimizer:a modern optimizer for real-time analytics in a distributed database[J].Proceedings of the VLDB Endowment,2016,9(13):1401-1412.
[7]RAO J,SHEKITA E J,TATA S,et al.Using Paxos to build a scalable,consistent,and highly available datastore[J].Proceedings of the VLDB Endowment,2011,4(4):243-254.
[8]BAILIS P,FEKETE A,HELLERSTEIN J M,et al.Scala-ble atomic visibility with RAMP transactions[J].Acm Tr-ansactions on Database Systems,2014,41(3):27-38.
[9]裴欧亚,刘文洁,李战怀,等.一种面向海量分布式数据库的嵌套查询策略[J].华东师范大学学报:自然科学版,2014(5):271-280.
[10]刘文洁,陈震,李战怀.一种面向海量分布式数据库的游标构造方法[J].西北工业大学学报,2017,35(4):718-723.
[11]樊秋实,周敏奇,周傲英.基线与增量数据分离架构下的分布式连接算法[J].计算机学报,2016,39(10):2102-2113.
[12]高锦涛,李战怀,杜洪涛,等.一种面向分布式数据库的基于剪枝的并行排序合并连接策略[J/OL].[2018-02-27].https://doi.org/10.13328/j.