摘要
大数据技术的应用为互联网的发展提供了助力,但其也带来了极高的数据处理压力。它的应用使互联网数据呈现数量级增长。对于数据的后台管理与处置,是保障大数据的根本,尤其是云数据库的正式商用,增加了此过程的难度。基于此,采用流式计算框架,实现数据库的实时分区管理,有效提高数据库服务器的综合负载,从而达到更高效能、更高质量的数据处理。
The application of big data technology has contributed to the development of the Internet, but it also brings high pressure of data processing. Its application has led to an exponential increase in Internet data. Background management and disposal of data is the fundamental guarantee of large data, especially the formal commercial use of cloud database, which increases the difficulty of this process. Based on this, the streaming computing framework is adopted to realize the real-time partition management of the database,effectively improve the comprehensive load of the database server, so as to achieve higher efficiency and quality of data processing.
引文
[1]郭蒙雨,康宏,袁晓洁.基于流式计算框架的实时数据库分区系统[J].计算机工程,2017,43(11):8-15.
[2]孙小涓,石涛,李冰,等.空间科学卫星数据快速处理方法[J].计算机工程与科学,2018,284(8):19-25.