大数据知识服务平台架构设计及应用研究
|
摘要
当前数据信息呈现出爆发式的增长,为了便于对大数据进行处理、汇聚、关联和挖掘,构建了大数据知识服务平台。该平台分成服务层、功能层和平台层,采用Struts2框架对平台进行开发,MySQL数据库对数据分析结果进行存储。知识服务大数据分析采用K-Medoids聚类改进算法。最后,对该平台的应用效果进行分析,结果表明:该平台知识分类效果较精确,检索效率更高。
Current data information shows explosive growth. In order to facilitate the processing, aggregation, correlation and mining of big data, this paper constructs a big data knowledge service platform. The platform is divided into service layer, function layer and platform layer. Struts 2 framework is used to develop the platform and MySQL database is used to store the results of data analysis. This platform makes use of K-Medoids clustering improved algorithm to analyze big data. Finally, the application of the platform is analyzed, the results show that the platform knowledge classification is more accurate and the retrieval efficiency is higher.
Current data information shows explosive growth. In order to facilitate the processing, aggregation, correlation and mining of big data, this paper constructs a big data knowledge service platform. The platform is divided into service layer, function layer and platform layer. Struts 2 framework is used to develop the platform and MySQL database is used to store the results of data analysis. This platform makes use of K-Medoids clustering improved algorithm to analyze big data. Finally, the application of the platform is analyzed, the results show that the platform knowledge classification is more accurate and the retrieval efficiency is higher.
引文
[1] 张广彬,盘骏,曾智强.数据中心2013:硬件重构与软件定义[R].北京:[出版地不详],2014.
[2] 李晨晖,崔建明,陈超泉.大数据知识服务平台构建关键技术研究[J].情报资料工作,2013(2):29-34.
[3] ZHANG Junbo,WONG JianSyuan,LI Tianrui.A comparison of parallel large-scale knowledge acquisition using rough set theory on different MapReduce runtime systems[J].Int J Approx Reason,2014,55(3):896-907.
[4] CAI Dongfeng,BAI Yu,ZHANG Guiping.The Knowledge Service Project in the Era of Big Data[C]//IEEE International Congress on Big Data.Santa Clara University,2013:403-405.
[2] 李晨晖,崔建明,陈超泉.大数据知识服务平台构建关键技术研究[J].情报资料工作,2013(2):29-34.
[3] ZHANG Junbo,WONG JianSyuan,LI Tianrui.A comparison of parallel large-scale knowledge acquisition using rough set theory on different MapReduce runtime systems[J].Int J Approx Reason,2014,55(3):896-907.
[4] CAI Dongfeng,BAI Yu,ZHANG Guiping.The Knowledge Service Project in the Era of Big Data[C]//IEEE International Congress on Big Data.Santa Clara University,2013:403-405.