基于电网生产项目数据预处理研究
|
摘要
数据作为现代企业的宝贵资源,占据着越来越重要的地位,它是科学管理的基础、正确决策的前提、有效调控的手段。本文介绍了数据预处理的主要方法,包括:数据清洗、数据集成、数据变换和数据归约。根据这些数据方法来对2015-2017年电网生产项目的原始数据进行处理。其中重点包括:缺失值的处理,异常值的处理,变量和变量值的变换,以及数据精简。最终为电网生产项目优化的分析建模和算法提供可靠性的数据支持。
As a valuable resource of modern enterprises, data occupies a more and more important position. It is the basis of scientific management, the premise of correct decision-making, and the effective means of regulation and control. This paper introduces the main methods of data preprocessing, including data cleaning, data integration, data transformation and data reduction. According to these data methods, the original data of 2015-2017 power grid production project are processed. The emphasis includes the processing of missing value, the processing of outlier value, the transformation of variable and variable value, and the simplification of data. Finally, it provides reliable data support for the analysis, modeling and algorithm of power grid production project optimization.
As a valuable resource of modern enterprises, data occupies a more and more important position. It is the basis of scientific management, the premise of correct decision-making, and the effective means of regulation and control. This paper introduces the main methods of data preprocessing, including data cleaning, data integration, data transformation and data reduction. According to these data methods, the original data of 2015-2017 power grid production project are processed. The emphasis includes the processing of missing value, the processing of outlier value, the transformation of variable and variable value, and the simplification of data. Finally, it provides reliable data support for the analysis, modeling and algorithm of power grid production project optimization.
引文
[1]李国杰,程学旗.大数据研究:未来科技及经济社会发展的重大战略领域——大数据的研究现状与科学思考[J].中国科学院院刊,2012,27(06):647-657.
[2]刘明吉,王秀峰,黄亚楼.数据挖掘中的数据预处理[J].计算机科学,2000(04):54-57.
[3]方洪鹰.数据挖掘中数据预处理的方法研究[D].西南大学,2009.
[4]程开明.统计数据预处理的理论与方法述评[J].统计与信息论坛,2007(06):98-103.
[5]张立伟.用数理统计的方法处理试验数据的异常值[J].电线电缆,2005(04):46-48.
[6]刘云霞.数据归约的统计方法研究及应用[D].厦门大学,2007.
[2]刘明吉,王秀峰,黄亚楼.数据挖掘中的数据预处理[J].计算机科学,2000(04):54-57.
[3]方洪鹰.数据挖掘中数据预处理的方法研究[D].西南大学,2009.
[4]程开明.统计数据预处理的理论与方法述评[J].统计与信息论坛,2007(06):98-103.
[5]张立伟.用数理统计的方法处理试验数据的异常值[J].电线电缆,2005(04):46-48.
[6]刘云霞.数据归约的统计方法研究及应用[D].厦门大学,2007.