基于自学习Pauta和Smooth的地下水位异常值检测和平滑处理方法
|
摘要
地下水监测主要通过自动化监测设备对地下水位进行监测,从而获得随时间变化的水位曲线.目前的自动化监测设备采集的水位数据中存在很多异常值,会影响正常的决策判断.针对此问题,提出将自学习算法融入到奇异值剔除—拉依达准则中,用于异常值的检测,将其应用于地下水位数据的平滑处理中,通过对内蒙古某地采集的水位数据进行平滑处理验证,表明本文方法能够有效剔除水位数据中的异常值,而且不会影响曲线的整体趋势走向,效果良好.
Groundwater monitoring monitors groundwater levels primarily through automated monitoring equipment to obtain time-varying water level curves.There are many abnormal values in the water level data collected by the current automatic monitoring equipment,which affects the normal decision-making.Aiming at this problem,it is proposed to integrate the selflearning algorithm into the singular value culling criterion—Layida criterion for the detection of outliers,and apply it to the smoothing of groundwater level data through the water level data collected in a certain area of Inner Mongolia.The smoothing process verification shows that themethod can effectively eliminate the outliers in the water level data,and does not affect the overall trend of the curve,and the effect is good.
Groundwater monitoring monitors groundwater levels primarily through automated monitoring equipment to obtain time-varying water level curves.There are many abnormal values in the water level data collected by the current automatic monitoring equipment,which affects the normal decision-making.Aiming at this problem,it is proposed to integrate the selflearning algorithm into the singular value culling criterion—Layida criterion for the detection of outliers,and apply it to the smoothing of groundwater level data through the water level data collected in a certain area of Inner Mongolia.The smoothing process verification shows that themethod can effectively eliminate the outliers in the water level data,and does not affect the overall trend of the curve,and the effect is good.
引文
[1]刘璐,房俊龙,赵忠泽,等.灌区地下水位远程监测终端设计[J].农机化研究,2015(6):97-100.LIU L,FANG J L,ZHAO Z Z,et al.Design of groundwater level remote monitoring terminal in irrigation district[J].Journal of Agricultural Mechanization Research,2015(6):97-100.(in Chinese)
[2]张本平.西安市地面沉降与地下水位监测数据管理[J].西安文理学院学报(自然科学版),2009,12(2):101-105.ZHANG B P.The monitoring data management of land subsidence and ground water level in Xi′an[J].Journal of Xi′an University of Arts&Science(Nature Science Edition),2009,12(2):101-105.(in Chinese)
[3]邓卉,杨嘉.地下水动态监测技术实例研究[J].价值工程,2015(29):103-105.DENG H,YANG J.Case study of groundwater dynamic monitoring technology[J].Value Engineering,2015(29):103-105.(in Chinese)
[4]王红,邸国辉,熊燕.水下地形测量高程异常点剔除方法研究[J].测绘,2004,27(1):36-38.WANG H,DI G H,XIONG Y.Research on the way of detecting abnormal altitude data in survey under water[J].Surveying and Mapping,2004,27(1):36-38.(in Chinese)
[5]游加.地下水位监测系统开发[D].北京:北方工业大学,2012.YOU J.Groundwater level monitoring system development[D].Beijing:North China University of Technology,2012.(in Chinese)
[6]周川辰,蒋新新,李玉梅,等.地下水位监测仪器质量检测技术研究与应用[J].水利信息化,2016(1):38-43.ZHOU C C,JIANG X X,LI Y M,et al.Research and application of quality inspection technique about monitoring instrument for groundwater level[J].Water Resources Informatization,2016(1):38-43.(in Chinese)
[7]潘博,游加,田震,等.地下水位监测冗余数据去除算法研究与应用[J].水电能源科学,2012,30(5):21-24.PAN B,YOU J,TIAN Z,et al.Applocation of wavelet network coupling model to groundwater level forecasting[J].Water Resources and Power,2012,30(5):21-24.(in Chinese)
[8]姚熊亮,陈海龙,赵新,等.基于拉依达准则的舰载设备抗冲击薄弱环节判定[J].中国舰船研究,2007,2(5):10-14.YAO X L,CHEN H L,ZHAO X,et al.Weak link determination of anti-shock performance of shipboard equipments based on Pauta criterion[J].Chinese Journal of Ship Research,2007,2(5):10-14.(in Chinese)
[9]孙苗钟.基于MATLAB的振动信号平滑处理方法[J].电子测量技术,2007,30(6):55-57.SUN M Z.Smooth processing methods of vibration signal based on MATLAB[J].Electronic Measurement Technology,2007,30(6):55-57.(in Chinese)
[10]贺冬冬,张理,张会礼,等.“3σ准则”在桥梁健康监测数据奇异值检验中的应用[J].中外公路,2013,33(6):107-110.HE D D,ZHANG L,ZHANG H L,et al.The application of“3σCriterion”in the singular value test of bridge health monitoring data[J].Journal of China&Foreign Highway,2013,33(6):107-110.(in Chinese)
[11]王莹,刘佳,王欣,等.计量检测中异常数据剔除的有效方法[J].电子世界,2016(24):93-93.WANG Y,LIU J,WANG X,et al.Efficient method for eliminating abnormal data in measurement detection[J].Electronics World,2016(24):93-93.(in Chinese)
[12]叶川,伍川辉,张嘉怡.计量测试中异常数据剔除方法比较[J].计量与测试技术,2007,34(7):26-27.YE C,WU C H,ZHANG J Y.Comparision about how to get rid of abnormal data in metrology&measurement[J].Metrology&Measurement Technique,2007,34(7):26-27.(in Chinese)
[13]邬恒东,徐建平.监测分析方法验证数据异常值的处理[J].环境监控与预警,2016,8(5):38-41.WU H D,XU J P.Processing and handling of abnormal data in validating monitoring analysis methods[J].Environmental Monitoring and Forewarning,2016,8(5):38-41.(in Chinese)
[14]王天送,张杰,孙明明.拉伊达准则在交通调查数据处理中的应用[J].西部交通科技,2016(4):96-99.WANG T S,ZHANG J,SUN M M.Application of Pauta criterion in traffic survey data processing[J].Western China Communication Science&Technology,2016(4):96-99.(in Chinese)
[15]刘喜梅,刘义芳,高林.小样本道路旅行时间数据中的异常点剔除算法[J].青岛科技大学学报(自然科学版),2015,36(3):346-349.LIU X M,LIU Y F,GAO L.Algorithm outlier filtering for small simple data of travel time[J].Journal of Qingdao University of Science and Technology(Natural Science Edition),2015,36(3):346-349.(in Chinese)
[16]李慧.石河子灌区地下水位变化规律分析[J].地下水,2016(3):43-44.LI H.Analysis on change law of groundwater level in Shihezi irrigation area[J].Ground Water,2016(3):43-44.(in Chinese)
[17]崔剑,巴合提努尔·巴赞.Smooth函数平滑处理马钢SO2排放数据方法与应用[J].资源节约与环保,2017(6):94-95.CUI J,BAHETIMUER B.Application and method of disposing data of smooth function[J].Resources Economization&Environment Protection,2017(6):94-95.(in Chinese)
[2]张本平.西安市地面沉降与地下水位监测数据管理[J].西安文理学院学报(自然科学版),2009,12(2):101-105.ZHANG B P.The monitoring data management of land subsidence and ground water level in Xi′an[J].Journal of Xi′an University of Arts&Science(Nature Science Edition),2009,12(2):101-105.(in Chinese)
[3]邓卉,杨嘉.地下水动态监测技术实例研究[J].价值工程,2015(29):103-105.DENG H,YANG J.Case study of groundwater dynamic monitoring technology[J].Value Engineering,2015(29):103-105.(in Chinese)
[4]王红,邸国辉,熊燕.水下地形测量高程异常点剔除方法研究[J].测绘,2004,27(1):36-38.WANG H,DI G H,XIONG Y.Research on the way of detecting abnormal altitude data in survey under water[J].Surveying and Mapping,2004,27(1):36-38.(in Chinese)
[5]游加.地下水位监测系统开发[D].北京:北方工业大学,2012.YOU J.Groundwater level monitoring system development[D].Beijing:North China University of Technology,2012.(in Chinese)
[6]周川辰,蒋新新,李玉梅,等.地下水位监测仪器质量检测技术研究与应用[J].水利信息化,2016(1):38-43.ZHOU C C,JIANG X X,LI Y M,et al.Research and application of quality inspection technique about monitoring instrument for groundwater level[J].Water Resources Informatization,2016(1):38-43.(in Chinese)
[7]潘博,游加,田震,等.地下水位监测冗余数据去除算法研究与应用[J].水电能源科学,2012,30(5):21-24.PAN B,YOU J,TIAN Z,et al.Applocation of wavelet network coupling model to groundwater level forecasting[J].Water Resources and Power,2012,30(5):21-24.(in Chinese)
[8]姚熊亮,陈海龙,赵新,等.基于拉依达准则的舰载设备抗冲击薄弱环节判定[J].中国舰船研究,2007,2(5):10-14.YAO X L,CHEN H L,ZHAO X,et al.Weak link determination of anti-shock performance of shipboard equipments based on Pauta criterion[J].Chinese Journal of Ship Research,2007,2(5):10-14.(in Chinese)
[9]孙苗钟.基于MATLAB的振动信号平滑处理方法[J].电子测量技术,2007,30(6):55-57.SUN M Z.Smooth processing methods of vibration signal based on MATLAB[J].Electronic Measurement Technology,2007,30(6):55-57.(in Chinese)
[10]贺冬冬,张理,张会礼,等.“3σ准则”在桥梁健康监测数据奇异值检验中的应用[J].中外公路,2013,33(6):107-110.HE D D,ZHANG L,ZHANG H L,et al.The application of“3σCriterion”in the singular value test of bridge health monitoring data[J].Journal of China&Foreign Highway,2013,33(6):107-110.(in Chinese)
[11]王莹,刘佳,王欣,等.计量检测中异常数据剔除的有效方法[J].电子世界,2016(24):93-93.WANG Y,LIU J,WANG X,et al.Efficient method for eliminating abnormal data in measurement detection[J].Electronics World,2016(24):93-93.(in Chinese)
[12]叶川,伍川辉,张嘉怡.计量测试中异常数据剔除方法比较[J].计量与测试技术,2007,34(7):26-27.YE C,WU C H,ZHANG J Y.Comparision about how to get rid of abnormal data in metrology&measurement[J].Metrology&Measurement Technique,2007,34(7):26-27.(in Chinese)
[13]邬恒东,徐建平.监测分析方法验证数据异常值的处理[J].环境监控与预警,2016,8(5):38-41.WU H D,XU J P.Processing and handling of abnormal data in validating monitoring analysis methods[J].Environmental Monitoring and Forewarning,2016,8(5):38-41.(in Chinese)
[14]王天送,张杰,孙明明.拉伊达准则在交通调查数据处理中的应用[J].西部交通科技,2016(4):96-99.WANG T S,ZHANG J,SUN M M.Application of Pauta criterion in traffic survey data processing[J].Western China Communication Science&Technology,2016(4):96-99.(in Chinese)
[15]刘喜梅,刘义芳,高林.小样本道路旅行时间数据中的异常点剔除算法[J].青岛科技大学学报(自然科学版),2015,36(3):346-349.LIU X M,LIU Y F,GAO L.Algorithm outlier filtering for small simple data of travel time[J].Journal of Qingdao University of Science and Technology(Natural Science Edition),2015,36(3):346-349.(in Chinese)
[16]李慧.石河子灌区地下水位变化规律分析[J].地下水,2016(3):43-44.LI H.Analysis on change law of groundwater level in Shihezi irrigation area[J].Ground Water,2016(3):43-44.(in Chinese)
[17]崔剑,巴合提努尔·巴赞.Smooth函数平滑处理马钢SO2排放数据方法与应用[J].资源节约与环保,2017(6):94-95.CUI J,BAHETIMUER B.Application and method of disposing data of smooth function[J].Resources Economization&Environment Protection,2017(6):94-95.(in Chinese)