基于监督学习的紫外-可见光光谱水质在线异常检测方法研究

详细信息    查看全文 | 推荐本文 |

英文篇名：In-Situ Detection of Water Quality Anomaly with UV/Vis Spectrum Based on Supervised Learning 作者：尹航 ; 俞巧君 ; 侯迪波 ; 黄平捷 ; 张光新 ; 张宏建 英文作者：YIN Hang;YU Qiao-jun;HOU Di-bo;HUANG Ping-jie;ZHANG Guang-xin;ZHANG Hong-jian;State Key Laboratory of Industrial Control Technology,College of Control Science and Engineering,Zhejiang University; 关键词：紫外-可见光光谱 ; 水质异常检测 ; 正交投影 ; 监督学习 ; 偏最小二乘判别分析 英文关键词：UV-Vis spectrum;;Water quality anomaly detection;;Orthogonal projection;;Supervised learning;;Partial least squares discriminatory analysis 中文刊名：GUAN 英文刊名：Spectroscopy and Spectral Analysis 机构：浙江大学控制科学与工程学院工业控制技术国家重点实验室; 出版日期：2019-02-15 出版单位：光谱学与光谱分析 年：2019 期：v.39 基金：国家自然科学基金项目(61573313,U1509208);; 国家重点研发计划项目(2017YFC1403801);; 浙江省重点研发计划项目(2015C03014)资助 语种：中文; 页：GUAN201902030 页数：9 CN：02 ISSN：11-2200/O4 分类号：165-173

摘要

水资源关系到国计民生,近年来时有发生的水污染事件使污染物入侵预警得到了广泛的社会关注。针对现有基于紫外-可见光光谱的水质异常检测方法存在的检出下限偏低的问题,提出一种基于监督学习的紫外-可见光光谱水质异常检测方法。该方法首先获取不同数据集中的正常样本差异性空间,再使用正交投影方法去除差异性空间中的光谱数据分量,以达到基线校正的目的;然后采用偏最小二乘判别分析从校正后的光谱中提取特征,利用训练集得到的最优阈值确定离群点;最后采用序贯贝叶斯滚动更新每个时刻上的异常概率,确定水质报警序列。实验选用苯酚作为模拟污染入侵事件的注入试剂,采样2周内的紫外-可见光光谱数据,在实验平台上对提出的方法进行了验证。实验结果表明,采用的正交投影基线校正方法可以消除不同批次水质光谱的背景差异,更为充分的利用了光谱信息,降低了对特征污染物的检出下限。
        Water resources are related to national economy and people's livelihood,detection of water quality anomaly has attracted more attention because of the water pollution events happened in recent years.In this paper,the detection method of water quality anomaly with UV-Vis Spectrum based on supervised learning was proposed to solve the problems of existing methods,which behaved as a high detection limit and poor adaptability method.The pretreatment of orthogonal projection was used to correct the gap between different batches of spectral data.Afterwards the Partial Least Squares Discriminatory Analysis was adopted to extract the features from the data set.Outliers were found by comparing the alarm signal with the best threshold from the training set.Finally,Sequential Bayesian Method was used to update the probability of Contaminate Intrusion Events and to get the alarm sequence.The results showed that the proposed method had the lower detection limit than unsupervised method and the pretreatment of orthogonal projection improved the adaptability of detection method based on supervised learning for baseline changing.

引文

[1] HE Hui-mei,HOU Di-bo,ZHAO Hai-feng(何慧梅,侯迪波,赵海峰).Journal of Zhejiang University(浙江大学学报·工学版),2013,(4):735.
    [2] Liu S,Smith K,Che H.Water Research,2015,80:109.
    [3] Hou D,Liu S,Zhang J,et al.Journal of Spectroscopy,2014,2014:150636.
    [4] Hou D,Zhang J,Yang Z,et al.Optics Express,2015,23(13):17487.
    [5] GUO Bing-bing,HOU Di-bo(郭冰冰,侯迪波).Spectroscopy and Spectral Analysis(光谱学与光谱分析),2017,37(5):1460.
    [6] Jean-Claude Boulet,Jean-Michel Roger,Chemometrics and Intelligent Laboratory Systems,2012,117:61.
    [7] Tormod Nzs,Tomas Isaksson,Tom Fearn,et al.A Userfriendly Guide to Multivariate Calibration and Classification.NIR Publication,2004,27.
    [8] WANG Hui-wen(王惠文).Partial Least Squares Regression Method and Application(偏最小二乘回归方法及其应用).Beijing:National Defense Industry Press(北京:国防工业出版社),1999.140.
    [9] Brereton R G,Lloyd G R.Journal of Chemometrics,2014,28:213.
    [10] Perelman L,Arad J,Housh M,et al.Environmental Science&Technology,2012,46(15):8212.
    [11] CHU Xiao-li(褚小立).Molecular Spectroscopy Analytical Technology Combined with Chemometrics and Its Applications(化学计量学方法与分子光谱分析技术).Beijing:Chemical Industry Press(北京:化学工业出版社),2011.106.
    [12] ZHOU Zhi-hua(周志华).Machine Learning(机器学习).Beijing:Tsinghua University Press(北京:清华大学出版社),2016.28.