时间序列异常值探测的Bayes方法及其在GPS数据处理中的应用
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
时间序列的观测值经常会受到异常扰动的影响,如果忽视这些影响直接进行建模和预测,就会造成虚假的后果,甚至导致错误的结果。因此,在动态测量数据分析和处理中,寻求有效的探测时间序列异常值的策略显得非常重要。
     本文在系统地回顾和总结时间序列异常值探测研究现状的基础上,应用现代Bayes统计理论和方法讨论并研究了平稳时间序列异常值的探测问题,在综合利用先验信息与观测信息的基础上,系统地提出了平稳时间序列异常值探测的Bayes方法。进一步,将平稳时间序列异常值探测的Bayes方法应用到GPS数据处理中,优化了GPS钟差序列和电离层VTEC序列的建模和预报方法。
     本文的主要工作和创新点如下:
     1.总结和分析了现有的时间序列异常值探测方法。概述了线性平稳时间序列的三种模型,指出了时间序列中若出现异常值将会对时间序列建模和预测的影响,回顾和总结了现有的时间序列异常值探测方法,并分析和指出了这些方法的局限性。
     2.提出了时间序列异常值定位的Bayes方法。在一定的限制条件下,将时间序列的异常值定位问题转化为线性回归模型的异常值定位问题,结合线性回归模型异常值定位的Bayes方法,提出了时间序列异常值定位的Bayes方法,并进一步给出了无信息先验下和正态—Gamma先验下基于均值漂移模型和方差膨胀模型的后验概率的Bayes公式。
     3.提出了时间序列异常值估计的Bayes方法。应用Bayes统计理论,分别在无信息先验分布和正态—Gamma先验分布条件下建立了时间序列异常扰动的Bayes估值公式,进一步完善了时间序列异常值探测的Bayes理论和方法。
     4.提出了GPS时间序列建模的Box—Jenkins法和异常值探测的Bayes方法。对GPS卫星钟差序列和电离层VTEC序列进行了Box-Jenkins建模,采用上述Bayes方法探测序列中的异常值并对异常值进行修正,提高了GPS卫星钟差预报和电离层VTEC预报的精度。理论分析和大量的数值试验都表明,本文提出的时间序列异常值探测的Bayes方法具有很好的可靠性和适用性。
The observation of time series may be influenced by outliers. If we forecasts directly, neglecting the influence, will lead to false result. So, in dynamic surveying data analysis and data processing practice, the seeking for approaches to dealing with time series outliers becomes very important.
     On the basis of reviewing and summarizing the actual researching state of time series outliers detection systemically, this paper will mainly discuss the approaches to outliers detection in time series utilizing the modern Bayesian theories and methods. And syncretizing prior information with observing information, Bayesian method for outliers detection in stationary time series is put forward. Furthermore, the method is applied in the research on the data processing of GPS; also optimize the modeling and predicting methods of clock error and VTEC series.
     The main conclusions are as follows:
     1. Firstly, we summarized and analyzed the outliers detecting methods in the present. This paper divided the stationary time series into three classes, then pointed out the influence on modeling and predicting,when there are outliers in time series. Furthermore, reviewed and summarized traditional outliers detecting method. Finally, suggested the limitation of traditional methods.
     2. Bayesian method for outliers positioning were given secondly. Given some special restrictions, we can change time series outliers positioning into outliers positioning in linear regression model. Based on the theory of Bayesian Statistical diagnostics, we put forward Bayesian method of outliers positioning. And then, under the condition of both the non-informative priors and normal-gamma prior information, Bayesian method for posterior probability calculating were given respectively.
     3. Bayesian methods for outliers estimating were given thirdly. Applying Bayesian statistical estimating theory, under the condition of both the non-informative priors and normal-gamma prior information, Bayesian estimations for outliers are given respectively to perfect outliers estimations as one important aspect of outliers detecting.
     4. Box-Jenkins modeling method on GPS time series and Bayesian method for outliers detecting were put forward. Then modeling the GPS clock error series and ionospheric VTEC series with Box-Jenkins method, At last, modify the outliers with the new method, improving the predicting accuracy of the GPS clock error series and ionospheric VTEC series.
     Theoretical analysis and mass numerical examples demonstrate that the new method is useful and efficient.
引文
[1] Whitehead, B., Hoyt, W.A. Function approximation approach to anomaly detection in propulsion system test data[J]. Journal of Propulsion and Power, 1995, 11(5):1074-1076.
    [2] Decoste, D. Mining multivariate time-series sensor data to discover behavior envelopes[R]. Proc of the 3rd Conference on Knowledge Discovery and Data-Mining, [S.l.]:AAAI Press, 1997, 151-154.
    [3] Dasgupt, A.D., Forrest, S. Novelty detection in time series data-using ideas from immunology[R]. Proc of the 5th International Conference on Intelligent Systems, 1996, 82-87.
    [4] Ma, J., Perkins, S. Time-series novelty detection using one-class support vector machines[R]. Proc of International Joint Conference on Neural Networks, 2003.
    [5] Ma, J., Perkins, S. Online novelty detection on temporal sequences[M]. ACM Press, New York, 2003.
    [6] Borisyuk, R., Denham, M., Hoppenstead, T.F., et al. An oscillatory neural network model of sparse distributed memory and novelty detection[J]. Bio-Systems, 2000, 58 (1):265-272.
    [7] Shahab, I.C., Tian, X., Zhao, W. A wavelet-based approach to improve the efficiency of multi-level surprise and trend queries[J]. Proc of the 12th International Conference on Scientific and Statistical Data-base Management, IEEE Computer Society, Washington DC, 2000, 55-68.
    [8] Chakrabarti, S., Saraqwagi, S., Dom, B. Mining surprising patterns using temporal description length[M]. Morgan Kaufmann Publishers, San Francisco, 1998, 606-617.
    [9] Yamanish, I.K., Takeuch, I.J. A unifying framework for detecting outliers and change points from non-stationary time series data[M]. ACM Press, New York, 2002, 676-681.
    [10] Jagadish, H.V., Koudas, N., Muthukrishnan, S. Mining deviants in a time series data base[M]. S Morgan Kaufmann Publishers, San Francisco, 1999, 102-113.
    [11] Deutsch, D., Richards, Swain, J.J. Effects of a signal outlier on ARMA identification[J]. Communications in Statistics, Theory and methods, 1990, 19:2207-2227.
    [12] Kleiner, B., Martin, R.D., Thomson, D.J. Robust estimation of power spectra[J]. Journal of the Royal Statistical Society, Series B, 1979, 41:313-351.
    [13] Ledolter, J. The effect of additive outliers on the forecasts from ARIMA models[J]. International Journal of Forecasting, 1989, 5:231-240.
    [14] Hotta, L.K. The effect of additive outliers on the estimates from aggregated and disaggregated ARIMA models[J]. International Journal of Forecasting, 1993, 9:85-93.
    [15]茆诗松.贝叶斯统计学[M].北京:中国统计出版社,1999.
    [16]吴喜之.现代贝叶斯统计学[M].北京:中国统计出版社,2000.
    [17] Fox, A.J. Outliers in time series[J]. Journal of the Royal Statistical Society, Series B, 1972, 34:350-363.
    [18] Ledolter, J. Outlier diagnostics in time series analysis[J]. Journal of Time Series Analysis, 1990, 11:317-324.
    [19] Ljung, G.M. On outlier detection in time series[J]. Journal of the Royal Statistical Society, Series B, 1993, 55:559-567.
    [20] Muirhead, C.R. Distinguishing outlier types in time series[J]. Journal of the Royal Statistical Society, Series B, 1986, 48:39-47.
    [21] Chang, I., Tiao, G.C., Chen, C. Estimation of time series parameters in the presence of outliers[J]. Technometrics, 1988, 30:193-204.
    [22] Tsay, R.S. Time series model specification in the presence of outliers[J]. Journal of the American Statistical Association, 1986, 81:132-141.
    [23] Tsay, R.S. Outliers, level shifts, and variance changes in time series[J]. Journal of Forecasting, 1988, 7:1-20.
    [24] Chen, C., Liu, L.M. Joint estimation of model parameters and outlier effects in time series[J]. Journal of the American Statistical Association, 1993, 88:284-297.
    [25] Wu, L.S.Y., Hosking, J.R.M., Ravishanker, N. Reallocation outliers in time series[J]. Journal of the Royal Statistical Society, Series C, 1993, 42:301-313.
    [26] Abraham, B., Box, G.E.P. Linear models and spurious observations[J]. Appl. Statist. 1978, 131-138.
    [27] Abraham, B., Box, G.E.P. Bayesian analysis of some outlier problems in time series[J]. Biometrika, 1979, 66:229-236.
    [28] Broemeling, L., Shaarawy, S. Time series: A Bayesian analysis in the time domain[M]. Bayesian analysis of time series and dynamic models, Marcel Dekker, New York, 1988.
    [29] McCulloch, R.E., Tsay, R.S. Bayesian inference and prediction for mean and variance shifts in autoregressive time series[J]. Journal of the American Statistical Association, 1993, 88:968-978.
    [30] McCulloch, R.E., Tsay, R.S. Bayesian analysis of autoregressive time series via the Gibbs sampler[J]. Journal of Time Series Analysis, 1994, 15:235-250.
    [31] Justel, A., Pena, D., Tsay, R.S. Detection of outlier patches in autoregressive time series[J]. Working Paper, University of Chicago, Graduate School of Business, 1998.
    [32] Schervish, M.J., Tsay, R.S. Bayesian modeling and forecasting in autoregressive models[M]. Bayesian analysis of time series and dynamic models. Marcel Dekker, New York, 1988.
    [33] Box, G.E.P., Tiao, G.C. A Bayesian approach to some outlier problems[J]. Biometrika, 1968, 55:119 -129.
    [34]欧吉坤.测量数据的质量控制理论探讨[J].测绘工程,2001, 10 (2):6-10.
    [35] Bossler, J.D. Bayesian Inference in Geodesy[D]. The Ohio State University, Columbus, 1972.
    [36] Bossler, J.D., Hanson, R.H. Application of Special Variance Estimators to Geodesy[R]. NOAA Technical Report NOS 84 NGS 15, US Department of Commerce, National Geodetic Survey, Rockville, 1980.
    [37] Bock, Y. Estimating Crustal Deformations from a Combination of Baseline Measurements and Geophysical models[J]. Bull. Geod., 1983, 57:294-311.
    [38] Koch, K.R. Bayesian Inference for Variance Components[J]. Manuscr. Geod., 1987, 12:309-313.
    [39] Koch, K.R. Bayesian Statistics for Variance Components with Informative and Non-informative Prior[J]. Manuscr. Geod., 1988, 13:370-373.
    [40] Schaffrin, B. Approximating the Bayesian Estimate of the Standard Deviation in a Linear Model[J]. Bull. Geod., 1987, 61:276-280.
    [41] Ou, Z. Bayesian Inference for Variance Factor with Maximum Entropy Prior[J]. Manuscr. Geod., 1993, 18:242-247.
    [42] Ou, Z., Koch, K.R. Analytical Expressions for Bayes Estimates of Variance Components[J]. Manuscr. Geod., 1994, 19:284-293.
    [43] Xu, P. Least squares Collocation with Incorrect Prior Information[J]. Z Vermess Wes, 1991, 116:266-273.
    [44] Yang, Y. Robust Bayesian Estimation[J]. Bull. Geod., 1991, 65:145-150.
    [45] Zhu, J. Bayesian Hypothesis Test for Determination Analysis[J]. Geomatica, 1995, 49:283-288.
    [46] Zhu, J. Sensitivity and Separability of Deformation Models with Regard to Prior Information[J]. Transactions of Nonferrous Metals Society of China, 1997, 7(4):156-159.
    [47] Zhu, J., Santerre, R. Improvement of GPS Phase Ambiguity Resolution Using Prior Height Information as a Quasi-observation[J]. Geomatica, 2002, 56:211-221.
    [48] de Lacy, M.C., Sanso, F., Rodriguez-Caderot, G., Gil, A.J. The Bayesian Approach Applied to GPS Ambiguity Resolution. A Mixture Model for the Discrete-real Ambiguities Alternative[J]. J. Geod., 2002, 76:82-94.
    [49]王振龙,胡永宏.应用时间序列分析[M].北京:科学出版社,2007.
    [50]韦博成,鲁国斌,史建清.统计诊断引论[M].南京:东南大学出版社,1991.
    [51]张树京,齐立新.时间序列分析简明教程[M].北京:清华大学出版社,2003.
    [52]李莉莉.非时期经济时间序列分析及应用[D].山东师范大学, 2000.
    [53] Akaike, H. Fitting autoregressive model for prediction[J]. Ann. Inst. Statist. Math., 1969, 21:243-247.
    [54] Akaike, H. A new look at the statistical model identification[J]. IEEE Transactions on Automatic Control, 1974, 716-723.
    [55] Schwarz, G.E. Estimating the dimension of a model[J]. Annals of Statistics, 1978, 6 (2): 461-464.
    [56]潘国荣.基于时间序列分析的动态变形预测模型研究[J].武汉大学学报(信息科学版),2005, 30(6): 483-487.
    [57]何书元.应用时间序列分析[M].北京:高等教育出版社,2003.
    [58] Koch, K.R. Parameter Estimation and Hypothesis Testing in Linear Models(2nd Ed.)[M]. Springer, Berlin, 1999.
    [59] Koch, K.R. Einfuhrung in Die Bayes-Statistic[M]. Springer, Berlin, 2000.
    [60] Broemeling, L.D. Bayesian Analysis of Linear Models[M]. Marcel Dekker, New York, 1985.
    [61]王惠南.GPS导航原理与应用[M].北京:科学出版社,2003.
    [62] Matosevic, M., Salcic, Z. A comparison of accuracy using a GPS and a low-cost DGPS[J]. IEEE Transactions on Instrumentation and Measurement, 2006, 55(5):1677-1683.
    [63] Rees, W.G. Improving the accuracy of low-cost GPS measurements for remote sensing applications[J]. International Journal of Remote Sensing, 2001, 22(5):871-881.
    [64] Zuo, W., Song, F. An autonomous navigation scheme using global positioning system/geomagnetism integration for small satellites[J]. Proc Instn Mech Engrs, 2000, 214(G):207-215.
    [65] Xue, Y., Cracknell, A.P., Guo, H.D. Telegeoprocessing: the integration of remote sensing, Geographic Information System(GIS), Global Positioning System(GPS) and telecommunication[J]. International Journal of Remote Sensing, 2002, 23(9):1851-1893.
    [66] Filjar, R., Kos, T., Markezic, I. GPS ionospheric error correction models[R]. 48th International Symposium ELMAR2006, Zadar, 2006.
    [67] Franchois, A., Roelens, L. Determination of GPS positioning errors due to multi-path in civil aviation[J]. Recent Advance in Space Technologies, 2005.
    [68]曹力,黄圣国.GPS误差的时间序列分析建模研究[J].计算机工程与应用,2005, 41(35):213-216.
    [69]杜鹏,傅梦印,张鸿业. GPS定位误差分析与建模[J].北京理工大学学报,1998, 18(4):456-460.
    [70]张淑芳,袁安存.一种以自主方式提高GPS定位精度的方法[J].电子学报,1999, 27(8):25-27.
    [71] Zhang, S.F., Liu, R.J. A rapid algorithm for on-line and real-time ARMA modeling[C]. Proceeding of ICSP, 2000, 230-233.
    [72]张朝玉.多维AR序列的最小二乘建模方法[J].武汉大学学报,2002,27(4):378-381.
    [73]朱虹,关永,田健仲,关桂霞.单点GPS定位误差建模研究[J].微计算机信息(测控自动化),2008, 24: 206-208.
    [74]刘娣,薄煜明,邹卫军.基于时间序列的GPS误差建模及单点定位精度研究[J].兵工学报,2009, 30(6):825-828.
    [75]滕云龙,师奕兵.GPS载波相位测量数据的时间序列分析建模研究[J].电子测量与仪器学报,2009, 23(9):18-22.
    [76]乔力争,曾元鉴.GPS定位误差分析与建模[J].海军工程学报,1996, 76(3):45-51.
    [77]刘利.相对论时间比对理论与高精度时间同步技术[D].郑州:解放军信息工程大学,2004.
    [78]徐君毅,戴伟.一种新的长期卫星钟差预报方法[J].大地测量与地球动力学,2009, 29(6):97-100.
    [79]崔先强,焦文海.灰色系统模型在卫星钟差预报中的应用[J].武汉大学学报(信息科学版),2005, 30(5):447-450.
    [80]路晓峰,杨志强,贾小林,崔先强.灰色系统理论的优化方法及其在卫星钟差预报中的应用[J].武汉大学学报(信息科学版),2008, 33(5):492-495.
    [81]徐君毅,曾安敏. ARIMA(0,2,q)模型在卫星钟差预报中的应用[J].大地测量与地球动力学,2009, 29(5):116-120.
    [82]李维鹏.电离层总电子含量预报研究[D].郑州:解放军信息工程大学,2009.
    [83]张小红,李征航,蔡昌盛.用双频GPS观测值建立小区域电离层延迟模型研究[J].武汉大学学报(信息科学版),2001, 26(2):140-143.
    [84]焦明连,蒋廷臣,王秀萍.基于GNSS的电离层模型研究进展[J].测绘科学,2008, 33(5):91-93.
    [85] Arikan, O., Arikan, F., Erol, C.B. Computerized ionospheric tomography with the IRI model[J]. Advances in Space Research, 2007, 39: 859-866.
    [86]李志刚,程宗颐,冯初刚.电离层预报模型研究[J].地球物理学报,2007, 50(2):327-337.
    [87]武文俊,李志刚,杨旭海.利用时间序列模型预报电离层TEC[J].时间频率学报,2008, 31(2):141- 146.
    [88]李志刚,李伟超,程宗颐.电离层TEC预报的直接法和间接法及其比较[J].天文学报,2008, 49(1): 29-44.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700