带参考信号的独立分量分析理论及其应用研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
对多元统计信号的探索一直是信息科学领域的热门研究课题,如何发现多元信号中的内在因素或者分量是该领域的研究重点之一。独立分量分析这种多元统计分析方法作为近年来人工神经网络、统计学习理论、信号处理等研究领域中的热点问题,它的一些成果已经应用到多个实际问题当中,证明了其广阔的应用价值。
     独立分量分析是盲源信号处理的一个分支,该理论假设多元观察信号是由多个相互独立的非高斯信号线性混合而成的。在很多实际应用领域中,我们对所需要获得的独立分量有部分先验信息,然而经典的独立分量分析方法首先需要把所有的独立分量都恢复出来,然后再由用户通过先验信息来选择自己所感兴趣的独立分量。这样的方法一般存在耗时,输出结果不稳定等问题。在遇到高维问题时,经典方法甚至可能出现完全失效的情况。本文研究的核心内容就是如何使用带先验信息的参考信号来直接抽取所感兴趣的独立分量。
     本文的主要贡献总结为如下几点:
     1.严格推导了约束独立分量分析框架下的带参考信号的独立分量分析问题的学习公式,发现原来的算法中存在的推导错误等,提出了修正的约束独立分量分析框架下的带参考信号的独立分量分析算法,并在理论上证明了算法改进的正确性,同时通过模拟实验和实际数据实验验证了修正后算法的有效性。
     2.研究了约束独立分量分析框架下的带参考信号的独立分量分析的收敛不稳定问题,发现了问题的原因在于ICA-R优化目标函数在不等式约的可行区域内不一定为凸函数,也就是KT条件不是全局充分的,那么采用类似牛顿法的优化算法是不能够保证获得全局最优值的。一般来说,采用贪婪策略的算法(每一次迭代都降低目标函数)都会出现误收敛的情况,所以算法的输出不稳定。在这种情况下,我们提出了新的ICA-R算法,在算法中我们引入了在算法早期判断误收敛的技术,解决了算法误收敛的问题,并且在实验中证明了新算法的误收敛率为0。
     3.研究了ICA-R的应用方法。在ICA-R应用中距离阈值参数的选择往往决定了算法的成功和失败。我们提出了合理选择ICA-R阈值参数方法,包括参考信号收缩方法来灵活的选择参数等。我们提出并证明了直接采用观测通道作为参考信号的可行性,简化了ICA-R的应用,使得参考信号在某些条件下并不需要手工构造就可以直接获得。
     4.提出了Complete ICA-R的方法。通过研究发现Complete ICA-R和传统ICA方法相比,是一种非常灵活的ICA算法,它不再通过强行的去相关化来防止同一性收敛问题,因此它的输出更好的保留了数据的内部特性。我们通过理论证明和实验结果说明了Complete ICA-R的输出质量确实要优于传统的ICA算法,特别是Complete ICA-R在某些应用中(观测信号多于独立分量时)还可以帮助研究人员判断独立分量的数量。
     5.提出了非约束独立分量分析框架下的带参考信号的独立分量分析方法。我们认为作为先验信息载体的参考信号不仅可以用作ICA算法的约束条件,从而提出约束独立分量分析框架,而且也可以用在ICA算法之前使用参考信号。我们提出了采用参考信号来设置初始权值向量的方法,发现使用这个预设的权值向量后,ICA算法可以收敛到需要的独立分量上,以完成带参考信号独立分量分析的任务。并且我们证明了这个方法的有效性和适用条件。
     6.发现并证明了原来约束独立分量分析框架的理论漏洞,提出了新的普适的带参考信号的独立分量分析算法框架,弥补了旧理论框架的漏洞。
The study of multivariate stochastic signals is a hot topic in information science field. The mainstream researches on this topic are how to discover the inherent factors or components from the multivariate stochastic signals. Recently, the independent component analysis (ICA) becomes a hotspot problem in artificial neural networks, statistical learning, signal processing, and etc. The high applied value of ICA has been verified by many successful applications of ICA in various fields.
     ICA is a research branch of blind source separation (BSS), which theoretically assumes that the observed multivariate signals are the linear mixtures of independent components (ICs) with non-Gaussian distributions. In many fields, researchers have some prior information on the desired ICs. However, the classic ICA methods have to calculate all the ICs and then choose the desired ICs by post-selection which is not only time-consuming but also unstable. And when the dimentsion of input data is high, the classic ICA methods maybe unable toproduce any correct results. The aim of this paper is to study how to use prior information, in the form of reference signals, to extract the desired ICs directly.
     The main contributions of the paper can be summarized as follows:
     1. We rigidly derived algorithm for the ICA with reference signals (ICA-R) under constrained ICA (cICA) framework, and found flaws in the previous works, then proposed an improved algorithm whose validity was proved not only by theoretical analyses but also by simulation on both artificial and real-world data.
     2. We probed problem of the unstable convergence of those previous ICA-R algorithms (under the framework of cICA) and found the reason was that the ICA contrast function can be nonconvex in the feasible region defined by the inequality constraint, which means that the KT condition is not globally sufficient. As the result, using Newton-like optimization algorithm (and other greedy algorithm) cannot guarantee the correct convergence. The proposed new ICA-R algorithm which can predict the future incorrect convergence was presented so as to avoid the instability of the previous algorithms which was confirmed by our experiments from which no incorrect convergence of the new algorithm was observed.
     3. We studied how to facilitate the application of the ICA-R algorithm. Since the parameter (or threshold) measuring the distance between reference signal and output is critical, we proposed a method that facilitates the parameter selection including reference deflation method and etc. Then we suggested that it is convenient to use one of the observed data channel as reference signal in some applications instead of concocting reference signal by manpower.
     4. We proposed the Complete ICA-R method for recovering all the underlying components as other classic ICAs done but without compulsively decorrelating the outputs. Therefore, the Complete ICA-R is flexible so as to remain the inherent structures of the outputs. The experimental results indicated that the Complete ICA-R algorithm would produce the outputs with better quality result compared to the classic methods. Particularly, the proposed Complete ICA-R has a unique feature which could help the users to judge the number of ICs when the number of the observed channels are more than the number of underlying components.
     5. A new method for ICA-R was presented which was not under the framework of cICA. The prior information in the form of reference signal should be used not only as a constraint which was the basic ideal of cICA but also before the learning of the weight vector. In this paper, an approach was proposed which used the reference to build the initial weight vector. It was found that the one-unit ICA algorithm could find the right demixing vector with the predesigned weight vector under some conditions. Moreover, the validity of the approach was proved and the detailed algorithm was presented.
     6. The theoretical flaw of the framework of cICA was found and proved in our work. In addition, we also proposed the new framework of ICA-R which can remedy the previous general framework of ICA-R.
引文
AMARI S, CHEN T P, CICHOCKI A 1997. Stability analysis of learning algorithms for blind source separation. Neural Networks [J],10:1345-1351.
    AMARI S I, CICHOCKI A 1998. Adaptive blind signal processing-Neural network approaches. Proceedings of the Ieee [J],86:2026-2048.
    AMARI S I, HYVARINEN A, LEE S Y, et al 2002.Blind signal separation and independent component analysis. Neurocomputing [J],49:1-5.
    BACK A D, WEIGEND A S 1997. A first application of independent component analysis to extracting structure from stock returns. International Journal of Neural Systems [J],8: 473-484.
    BACK A D, WEIGEND A S 1998. What drives stock returns? An independent component analysis. Proceedings of the Ieee/Iafe/Informs 1998 Conference on Computational Intelligence for Financial Engineering (Cifer) [J]:141-156
    BARROS A K, VIGARIO R, JOUSMAKI V, et al.2000. Extraction of event-related signals from multichannel bioelectrical measurements. Ieee Transactions on Biomedical Engineering [J],47:583-588.
    BELL A J, SEJNOWSKI T J 1996. Learning the higher-order structure of a natural sound. Network-Computation in Neural Systems [J],7:261-267.
    BELL A J, SEJNOWSKI T J 1997. The "independent components" of natural scenes are edge filters. Vision Research [J],37:3327-3338.
    CARDOSO J F 1998a. Blind signal separation:Statistical principles. Proceedings of the Ieee [J], 86:2009-2025.
    CARDOSO J F 1998b. Statistical principles of source separation. (Sysid'97):System Identification, Vols 1-3 [J]:9-16
    CARDOSO J F 1999. High-order contrasts for independent component analysis. Neural Computation [J],11:157-192.
    CARDOSO J F, COMON P 1996. Independent component analysis, a survey of some algebraic methods. Iscas 96:1996 Ieee International Symposium on Circuits and Systems-Circuits and Systems Connecting the World, Vol 2 [J]:93-96
    COMON P 1994. Independent Component Analysis, a New Concept. Signal Processing [J],36: 287-314.
    ERFANI A, NASAB M F 2007. Enhancement of epileptic seizure in EEG signals using novelty filtering based on neural networks.3rd Kuala Lumpur International Conference on Biomedical Engineering 2006 [J],15:383-386
    HAM F M, PARK S, WHEELER J C 2000. Separation of infrasound signals using independent component analysis. Applications and Science of Computational Intelligence Iii [J],4055: 418-429
    HUANG D S, MI J X 2007. A new constrained independent component analysis method. Ieee Transactions on Neural Networks [J],18:1532-1535.
    HYVARINEN A 1997a. A family of fixed-point algorithms for independent component analysis. 1997 Ieee International Conference on Acoustics, Speech, and Signal Processing, Vols Ⅰ-Ⅴ[J]:3917-3920
    HYVARINEN A 1997b. One-unit contrast functions for independent component analysis:A statistical analysis. Neural Networks for Signal Processing ⅶ[J]:388-397
    HYVARINEN A 1998. New approximations of differential entropy for independent component analysis and projection pursuit. Advances in Neural Information Processing Systems 10 [J],10:273-279
    HYVARINEN A 1999a. Fast and robust fixed-point algorithms for independent component analysis. Ieee Transactions on Neural Networks [J],10:626-634.
    HYVARINEN A 1999b. Fast ICA for noisy data using gaussian moments. Iscas'99:Proceedings of the 1999 Ieee International Symposium on Circuits and Systems, Vol 5 [J]:57-61
    HYVARINEN A 1999c. The fixed-point algorithm and maximum likelihood estimation for independent component analysis. Neural Processing Letters [J],10:1-5.
    HYVARINEN A, OJA E 1997a. A fast fixed-point algorithm for independent component analysis. Neural Computation [J],9:1483-1492.
    HYVARINEN A, OJA E 1997b. One-unit learning rules for independent component analysis. Advances in Neural Information Processing Systems 9 [J],9:480-486
    HYVARINEN A, OJA E 2000. Independent component analysis:algorithms and applications. Neural Networks [J],13:411-430.
    JAIN A K, DUIN R P W, MAO J C 2000. Statistical pattern recognition:A review. Ieee Transactions on Pattern Analysis and Machine Intelligence [J],22:4-37.
    JAMES C J, GIBSON O J 2003. Temporally constrained ICA:An application to artifact rejection in electromagnetic brain signal analysis. Ieee!Transactions on Biomedical Engineering [J], 50:1108-1116.
    JOSHUA L K L, RAJAPAKSE J C 2005. Extraction of event-related potentials from EEG signals using ICA with reference. Proceedings of the International Joint Conference on Neural Networks (Ijcnn), Vols 1-5 [J]:2526-2531
    JOUTSENSALO J, PAJUNEN P 1998.Blind symbol learning algorithms for CDMA system. leee World Congress on Computational Intelligence [J]:152-155
    KAYSER J, BRUDER G E, TENKE C E, et al.2001. Event-related brain potentials (ERPs) in schizophrenia for tonal and phonetic oddball tasks. Biological Psychiatry [J],49: 832-847.
    LASHKARI D, VUL E, KANWISHER.N, et al.2010. Discovering structure in the space of fMRI selectivity profiles. Neuroimage [J],50:1085-1098.
    LEMM S, CURIO G, HLUSHCHUK. Y, et al.2006. Enhancing the signal-to-noise ratio of ICA-based extracted ERPs. Ieee Transactions on Biomedical Engineering [J],53: 601-607.
    LI N, CHEN M C, FANG Y J, et al.2006. Fault diagnose of rotating system based on ICA with reference and RBF networks. Proceedings of the 2006 Ieee International Conference on Networking, Sensing and Control [J]:174-178
    LI R J, PRINCIPE J C, BRADLEY M, et al.2007. Robust single-trial ERP estimation based on spatiotemporal filtering.2007 Annual International Conference of the Ieee Engineering in Medicine and Biology Society, Vols 1-16 [J]:5206-5209
    LI Y O, ADALI T, CALHOUN V D 2005. Feature-selective ICA and its convergence properties. 2005 Ieee International Conference on Acoustics, Speech, and Signal Processing, Vols 1-5 [J]:265-268
    LIN Q H, ZHENG Y R, YIN F L, et al.2004. Speech segregation using constrained ICA. Advances in Neural Networks-Isnn 2004, Pt 1 [J],3173:755-760.
    LU W, RAJAPAKSE J C 2005. Approach and applications of constrained ICA. Ieee Transactions on Neural Networks [J],16:203-212.
    MCKEOWN M J, MAKEIG S, BROWN G G, et al.1998. Analysis of fMRI data by blind separation into independent spatial components. Human Brain Mapping [J],6:160-188.
    NAIK G R, KUMAR D K, PALANISWAMI M 2008. Multi run ICA and surface EMG based signal processing system for recognising hand gestures.2008 Ieee 8th International Conference on Computer and Information Technology, Vols 1 and 2 [J]:700-705
    NAIK G R, KUMAR D K, WEGHORN H 2007. ICA based identification of sources in sEMG. Proceedings of the 2007 International Conference on Intelligent Sensors, Sensor Networks and Information Processing [J]:619-624
    NAKHATE S, SINGH R P, SOMKUWAR A 2010. Speech Enhancement Using Independent Component Analysis Based on Entropy Maximization. Iccnt 2009:Proceedings of the 2009 International Conference on Computer and Network Technology [J]:154-158
    NATH M K 2009. Independent Component Analysis of Real Data. Icapr 2009:Seventh International Conference on Advances in Pattern Recognition, Proceedings [J]:149-152
    NIINO Y, SHIRAISHI T, MORISHITA S 2009. Blind Source Separation Using a Neural Network. Imece 2008:Mechanical Systems and Control, Vol 11 [J]:211-217
    NORBERT W 1949. Extrapolation, Interpolation, and Smoothing of Stationary Time Series [M], New York:Wiley.
    OJA E 1997. The nonlinear PCA learning rule in independent component analysis. Neurocomputing [J],17:25-45.
    OJA E 1998. From neural learning to independent components. Neurocomputing [J],22:187-199.
    OLLILA E 2010. The Deflation-Based FastICA Estimator:Statistical Analysis Revisited. Ieee Transactions on Signal Processing [J],58:1527-1541.
    OMAM M A, TORKAMANI-AZAR F 2010. Band selection of hyperspectral-image based weighted indipendent component analysis. Optical Review [J],17:367-370.
    PARK S, LEE H, CHOI S 2003. ICA plus OPCA for artifact-robust classification of EEG data. 2003 Ieee Xiii Workshop on Neural Networks for Signal Processing-Nnsp′03 [J]: 585-594
    PHAM D T 2000. Blind separation of instantaneous mixture of sources based on order statistics. Ieee Transactions on Signal Processing [J],48:363-375.
    POPE K J, BOGNER R E 1996. Blind signal separation.1. Linear, instantaneous combinations. Digital Signal Processing [J],6:5-16.
    QIAN Z J, ABDEL-RAHMAN O, BATARSEH I 2010. An Integrated Four-Port DC/DC Converter for Renewable Energy Applications. Ieee Transactions on Power Electronics [J], 25:1877-1887.
    ROBERTSON F C, DOUGLAS T S, MEINTJES E M 2010. Motion Artifact Removal for Functional Near Infrared Spectroscopy:A Comparison of Methods. Ieee Transactions on Biomedical Engineering [J],57:1377-1387.
    SCHOEPF V, KOPIETZ R, ALBRECHT J, et al. 2008. An Fmri Validation Study Using Independent Component Analysis (ICA). Chemical Senses [J],33:S112-S112.
    SERDENGECTI C, ENGIN M, ENGIN E Z, et al.2009. Extraction of Fetal ECG from Maternal ECG. Biyomut: 2009 14th National Biomedical Engineering Meeting [J]:416-418
    SHI Z N, SCHLEGEL C 2006. Iterative multiuser detection and error control code decoding in random CDMA. Ieee Transactions on Signal Processing [J],54:1886-1895.
    TANGKRAINGKIJ P, LURSINSAP C, SANGUANSINTUKUL S, et al.2010. Personal Identification by EEG Using ICA and Neural Network. Computational Science and Its Applications-Iccsa 2010, Pt 3, Proceedings [J],6018:419-430
    VAROQUAUX G, SADAGHIANI S, PINEL P, et al.2010. A group model for stable multi-subject ICA on fMRI datasets. Neuroimage [J],51:288-299.
    VENTOURAS E M, KTONAS P Y, TSEKOU H, et al.2008. Slow and fast EEG sleep spindle component extraction using Independent Component Analysis.8th Ieee International Conference on Bioinformatics and'Bioengineering, Vols 1 and 2 [J]:1016-1021
    VIGARIO R, SARELA J, JOUSMAKI V, et al. 2000. Independent component approach to the analysis of EEG and MEG recordings. Ieee Transactions on Biomedical Engineering [J], 47:589-593.
    VULLINGS R, PETERS C, MISCHI M, et al.2006. Maternal ECG removal from non-invasive fetal ECG recordings. 2006 28th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vols 1-15 [J]:1059-1062
    WACHOWIAK M, SMOLIKOVA R, TOURASSI G, et al.2002. Separation of cardiac artifacts from EMG signals with independent component analysis. Analysis of Biomedical Signals and Images, Proceedings [J]:23-26
    WEI L, RAJAPAKSE J C 2006. ICA with Reference. Neurocomputing [J],69:2244-2257.
    YE Y L, ZHANG Z L, ZENG J S, et al. 2008. A fast and adaptive ICA algorithm with its application to fetal electrocardiogram extraction. Applied Mathematics and Computation [J],205:799-806.
    YLIPAVALNIEMI J, VIGARIO R 2008. Analyzing consistency of independent components:An fMRI illustration. Neuroimage [J],39:169-180.
    YPMA A, LESHEM A, DUIN R P W 2002. Blind separation of rotating machine sources:bilinear forms and convolutive mixtures. Neurocomputing [J],49:349-368.
    ZARZOSO V, NANDI A K 2001. Noninvasive fetal electrocardiogram extraction:Blind separation versus adaptive noise cancellation. Ieee Transactions on Biomedical Engineering [J],48:12-18.
    ZHANG H F, XIAO W S, LI W C, et al.2010. Signal Extraction Based on Modified nc-FastICA. Proceedings of 2010 International Symposium on Image Analysis and Signal Processing [J]:237-240
    ZHANG Z L 2008. Morphologically constrained ICA for extracting weak temporally correlated signals. Neurocomputing [J],71:1669-1679.
    ZHANG Z L, ZHANG Y 2006. Extraction of temporally correlated sources with its application to non-invasive fetal electrocardiogram extraction. Neurocomputing [J],69:894-899.
    ZHAO Y L, WANG L M, HAN Y 2010. The restoration of X-ray radiograph based on ICA. Nuclear Instruments & Methods in Physics Research Section a-Accelerators Spectrometers Detectors and Associated Equipment [J],614:227-230.
    ZUO X N, KELLY C, ADELSTEIN J S, et al.2010. Reliable intrinsic connectivity networks: Test-retest evaluation using ICA and dual regression approach. Neuroimage [J],49: 2163-2177.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700