扩展独立成分分析的若干算法及其应用研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
独立成分分析(Independent Component Analysis,ICA)是一种新兴的数据处理与分析方法,主要用于在源信号和混合信道未知的情况下,从观测数据来提取原始的独立源信号。近年来,该方法已经成功地应用于语音信号处理、生物医学信号处理、神经计算、图像特征提取、远程通信、人脸识别等众多领域。ICA具有广阔的应用前景,吸引了众多的科研工作者献身其中,因此近些年获得了长足的发展。然而,ICA的研究尚处于发展阶段,仍有许多问题有待进一步深入研究和解决。
     本文首先对ICA的国内外研究现状以及应用作了较详细的介绍,然后介绍了标准ICA和扩展ICA的相关知识。最后,针对ICA现有的几个问题,例如按顺序输出独立成分、只提取一个或多个感兴趣信号的盲抽取问题以及带噪观测信号的盲信号分离问题等进行了研究,提出了几个较为有效的算法。本文的主要工作概括如下:
     1.针对独立成分输出顺序的不确定性问题,提出了一种基于约束ICA模型的排序算法。由于现有的标准ICA算法往往仅探求独立成分的方向,认为所得到的源信号的顺序对于通常所考虑的问题影响不大,从而忽略了这种不确定性。然而,在某些特殊应用中,确定输出成分的顺序是必需的。针对这种需要,本文提出了一种基于投影方法的约束ICA模型,根据某些统计量的大小来规定输出成分的顺序,并结合NewFP算法得到了相应的约束不动点算法。由于算法是不动点型算法,从而避免了其它梯度型算法中学习率的选择问题。基于模拟信号、语音信号的仿真实验以及实际的胎儿心电数据的处理结果证实了算法的有效性。
     2.针对时间ICA的盲源抽取问题,提出了两个基于待抽取信号时间结构特性的盲抽取算法。首先,利用待抽取信号的广义自相关性以及其新息的非高斯性,提出了基于两者的凸组合模型,得到了梯度型的盲抽取算法,并在理论上给出了算法的稳定性分析。与一般的只利用非高斯性或只利用时间结构性的算法不同,该算法有效结合了这两个特性,从而能够较大限度地挖掘数据中的隐含的信息。在图像数据以及胎儿心电信号的抽取实验中,取得了较好的抽取效果。其次,以待抽取信号的先验参考信息为基础,将待抽取信号的参考信号和广义自相关性相结合,构造了基于两者的目标函数并提出了一种新的盲抽取算法。与现有的盲抽取算法相比,新算法更充分利用了待抽取信号的先验参考信息。需要指出的是,该算法并不过分地依赖于参考信号,即使选取的参考信号较一般时,也能得到较为满意的效果。基于胎儿心电数据的实验证实了算法的较好性能。
     3.针对带噪数据的抽取及分离问题,提出了两个基于源信号时间结构特性的去噪算法。首先,将待抽取信号广义自相关性与高斯矩函数相结合,通过最大化这种广义自相关性,给出了感兴趣信号的去噪盲抽取算法。该算法采用偏差移除技术,是对无噪ICA算法的修正,以去除或减少由噪声引起的偏差。与现有的一些噪声盲抽取算法相比,即使在噪声协方差较大时,也能得到较满意的效果。而且本算法对时间延迟的估计误差不敏感。基于模拟信号、图像数据以及胎儿心电数据的实验结果证实了算法的有效性。其次,将源信号的非线性新息表示与高斯矩函数相结合,提出了一种适用于源信号协方差非平稳情况的去噪盲源分离算法。并针对现有噪声方法较少考虑噪声未知这一问题,进一步将其推广到噪声协方差未知情况,实验证实了算法的有效性和实用性。
Independent component analysis(ICA) is a new promising method for data processing and analysis.The aim of the ICA is to extract original independent components from observed data that are mixtures of the unknown sources without any knowledge of the mixed channel.Recently,ICA has received great attention due to its potential signal processing applications such as speech signal processing,biomedical signal processing,neural computation,image feature extraction,telecommunications and face recognition etc.Due to its wide and attractive applications,many researchers have studied ICA in the past twenty years and made this technique considerable developed.However,ICA is still in an initial stage of development,some problems about its theory and application need to be enhanced and improved further.
     In this dissertation,we first provide an introduction about the research status and applications of ICA both at home and abroad.Then,preliminary knowledge of basic and extended ICA are given.In addition,some problems of extended ICA,for example,the ordering of independent components,the blind extraction of one or a set of interesting signals and the noisy blind source separation,are investigated deeply and several novel efficient methods are proposed.The main works in this dissertation can be introduced as follows:
     1.Based on the constrained independent component analysis model,we propose a method for eliminating the indeterminacy on permutation of the ICA.Most Of traditional ICA algorithms only exploit the direction of independent components but ignore these inherent indeterminacy,which is considered as unimportant impact factors in the signal processing.However,in many special applications,this inherent indeterminacy needs to be determined.Concerning this case,we propose an algorithm for constrained independent component analysis model based on projection methods and incorporate the new fixed-point(NewFP) algorithm into this constrained ICA model to construct a new constrained fixed-point algorithm.This method is applied to order the independent components in a specific statistical measures.Moreover,it is more simple to implement than other existing algorithms due to its independence of the learning rate.Computation simulations on synthesized signals,speech signals and real-world fetal electrocardiograph (ECG) data demonstrate that this method not only systematically eliminates the indeterminacy of ICA on permutation but also performs better.
     2.We further study the issue of blind source extraction(BSE) on temporal ICA (TICA) and present two BSE algorithms for extracting the desired signal with temporal structures.
     Firstly,through combining the generalized autocorrelations of the desired signal and the non-Gaussianity of its innovations,we develop an objective function,which is formulated as the convex combination of these priori special temporal characteristics.Maximizing this objective function,we obtain an efficient gradient BSE algorithm and further give its stability analysis in this paper.Note that ICA with its basic form ignores the time structure and uses only the non-Gaussianity criteria.However,the proposed algorithm combines both of these estimation criteria(non-Gaussianity and time-correlations) in order to exploit the data information as much as possible.Simulations on image data and ECG data indicate its better performance.
     Secondly,based on the temporal characteristics and other prior information of desired signals,we develop an objective function for extracting the interesting signals,which combines the generalized autocorrelations and reference information of desired signals. Maximizing this objective function,a BSE fixed-point algorithm is proposed.Comparing with other BSE method,this method makes full use of more priori information of the desired signal.It should be pointed out that the good performance of the proposed algorithm may attribute to the application of a properly reference signal.Fortunately, the proposed method does not excessively depend on the selection of the reference signals, which generalizes this method for broader applicability.Simulations on artificial ECG signals and the real-world ECG data demonstrate the better performance of the new algorithm.
     3.We study the problem of extracting or separating source signals with temporal structures.Moreover,we propose two noisy algorithms based on these priori special characteristics and Gaussian moments.
     Firstly,we address the extraction of the noisy model based on the temporal characteristics of sources.An objective function,which combines Gaussian moments to generalized autocorrelations,is proposed.Maximizing this objective function,we present a fixed-point noisy blind source extraction algorithm,which is given by bias removal techniques.This means that ordinary(noise-free) ICA methods are modified so that the bias due to Gaussian noise is removed,or at least reduced.Comparing with other existing extraction algorithms,the proposed algorithm shows its robustness to the estimated error of time delay even to high noise level.Simulations on synthesized signals,images and ECG data demonstrate the better performance of the proposed method.
     Secondly,we present a noisy blind source separation algorithm which incorporates Gaussian moments into the nonlinear innovation of original sources.This method is applicable to the situation when the noise covariance is known and source signals are nonstationary in the sense that the variance of each is assumed to change smoothly as a function of time.Furthermore,this method is extended to the case of noise covariance unknown in advance.Validity and performance of the described approaches are demonstrated by computer simulations.
引文
[1]王刚.基于最大非高斯估计的独立分量分析理论研究.国防科学技术大学博士论文,2005.
    [2]Jutten C,Hérault J.Blind separation of sources,part Ⅰ:an adaptive algorithm based on neuromimetic architecture.Signal Processing,1991,24(1):1-10.
    [3]Comon P,Jutten C,Hérault J.Blind separation of sources,Part Ⅱ:problems statement.Signal Processing,1991,24(1):11-20.
    [4]Sorouchyari E.Blind separation of sources,part Ⅲ:stability analysis.Signal Processing,1991,24(1):21-29.
    [5]Moulines E,Cardoso J-F,Gassiat E.Maximum likelihood for blind separation and deconvolution of noisy signals using mixture models.In:Proceedings of IEEE International Conference on Acoustics,Speech and Signal Processing(ICASSP'97),1997,5:3617-3620.
    [6]Cichocki A,Douglas S C,Amari S.Robust techniques for independent component analysis (ICA) with noisy data.Neurocomputing,1998,22(1-3):113-129.
    [7]Hyv(a|")rinen A.Independent component analysis in the presence of Gaussian noise by maximizing joint likelihood.Neurocomputing,1998,22(1-3):49-67.
    [8]Hyv(a|")rinen.A fast ICA for noisy data using Gaussian moments.In:Proceedings of Interenational Conference Symposium on Circuits and Systems,1999,57-61.
    [9]Hyv(a|")rinen A.Gaussian moments for noisy independent component analysis.IEEE Signal Processing Letter,1999,6(6):145-147.
    [10]Hyv(a|")rinen,A.Sparse code shrinkage:denoising of nongaussian data by maximum likelihood estimation.Neural Computation,1999,11(7):1739-1768.
    [11]Hojen-Sorensen P A D E R,Winther O,Hansen L K.Mean-field approaches to independent component analysis.Neural Computation,2002,14(4):889-918.
    [12]Zhong M J,Tang H W,Wang H L,Tang Y Y.An EM algorithm for independent component analysis in the presence of Gaussian noise.Neural Information Processing:Letters and Reviews,2004,2(1):11-17.
    [13]Shi Z W,Zhang C S.Gaussian moments for noisy complexity pursuit.Neurocomputing,2006,69:917-921.
    [14]Lewicki M S,Sejnowski T J.Learning overcomplete representations.Neural Computation,2000,12(2):337-365.
    [15]Girolami M.A variational method for learning sparse and overcomplete representations.Neural Computation,2001,13(11):2517-2532.
    [16]Zhong M J,Tang H W,Chen H J,Tang Y Y.An EM algorithm for learning sparse and overcomplete representations.Neurocomputing,2004,57:469-476.
    [17]Hyv(a|")rinen A.Independent component analysis for time-dependent stochastic processes .In:Proceedings of the International Conference on Artificial Neural Networks (ICANN'98),1998:135-140.
    [18]Murata N,Ikeda S,Ziehe A.An approach to blind source separation based on temporal structure of speech signals.Neurocomputing,2001,41:1-24.
    [19]Hyv(a|")rinen A.Complexity pursuit:separating interesting components from time-series.Neural Computation,2001,13(4):883-898.
    [20]Shi Z W,Tang H W,Tang Y Y.A fast fixed-point algorithm for complexity pursuit.Neurocomputing,2005,64:529-536.
    [21]Hyv(a|")rinen A,Pajunen P.Nonlinear independent component analysis:Existence and uniqueness.Neural Networks,1999,12:429-439.
    [22]Lappalainen H,Honlela A.Bayesian nonlinear independent component analysis by multilayer perceptrons.In:Advances in Independent Component Analysis,2000:93-121.
    [23]Harmeling S,Ziehe A,Kawanabe M,Muller K-R.Kernel-based nonlinear blind source separation.Neural Computation,2003,15:1089-1124.
    [24]Pham D T,Cardoso J-F.Blind separation of instantaneous mixtures of nonstationary sources.IEEE Transactions on Signal Processing,2003,1:353-358.
    [25]Sáchez A V D.Frontiers of research in BSS/ICA.Neurocomputing,2002,49:7-23.
    [26]Hérault J,Ans B.Circuits neuronaux àsynapses modifiables:décodage de messages composites par apprentissage non supervisé.C.-R.de l'Académie des Sciences,1984,299(Ⅲ-13):525-528.
    [27]Hérault J,Jutten C,Ans B.Détection de grandeurs primitives dans un message composite par une architecture de calcul neuromimétique en apprentissage non supervisé.In:Actes du Xème colloque GRETSI,1985,1017-1022.
    [28]Ans B,Hérault J,Jutten C.Adaptive neural architectures:detection of primitives.In:Proceedings of Cognitiva,1985,593-597.
    [29]Jutten C.Source separation:from dusk till dawn.In:Proceedings of 2nd International Workshop on Independent Component Analysis and Blind Source Separation(ICA'2000),2000,15-26.
    [30]Hérault J,Jutten C.Space or time adaptive signal processing by neural network models.In:AIP Conference Proceedings 151 on Neural Networks for Computing,1986,206-211.
    [31]Comon P.Independent component analysis-a new concept?.Signal Processing,1994,36:287-314.
    [32]Bell A,Sejnowski T.An information-maximization approach to blind separation and blind deconvolution.Neural Computation,1995,7(6):1129-1159.
    [33] Bell A, Sejnowski T J. An on-line information maximization algorithm that performs blind seperation. Advances in Neural Information Processing Systems, 1995, 7: 467-474.
    [34] Amari S, Cichocki A, Yang H. A new learning algorithm for blind signal separation. Advances in Neural Information Processing Systems, 1996, 8: 757-763.
    [35] Amari S. Natural gradient works efficiently in learning. Neural Computation, 1998, 10: 251-276.
    [36] Amari S. Neural learning in structured parameter spaces—natural Riemannian gradient. Advances in Neural Information Processing Systems, 2000, 9: 127-133.
    [37] Cardoso J-F, Laheld B H. Equivariant adaptive source separation. IEEE Transactions on Signal Processing, 1996, 44(12): 3017-3030.
    [38] Cardoso J-F. Blind signal processing: statistical priciple. Proceedings of IEEE, 1998, 86(10): 2009-2025.
    [39] Pearlmutter B, Parra L. A context-sensitive generalization of ICA. In: International Conference on Neural Information Processing (ICONIP'96), 1996: 151-157.
    [40] Pearlmutter B, Parra L. Maximum likelihood blind source separation: a context-sensitive generalization of ICA. Advances in Neural Information Processing Systems, 1997, 9: 613-619.
    [41] MacKay D J C. Maximum likelihood and covariant algorithms for independent component analysis. Available online at: ftp://wol.ra.phy.cam.ac.uk/pub/mackay/ica.pa.gz, 1996.
    [42] Cardoso J-F. Informax and maximum likelihood for blind separation. IEEE Signal Processing Letters, 1997, 4(4): 112-114.
    [43] Girolami M. An alternative perspective on adaptive independent component analysis algorithms. Neural Computation, 1998, 10: 2103-2114.
    [44] Girolami M. Self-organising neural networks-independent component analysis and blind source separation. Springer-Verlag, 1999.
    [45] Lee T W, Girolami M, Sejnowski T. Independent component analysis using an extended infomax algorithm for mixed subgaussian and supergaussian sources. Neural Computation, 1999, 11(2): 417-441.
    [46] Hyvarinen A, Oja E. A fast fixed-point algorithm for independent component analysis. Neural Computation, 1997, 9(7): 1483-1492.
    [47] Hyvarinen A. Fast and robust fixed-point algorithm for independent component analysis. IEEE Transactions on Neural Networks, 1999, 10(3): 626-634.
    [48] Hyvarinen A, Oja E. Independent component analysis: algorithms and applications. Neural Networks, 2000, 13: 411-430.
    [49]Hyv(a¨|)rinen A,Kaurhunen J,oja E.Independent component analysis.New York,wiley,2001.(中文版:周宗潭,董国华,徐听,胡德文等译.独立成分分析.北京:电子工业出版社,2007.)
    [50]Shi Z W,Tang H W,Tang Y Y.A new fixed-point algorithm for independent component analysis.Neurocomputing,2004,56:467-473.
    [51]Lee T W,Girolami M,Bell A,Sejnowski T J.A unifying information-theoretic framework for independent component analysis.Computers and Mathematics with Applications,2000,31(11):1-21.
    [52]Cardoso J-F.Source separation using higher order moments.In:Proceedings of IEEE Conference on Acoustics,Speech and Signal Processing(ICASSP'89),1989,2109-2112.
    [53]Cardoso J-F.Eigen-structure of the fourth-order cumulant tensor with application to the blind source separation problem.In:Proceedings of IEEE International Conference on Acoustics,Speech and Signal Processing(ICASSP'90),1990,2655-2658.
    [54]Tong L,Liu R W,Soon V,Huang Y F.Indeterminacy and identifiability of blind identification,IEEE Transactions on Circuits and Systems,1991,38:499-509.
    [55]Cardoso J-F,Souloumiac A.Blind beamforming for non Gaussian signals.IEE Proceedings-F,1993,140(6):362-370.
    [56]Cichocki A,Moszczyuski L.A new learning algorithm for blind separation of sources.Electronics Letters,1992,28(21):1986-1987.
    [57]Cichocki A,Unbehauen R,Rummert E.Robust learning algorithm for blind separation of signals.Electronics Letters,1994,30(17):1386-1387.
    [58]Cichocki A,Unbehauen R.Robust neural networks with on-line learning for blind identification and blind separation of sources.IEEE Transactions on Circuits and Systems,1996,43(11):894-906.
    [59]Oja E,Ogawa H,Wangviwattana J.Learning in nonlinear constrained Hebbian networks.In:Proceedings of Internatinal Conference on Artificial Neural Networks(ICANN' 91),1991,385-390.
    [60]Oja E.Principal components,minor components,and linear neural networks.Neural Networks,1992,5:927-935.
    [61]Xu L.Least mean square error reconstruction principle for self-organizing neural nets.Neural Networks,1993,6:627-648.
    [62]Karhunen J,Joutsensalo J.Representation and separation of signals using nonlinear PCA type learning.Neural Networks,1994,7:113-127.
    [63]Karhunen J,Joutsensalo J.Generalizations of principal component analysis,optimization problems,and neural networks.Neural Networks,1995:8(4):549-562.
    [64]Karhunen J,Pajunen P.Blind source separation using least-squares type adaptive algorithms.In:Proceedings of IEEE International Conference on Acoustics,Speech and Signal Processing(ICASSP'97) 1997,3361-3364.
    [65]Karhunen J,Oja E,Wang L,Eigario R,Joutsensalo J.A class of neural networks for independent component analysis.IEEE Transactions on Neural Networks,1997,8(3):486-504.
    [66]Karhunen J,Cichocki A,Kasprzak W,Pajunen P.On neural blind separation with noise suppression and redundancy reduction.International Journal of Neural Systems,1997,8(2):219-232.
    [67]Oja E,Karhunen J,Hyv(a¨|)rinen A.From neural principal components to neural independent components.In:Proceedings of Internatinal Conference on Artificial Neural Networks (ICANN'97),1997,519-528.
    [68]Karhunen J,Pajunen P,Oja E.The nonlinear PCA criterion in blind source separation:Relations with other approaches.Neurocomputing,1998,22(1):5-20.
    [69]Pajunen P,Karhunen J.Least-squares methods for blind source separation based on nonlinear PCA.International Journal of Neural Systems,1998,8(5-6):601-612.
    [70]Chen T P,Hua Y,Yan W.Global convergence of Oja's subspace algorithm for principle component extraction.IEEE Transactions on Neural Networks,1998,9(1):58-67.
    [71]Girolami M,Fyfe C.An extended exploratory projection pursuit network with linear and nonlinear anti-hebbian lateral connections applied to the cocktail party problem.Neural Networks,1997,10(9):1607-1618.
    [72]胡波,凌燮亭.Hebbian无导师学习原理的盲均衡:(Ⅰ)最小相位通道.通信学报,1994,15(5):17-24.
    [73]胡波,凌燮亭.Hebbian无导师学习原理的盲均衡:(Ⅱ)非最小相位通道.通信学报,1994,15(6):17-22.
    [74]凌燮亭.延时狭带信号的自学习盲分离.电子学报,1995,23(1):28-33.
    [75]张贤达.时间序列分析-高阶统计量方法.北京:清华大学出版社,1996.
    [76]张贤达,朱孝龙,保铮.基于分阶段学习的盲信号分离.中国科学,E辑,2002,32(5):693-703.
    [77]Zhu X L,Zhang X D,Ye J M.Natural gradient-based recursive least-squares algorithm for adaptive blind source separation.Science in China,Series F,2004,47:55-65.
    [78]Yang H,Zhang X D.A fast maximum likelihood sequence decoding method for multi-carrier DS-CDMA using frequency spread coding.IEEE Transactions on Wireless Communications,2004,3(3):770-780.
    [79]汪军,何振亚.基于高阶谱的信号盲分离.东南大学学报,1996,26(5):75-78.
    [80]何振亚,杨绿溪,鲁子奕.非线性Informax自组织算法的盲源分离机理.数据采集与处理,1998,13(4):303-305.
    [81]刘琚,梅良模,何振亚.一种盲信号分离的信息理论方法.山东大学学报(自然科学版),1998,33(4):398-403.
    [82]刘琚,顾明亮,何振亚.一种新的瞬时混迭信号盲分离的自适应方法.电路与系统学报,1998,3(4):66-71.
    [83]刘琚,鲁子奕,何振亚,梅良模.基于信息理论准则的盲源分离方法.应用科学学报,1999,17(2):156-162.
    [84]刘琚,何振亚,梅良模.一种基于ICA和过采样技术的盲反卷积方法.现代雷达,1998,20(4):
    [85]Liu J,Wang T J,He Z Y.A new approach for on-line blind equalization and channel identification.Journal of Southeast University(English Edition),1999,15(1):20-25.
    [86]刘琚,聂开宝,李道真,何振亚.基于递归神经网络的信息理论盲源分离准则.电路与系统学报,2001,6(1):40-44.
    [87]刘琚,孙建德,张新刚.基于ICA的数字水印的方法.电子学报,2004,32(4):657-660.
    [88]Sun J D,Liu J,Hu H B.Data hiding in independent components of video.Lecture Notes in Computer Science,2004,3173:738-743.
    [89]Sun J D,Liu J.A Blind Video Watermarking Scheme Based on ICA and Shot Segmentation.Science in China Series F,2006,49(3):302-312.
    [90]Sun J D,Liu J.A novel blind video watermarking scheme based on independent dynamic component.Multidimensional Systems and Signal Processing,2006,17(1):59-74.
    [91]Xu H J,Liu J,Gu B.Optimal antenna subset selection and blind detection approach applied to orthogonal space-time block coding.Journal of Electronics(China),电子科学刊(英文版),2007,24(2):76-81.
    [92]谷波,刘琚,许宏吉.波束空时分组编码的ICA盲检测方案.电子与信息学报,2007,29(1):105-108.
    [93]许宏吉,刘琚,谷波,胡惠博.空时分组码通信中的一类ICA盲检测方案.通信学报,2007,28(6):12-18.
    [94]史维祥,冯大政.有效的自适应波达方向盲估计算法.电子学报,1999,27(3):1-4.
    [95]冯大政,保铮,张贤达.信号盲分离问题多阶段分解算法.自然科学进展,2002,12(3):324-328.
    [96]Feng D Z,Zhang X D,Bao Z.An efficient multistage decomposition approach for independent components.Signal Processing,2003,83;181-197.
    [97]Feng D Z,Zhang X D,Bao Z.A neural network learning for adaptively extracting crosscorrelation features between two high dimensional data streams.IEEE Transactions on Neural Networks,2004,15(6):1541-1554.
    [98]Chang D X,Feng D Z,Zheng W X,Li L.A Fast recursive total least squares algorithm for adaptive IIR filtering.IEEE Transactions on Signal Processing,2005,52(3):957-965.
    [99]Feng D Z,Zhang X D,Chang D X,Zheng W X.A fast recursive total least squares algorithm for adaptive FIR filtering.IEEE Transactions on Signal Processing,2006,10:4032-4039.
    [100]虞晓,胡光锐.基于高斯混合密度函数估计的语音分离.上海交通大学学报,2000,34(2):177-180.
    [101]Zhang L Q,Cichocki A,Amari S.Self-adaptive blind source separation based on activation functions adaptation.IEEE Transactions on Neural Networks,2004,15(2):233-244.
    [102]吴小培,詹长安,周荷琴,冯焕清.采用独立分量分析方法消除信号中的工频干扰.中国科学技术大学学报,2000,30(6):671-676.
    [103]吴小培,冯焕清,周荷琴,王涛.基于独立分量分析的图像分离技术及应用.中国图像图形学报,2001,6A(2):133-137.
    [104]吴小培,冯焕清,周荷琴,王涛.基于独立分量分析的混合声音信号分离.中国科学技术大学学报,2001,31(1):68-73.
    [105]李全政,高小榕,欧阳婧.胸阻抗信号中的呼吸波的去除.清华大学学报(自然科学版),2000,40(9):13-16.
    [106]洪波,唐庆玉,杨福生,潘映辐,陈葵,铁艳梅.ICA在视觉诱发电位的少次提取与波形分析中的应用.中国生物医学工程学报,2000,19(3):334-341.
    [107]Wang G,Hu D W.The existence of spurious equilibrium in FastICA.Lecture Notes in Computer Science,2004,3173:708-713.
    [108]Zheng C H,Chert Y,Li X X,Li Y X,Zhu Y P.Tumor classification based on independent component analysis.International Journal of Pattern Recognition and Artificial Intellgeince,2006,20(2):297-310.
    [109]Zheng C H,Huang D S,Sun Z L.Lyu M R,Lok T M.Nonnegative independent component analysis based on minimizing mutual information technique.Neurocomputing,2006,69:878-883.
    [110]Zheng C H,Huang D S,Shang L.Feature selection in independent component subspace for microarray data classification.Neurocomputing,2006,69:2407-2410.
    [111]Huang D S,Zheng C H.Independent component analysis based on penalized discriminant method for tumor classification using gene expression data.Bioinformatics,2006,22(15):1855-1862.
    [112]Shang L,Huang D S,Du J X,Zheng C H.Palmprint recognition using FastICA algorithm and radial basis probabilistic neural network.Neurocomputing,2006,69:1782-1786.
    [113]Sch(o¨|)lkopf B,Smola A,M(u¨|)iller K R.Nonlinear component analysis as a kernel eigenvalue problem.Neural Computation,1998,10(5):1299-1319.
    [114]Bach F R,Jordan M I.Kernel independent component analysis.Journal of Machine Learning Research,2002,3:1-48.
    [115]Hyv(a¨|)rinen A,Hoyer P O,Inki M.Topographic independent component analysis.Neural Computation,2001,13(7):1525-1558.
    [116]Kwak K-C,Pedrycz W.Face recognition using an enhanced independent component analysis approach.IEEE Transactions on Neural Networks,2007,18(2):530-541.
    [117]Sharma A,Paliwal K K.Subspace independent component analysis using vector kurtosis.Pattern Recognition,2006,39:2227-2232.
    [118]Choi S.Differential Hebbian-type learning algorithms for decorrelation and independent component analysis.Electronics Letters,1998,34:900-901.
    [119]Choi S.Adaptive differential decorrelation:a natural gtadient algorithm.Lecture Notes in Computer Science,2002,2415:1168-1173.
    [120]Choi S.Differential learning and random walk model.In:Proceedings of IEEE International Conference on Acoustics,Speech,and Signal Processing,2003,2:721-724.
    [121]Choi S.Differential learning algorithms for decorrelation and independent component analysis.Neural Networks,2006,19:1558-1567.
    [122]Roberts S J,Everson R.Independent component analysis:principles and practice.Cambridge University Press,2001.
    [123]Cichocki A,Amari S.Adaptive blind signal and image processing:learning algorithms and applications.New York,Wiley,2002.
    [124]Lu W,Rajapakse J C.Constrained independent component analysis.Advances in Neural Information Processing Systems,2000,13:570-576.
    [125]Lu W,Rajapakse J C.ICA with reference.In:Proceedings of the 3rd International Conference on Independent Component Analysis and Blind Source Separation(ICA2001),2001,120-125.
    [126]Lu W,Rajapakse J C.Eliminating indeterminancy in ICA.Neurocomputing,2003,50:271-290.
    [127]Lu W,Rajapakse J C.Approach and applications of constrained ICA.IEEE Transactions on Neural Networks,2005,16(1):203-212.
    [128]Lu W,Rajapakse J C.ICA with reference.Neurocomputing,2006,69:2244-2257.
    [129]Lin Q H,Zheng Y R,Yin F L,Liang H L.Speech segregation using constrained ICA.Lecture Notes in Computer Science,2004,3173:755-760.
    [130]Makeig S,Bell A J,Jung t,Sejnowski T J.Independent component analysis of electroencephalographic data.Advances in Neural Infomation Processing Systems,1996,8:145-151.
    [131]Lathauwer L De,Callaerts D,Moor B De.Fetal electrocardiogram extraction by source subspace separation.In:Proceedings of IEEE SP/ATHOS Workshop HOS,1995,134-138.
    [132]Mckeown M,Makeig S,Brown G,Jung T P,Kindemrann S,Lee T W,Sejnowski T J.Spatially independent activity patterns in functional magnetic resonance imaging data during the stroop color-naming task.Proceedings of the National Academy of Sciences,1998,95:803-810.
    [133]McKeown M J,Makeig S,Brown G G,Jung T P,Kindermann S S,Bell A,Sejnowski T J.Analysis of fMRI data by blind separation into spatial independent component analysis.Human Brain Mapping,1998,6:160-188.
    [134]McKeown M J,Sejnowski T J.Independent component analysis of fMRI data:examining the assumptions.Human Brain Mapping,1998,6:368-372.
    [135]Calhoun V D,Adali T,Pearlson G D,Pekar J J.Spatial and temporal independent component analysis of functional MRI Data containing a pair of task-related Waveforms.Human Brain Mapping,2001,13:43-53.
    [136]唐焕文,唐一源,郭崇慧,陈克伟.神经信息学及其应用.北京:科学出版社,2007.
    [137]Bell A,Sejnowski T.Learning higher-order structure of a natural sound.Network:Computation in Neural Systems,1996,7:261-266.
    [138]Lee T W,Lewicki M S,Sejnowski T J.ICA mixture models for unsupervised classification of non-Gaussian classes and automatic context switching in blind signal separation.IEEE Transactions on Pattern Analysis and Machine Intelligence,2000,22(10):1-12.
    [139]Lee T W,Lewicki M S.Unsupervised classification,segmentation,de-noising of images using ICA mixture models.IEEE Transactions on Image Processing,2002:270-279.
    [140]Cristescu R,Ristaniemi T,Joutsensalo J,Karhunen J.Delay estimation in CDMA communications using a Fast ICA algorithm.In:Proceedings of Internatinal Workshop on Independent Component Analysis and Blind Signal Separation(ICA2000),2000:105-110.
    [141]Hoyer P O,Hyv(a¨|)rinen A.Independent component analysis applied to feature extraction from colour and stereo images.Network:Computation in Neural Systems,2000,11(3):191-210.
    [142]Van Hateren H,Ruderman D L.Independent component analysis of natural image sequences yields spatiotemporal filters similar to simple cells in primary visual cortex.Proceedings of Royal Society,Ser.B,1998,265:2315-2320.
    [143]Back A D,Weigend A S,A first application of independent component analysis to extracting structure from stoke returns.International Journal of Neural Systems,1997,8(4):473-484.
    [144]Girolmai M.An alternative perspective on adaptive Independent component analysis algorithms.Technical Report,Issn1461-6122,Department of Computing and Information Systems,Paisley University,Scotlnad,1997.
    [145]Bingham E.Advances in dependent component analysis with applications to data mining.Unpublished doctoral dissertion,Helsinki University of Technology,2003.
    [146]马建仓,牛弈龙,陈海洋.盲信号处理.北京:国防工业出版社,2006.
    [147]Lee T W.Independent component analysis-theory and applications.Springer,1998.
    [148]Papoulis A.Probability,random variables and stochastic processes,2nd ed.New York.McGraw-Hill,1984.
    [149]张发启,张斌,张喜斌.盲信号处理及应用.西安:西安电子科技大学出版社,2006.
    [150]Gaeta M,Lacoume J.Source separation without a priori knowledge:the maximum likelihood solution.In:Proceediugs of European Signal Processing Conference(EUSIPCO),1990,621-624.
    [151]Pham D T,Garrat P,Jutten C.Separation of mixture of independent sources through a maximum likelihood approach.In:Proceedings of European Signal Processing Conference (EUSIPCO),1992,771-774.
    [152]Linsker R.Self-organization in a perceptual network.IEEE Computer,i988,21:105-117.
    [153]Cover T M,Thomas J A.Elements of Information Theory.New York,Wiley,1991.
    [154]Huber P.Projection pursuit.Annals of Statistics,1985,13(2):435-475.
    [155]Hyv(a¨|)rinen A.New approximation of differential entropy for independent component anal-ysis and projection pursuit.In:Proceedings of the Conference on Advances in Neural Information Processing Systems,1998,10:273-279.
    [156]Jones M,Sibson R.What is projection pursuit?.Journal of the Royal Statistical Society,1987,150:1-36.
    [157]Hyv(a¨|)rinen A.Survey on independent component analysis.Neural Computing Surveys,1999,2(4):94-128.
    [158]Pham D T,Garat P.Blind separation of mixture of independent sources through a quasimaximum likelihood approach.IEEE Transactions on Signal Processing,1997,45(7):1712-1725.
    [159]Cichocki A,Thawonmas it,Amari S.Sequential blind signal extraction in order specified by stochastic properties.Electronical Letter,1997,33(1):64-65.
    [160]Hyv(a¨|)rinen A,Oja E.Simple neuron models for independent component analysis.International Journal of Neural Systems,1996,7(6):671-687.
    [161]Cichocki A,Karhunen J,Kasprzak W,Vigário R.Neural networks for blind separation with unknown number of sources.Neurocomputing,1999,24(1-3):55-93.
    [162]James C J,Hesse C W.Independent component analysis for biomedical signals.Physiological Measurement,2005,26:R15-R39.
    [163]Belouchrani A,Meraim K A,Cardoso J-F,Moulines E.A blind source separation technique based on second order statistics.IEEE Transactions on Signal Processing,1997,45:434-444.
    [164]Matsuoka K,Ohya M,Kawamoto M.A neural net for blind separation of nonstationary signals.Neural Networks,1995,8(3):411-419.
    [165]Molgedey L,Schuster H G.Separation of a mixture of independent signals using time delayed correlations.Physical Review Letters,1994,72:3634-3636.
    [166]王刚,王广云,胡德文.时间独立分量分析模型的新息方法.信号处理,2007,23(1):88-92.
    [167]Friedman J H,Tukey J W.A projection pursuit algorithm for exploratory data analysis.IEEE Transactions on Computers,1974,C-23(9):881-890.
    [168]Pajunen P.Blind source separation using algorithmic information theory.Neurocomputing,1998,22:35-48.
    [169]Douglas S C,Cichocki A,Amari S.A bias removal technique for blind source separation with noisy measurements.Electronics Letters,1998,34:1379-1380.
    [170]Lappalainen H.Ensemble learning for independent component analysis.In:Proceedings of First International Conference on Independent Component Analysis and Blind Source Separation(ICA'99),1999:7-12.
    [171]Lappalainen H,Giannakopoulos X,Honlela A,Karhunen J.Nonlinear independent component analysis using ensemble learning theory.In:Proceedings of the 2nd International Workshop on Independent Component Analysis and Blind Signal Separation,2000.
    [172]Attias H.Independent factor analysis.Neural Computation,1999,11(5):803-852.
    [173]Welling M,Weber M.A constrained EM algorithm for independent component analysis.Neural Computation,2001,13(3):677-689.
    [174]Hyv(a¨|)rinen A.Noisy independent component analysis,maximum likelihood estimation,and competitive learning.In:Proceedings of 1999 International Joint Conference on Neural Networks,1998,2282-2286.
    [175]Cheung Y,Xu L.An expirical method to selected dominant independent components in ICA for time series analysis,In:Proceedings of 1999 International Joint Conference on Neural Networks,1999,6:3883-3887.
    [176]Cheung Y,Xu L.Independent component ordering in ICA series analysis.Neurocomputing,2001,41(1-4):145-152.
    [177]Wu H C,Yu L H,Li W K.An independent component ordering and selection procedure based on the MSE criterion.Lecture Notes in Computer Science,2006,3889:286-294.
    [178]Youssef T,Youssef A-B M,LaConte S,Hu X P,Kadaha Y M.Robust ordering of independent components in functional magnetic resonance imaging time series data using canonical correlation analysis.In:Proceedings of the SPIE Medical Imaging,2003,5031:332-340.
    [179]Bertsekas D P.Constrained optimization and Lagrange multiplier methods.Academic Press,New York,1982.
    [180]Moor D De(Ed.).Daisy:database for the identification of systems,available online at:http://www.esat.kuleuven.ac.be/sista/daisy,(1997).
    [181]Barros A K,Cichocki A.Extraction of specific signals with temporal structure.Neural Computation,2001,13(9):1995-2003.
    [182]Cruces-Alvarez S A,Cichocki A,Amari S.From blind signal extraction to blind instantaneous signal separation:criteria,algorithm,and stability.IEEE Transactions on Neural Networks,2004,15(4):859-873.
    [183]Amari S,Cichocki A.Adaptive blind signal processing-neural network approaches.Proceedings of IEEE,1998,86(10):2016-2048.
    [184]Anand K,Mathew G,Reddy V.Blind separation of multiple co-channel BPSK signals arriving at an antenna array.IEEE Signal Processing Letters,1995,2(9):176-178.
    [185]Boudet S,Peyrodie L,Gallois P,Vasscur C.Filtering by optimal projection and application to automatic artifact removal from EEG.Signal Processing,2007,87(8):1978-1992.
    [186]Chaumette E,Comon P,Muller D.ICA-based technique for radiating sources estimation:application to airport surveillance.IEE Proceedings-F,1993,140(6):395-401.
    [187]Cichocki A,Rutkowski T,Barros A K,Oh S H.A blind extraction of temporally correlated but statistically dependent acoustic signals.In:Neural Networks for Signal Processing X:Proceedings of the 2000 IEEE Signal Processing Society Workshop(NNSP2000),2002,1:455-464.
    [188]C5co K F,Salles E O T,Sarcinelli-Filho M.Topographic independent component analysis based on fractal theory and morphology applied to texture segmentation.Signal Processing,2007,87(8):1966-1977.
    [189]Hild K E.Attias H T,Comani S,Nagarajan S S.Fetal cardiac signal extraction from magnetocardiographic data using a probabilistic algorithm.Signal Processing,2007,87(8):1993-2004.
    [190]Shi Z W,Zhang C S.Semi-blind source extraction for fetal electrocardiogram extraction by combining non-Gaussianity and time-correclation.Neurocomputing,2007,70:1574-1581.
    [191]Zibulevsky M,Zeevi Y Y.Extraction of a source from mutichannel data using sparse decomposition.Neurocomputing,2002,49:163-173.
    [192]Shi Z W,Zhang C S.Blind source extraction using generalized autocorrelations.IEEE Transactions on Neural Networks,2007,18(5):1516-1524.
    [193]Delfosse N,Loubaton P.Adaptive blind separation of independent sources:a deflation approach.Signal Processing,1995,45:59-83.
    [194]Zhang Z L,Yi Z.Extraction of a source signal whose kurtosis value lies in a specific range.Neurocomputing,2006,69:900-904.
    [195]Zhang Z L,Yi Z.Robust extraction of specific signals with temporal structure.Neurocomputing,2006,69:888-893.
    [196] Jafari M G, Wang W, Chambers J A, Hoya T, Cichocki A. Sequential blind source separation based exclusively on second-order statistics developed for a class of periodic signals. IEEE Transactions on Signal Processing, 2006, 54(3): 1028-1040.
    [197] Huang D S, Mi J X. A new constrained independent component analysis method. IEEE Transactions on Neural Networks, 2007, 18(5): 1532-1535.
    [198] Lin Q H, Zheng Y R, Yin F L, Liang H L, Calhoun V D. A fast algorithm for one-unit ICA-R. Information Sciences, 2007, 177: 1265-1275.
    [199] Zhang Z L. Morphologically constrained ICA for extraction weak temporally correlated signals. Neurocomputing, 2008, 71(7-9): 1669-1679.
    [200] Liu W, Mandic D P. A normalised kurtosis-based algorithm for blind source extraction from noisy measurements. Signal Processing, 2006, 86: 1580-1585.
    [201] Shi Z W, Zhang C S. Nonlinear innovation to blind source separation. Neurocomputing, 2007, 71: 406-410.
    [202] Shi Z W, Zhang C S. Energy predictability to blind source separation, Electronics Letters, 2006, 42(17): 1006-1007.
    [203] Yang Y M, Guo C H. Gaussian moments for noisy unifying model. Neurocomputing, 2008, doi:10.1016/j.neucom.2008.03.005.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700