基于协同PSO算法的模糊辨识与神经网络学习
|
摘要
粒子群优化(Particle swarm optimization,PSO)算法是一种基于群体智能的算法,它模拟鸟群、鱼群和蜂群等动物群体的觅食行为,通过个体之间的相互协作使群体达到最优化目的。同遗传算法类似,PSO算法也是一种基于种群的优化技术,它初始化为一组随机解,粒子群在搜索空间中追随种群中的最优粒子进行协同搜索。PSO算法具有操作简单、需要调节的参数少、收敛速度快等特点,因而引起越来越多的关注,成为计算智能及经济、社会、生物等交叉学科的研究热点和前沿。
协同搜索的主要思想是使用多个模块同时搜索问题空间,这些模块之间相互交换信息,以提高算法的效率,它在研究大规模复杂优化问题中得到了广泛的应用。本文主要研究了结合协同搜索和PSO算法的协同PSO算法,以及其在模糊辨识和神经网络学习中的应用。
本文首先介绍了PSO算法的产生背景、研究的主要内容和开放问题等;接着给出了协同PSO算法的基本框架和参数分析;然后提出了协同随机PSO算法来改进标准PSO算法的性能;最后将提出的改进算法和协同进化PSO算法应用在模糊辨识和神经网络学习等领域。本文研究的主要内容和创新点可概括如下:
(1)提出了一种协同随机PSO算法,使用多个子种群同时搜索问题空间,在迭代的过程中,不同的子种群间以随机方式相互交换信息。粒子通过学习不同子种群的最优历史信息来更新自己的速度和位置,保持了种群的多样性;同时,使用多个子种群的有用信息也保证了算法的收敛速度。从而算法的全局和局部搜索能力达到了很好的平衡。
(2)提出了一种基于减法聚类和协同随机PSO算法的二阶段模糊辨识方法:减法聚类用来辨识模糊模型的结构,协同随机PSO算法用来优化模型的参数,同时使用减法聚类的结果来初始化算法的种群。该辨识方法能有效地获得紧凑而精确的模糊模型。
(3)针对一类用于时间序列预测的单乘法神经元模型,引入协同随机PSO算法来加强其学习能力。单乘法神经元模型可以看作是结构简单,参数较少的神经网络,代替多层神经网络来完成函数逼近等任务。协同随机PSO算法作为该模型的训练算法,提高了模型的学习效率和鲁棒性。
(4)针对模糊模型辨识中模型结构难以确定的问题,提出了一种基于协同进化PSO算法的自动模糊模型辨识方法。首先预定义一个最大的模糊规则数,每条规则都有一个标签来决定其是否属于模糊模型;然后将标签、模糊模型的前件参数和后件参数编码成不同的粒子,使用三个PSO算法协同地搜索;通过标签的进化可以得到模糊模型的结构,在模型性能达到最优时,也得到了最优的模型参数。该方法能直接从输入输出数据抽取精确的模糊模型。
(5)针对全连接神经网络的结构冗余问题,提出了一种基于协同进化PSO算法的同时调节神经网络结构和权值的方法。首先定义了一种带开关权值的神经网络模型,开关权值由离散值0和1表示,用来决定神经网络的结构;然后使用协同进化的二进制PSO算法和实值PSO算法来优化网络结构和模型参数。该方法能有效地获得精度高而结构精简的神经网络。
Particle swarm optimization (PSO) algorithm is a novel swarm intelligence-based algo-rithm which mimics the movement of birds ?ocking or fish schooling looking for food. Thealgorithm finds optimal solution by the cooperation among particles. Similar to the geneticalgorithms, PSO algorithm is an optimal technology based on population, which generatesa set of random solutions and searches the space cooperatively through pursuing the bestexperiences of the swarm. PSO algorithm draws more and more attention and becomes aresearch focus because it has such features as easy operation, fewer tuning parameters, highconvergence speed, etc.
Cooperative search is one of the many areas that have been extensively studied in thepast decade to solve many large size optimization problems. The main idea involves havingmore than one search module running and exchanging information among each other inorder to explore the search space more efficiently and reach better solutions. Together withtheir applications in fuzzy identification and neural networks learning, the cooperative PSOalgorithms, which combine the cooperative search and PSO algorithms, are mainly studied.
First, the social background, research contents and open problems of PSO algorithmare introduced; next, the basic framework and analysis of parameters are provided; thenthe cooperative random learning PSO algorithm is presented to enhance the performanceof the original PSO algorithm; finally, the improved algorithm and the coevolutionary PSOalgorithm are used in fuzzy modeling and neural network learning. The main contributionsof this dissertation can be summarized as follows:
1. A cooperative random learning PSO, which employs several sub-swarms to searchthe space simultaneously, is proposed. In the evolving process, the information among dif-ferent sub-swarms exchanges randomly. The particles learn the best history information toupdate the velocities and positions, thus the diversity of the swarm is maintained. At thesame time, the convergence speed of the algorithm is kept by employing more useful infor-mation during the iteration. The cooperative random learning strategy balances the globaland local search abilities very well.
2. A two-stage fuzzy identification method based on subtractive clustering and coop-erative random learning PSO algorithm is proposed. In the proposed method, subtractiveclustering is utilized to partition the input space and extract a set of fuzzy rules and cooper-ative random learning PSO algorithm is used to find the optimal membership functions andconsequent parameters of the rule base. Furthermore, the subtractive clustering is used toinitialize the swarm of cooperative random learning PSO algorithm. The proposed methodcan extract compact and accurate fuzzy model effectively.
3. The cooperative random learning PSO algorithm is introduced into the single mul-tiplicative neuron (SMN) model to enhance its learning ability for time series prediction.The SMN model can be considered as a neural network with simple structure and fewer pa-rameters to take the place of the multiple layers neural network for function approximation.The learning efficiency and robustness of the SMN model are improved through training bycooperative random learning PSO algorithm.
4. A new approach for constructing the fuzzy systems automatically by coevolutionaryPSO algorithm is proposed. At first, a maximum rule number is predefined according to priorknowledge. Every rule has a label to determine whether it belongs to the fuzzy inferencesystem. The labels, antecedent and consequent parameters of the model are encoded intothree particles and searched by three PSO algorithms cooperatively. The model structure isobtained through evolving of the labels; meanwhile, the optimal parameters are reached. Theproposed method can construct the accurate fuzzy model from the input-output data directly.
5. A coevolutionary PSO-based method to tune the structure and parameters of a neu-ral network for tackling the connections redundant problems is proposed. A neural networkwith switches is introduced firstly, and the switches have two values 0 and 1. The struc-ture of a neural network is decided by the switches. Then, coevolutionary PSO algorithm,which uses a binary PSO algorithm and a standard PSO algorithm, is employed to optimizethe structure and parameters of the proposed model. This method can obtain an accuratepartially-connected neural network effectively.
协同搜索的主要思想是使用多个模块同时搜索问题空间,这些模块之间相互交换信息,以提高算法的效率,它在研究大规模复杂优化问题中得到了广泛的应用。本文主要研究了结合协同搜索和PSO算法的协同PSO算法,以及其在模糊辨识和神经网络学习中的应用。
本文首先介绍了PSO算法的产生背景、研究的主要内容和开放问题等;接着给出了协同PSO算法的基本框架和参数分析;然后提出了协同随机PSO算法来改进标准PSO算法的性能;最后将提出的改进算法和协同进化PSO算法应用在模糊辨识和神经网络学习等领域。本文研究的主要内容和创新点可概括如下:
(1)提出了一种协同随机PSO算法,使用多个子种群同时搜索问题空间,在迭代的过程中,不同的子种群间以随机方式相互交换信息。粒子通过学习不同子种群的最优历史信息来更新自己的速度和位置,保持了种群的多样性;同时,使用多个子种群的有用信息也保证了算法的收敛速度。从而算法的全局和局部搜索能力达到了很好的平衡。
(2)提出了一种基于减法聚类和协同随机PSO算法的二阶段模糊辨识方法:减法聚类用来辨识模糊模型的结构,协同随机PSO算法用来优化模型的参数,同时使用减法聚类的结果来初始化算法的种群。该辨识方法能有效地获得紧凑而精确的模糊模型。
(3)针对一类用于时间序列预测的单乘法神经元模型,引入协同随机PSO算法来加强其学习能力。单乘法神经元模型可以看作是结构简单,参数较少的神经网络,代替多层神经网络来完成函数逼近等任务。协同随机PSO算法作为该模型的训练算法,提高了模型的学习效率和鲁棒性。
(4)针对模糊模型辨识中模型结构难以确定的问题,提出了一种基于协同进化PSO算法的自动模糊模型辨识方法。首先预定义一个最大的模糊规则数,每条规则都有一个标签来决定其是否属于模糊模型;然后将标签、模糊模型的前件参数和后件参数编码成不同的粒子,使用三个PSO算法协同地搜索;通过标签的进化可以得到模糊模型的结构,在模型性能达到最优时,也得到了最优的模型参数。该方法能直接从输入输出数据抽取精确的模糊模型。
(5)针对全连接神经网络的结构冗余问题,提出了一种基于协同进化PSO算法的同时调节神经网络结构和权值的方法。首先定义了一种带开关权值的神经网络模型,开关权值由离散值0和1表示,用来决定神经网络的结构;然后使用协同进化的二进制PSO算法和实值PSO算法来优化网络结构和模型参数。该方法能有效地获得精度高而结构精简的神经网络。
Particle swarm optimization (PSO) algorithm is a novel swarm intelligence-based algo-rithm which mimics the movement of birds ?ocking or fish schooling looking for food. Thealgorithm finds optimal solution by the cooperation among particles. Similar to the geneticalgorithms, PSO algorithm is an optimal technology based on population, which generatesa set of random solutions and searches the space cooperatively through pursuing the bestexperiences of the swarm. PSO algorithm draws more and more attention and becomes aresearch focus because it has such features as easy operation, fewer tuning parameters, highconvergence speed, etc.
Cooperative search is one of the many areas that have been extensively studied in thepast decade to solve many large size optimization problems. The main idea involves havingmore than one search module running and exchanging information among each other inorder to explore the search space more efficiently and reach better solutions. Together withtheir applications in fuzzy identification and neural networks learning, the cooperative PSOalgorithms, which combine the cooperative search and PSO algorithms, are mainly studied.
First, the social background, research contents and open problems of PSO algorithmare introduced; next, the basic framework and analysis of parameters are provided; thenthe cooperative random learning PSO algorithm is presented to enhance the performanceof the original PSO algorithm; finally, the improved algorithm and the coevolutionary PSOalgorithm are used in fuzzy modeling and neural network learning. The main contributionsof this dissertation can be summarized as follows:
1. A cooperative random learning PSO, which employs several sub-swarms to searchthe space simultaneously, is proposed. In the evolving process, the information among dif-ferent sub-swarms exchanges randomly. The particles learn the best history information toupdate the velocities and positions, thus the diversity of the swarm is maintained. At thesame time, the convergence speed of the algorithm is kept by employing more useful infor-mation during the iteration. The cooperative random learning strategy balances the globaland local search abilities very well.
2. A two-stage fuzzy identification method based on subtractive clustering and coop-erative random learning PSO algorithm is proposed. In the proposed method, subtractiveclustering is utilized to partition the input space and extract a set of fuzzy rules and cooper-ative random learning PSO algorithm is used to find the optimal membership functions andconsequent parameters of the rule base. Furthermore, the subtractive clustering is used toinitialize the swarm of cooperative random learning PSO algorithm. The proposed methodcan extract compact and accurate fuzzy model effectively.
3. The cooperative random learning PSO algorithm is introduced into the single mul-tiplicative neuron (SMN) model to enhance its learning ability for time series prediction.The SMN model can be considered as a neural network with simple structure and fewer pa-rameters to take the place of the multiple layers neural network for function approximation.The learning efficiency and robustness of the SMN model are improved through training bycooperative random learning PSO algorithm.
4. A new approach for constructing the fuzzy systems automatically by coevolutionaryPSO algorithm is proposed. At first, a maximum rule number is predefined according to priorknowledge. Every rule has a label to determine whether it belongs to the fuzzy inferencesystem. The labels, antecedent and consequent parameters of the model are encoded intothree particles and searched by three PSO algorithms cooperatively. The model structure isobtained through evolving of the labels; meanwhile, the optimal parameters are reached. Theproposed method can construct the accurate fuzzy model from the input-output data directly.
5. A coevolutionary PSO-based method to tune the structure and parameters of a neu-ral network for tackling the connections redundant problems is proposed. A neural networkwith switches is introduced firstly, and the switches have two values 0 and 1. The struc-ture of a neural network is decided by the switches. Then, coevolutionary PSO algorithm,which uses a binary PSO algorithm and a standard PSO algorithm, is employed to optimizethe structure and parameters of the proposed model. This method can obtain an accuratepartially-connected neural network effectively.
引文
[1] Abonyi J., Babuska R., Szeifert F., Fuzzy modeling with multivariate membership functions: Gray-box identification and control design. IEEE Transactions on Systems, Man, Cybernnetics. B, Cyber-netics, 31(5):755-767, 2001.
[2] Adleman L. M., Molecular computation of solutions to combinatorial problems. Science, 226:1021-1024, 1994.
[3] Alcala-Fdez J., Herrera F., Marquez F., Peregrin A Increasing fuzzy rules cooperation based onevolutionary adaptive inference systems. International Journal of Intelligence Systems, 22(9):1035-1064, 2007.
[4] Angeline P. J., Saunders G. M., Pollack J. P., An evolutionary algorithm that constructs recurrentneural networks. IEEE Trans. on Neural Networks. 5(1):54-65, 1994.
[5] Angeline P. J., Using selection to improve particle swarm optimization. In: Proceedings of the IEEEcongress on evolutionary computation, Anchorage, Alaska, 1998.
[6] Angelov P. P., Buswell R. A., Automatic generation of fuzzy rule-based models from data by geneticalgorithms. Information sciences, 15:17-31, 2003.
[7] Banks A., Vincent J., Anyakoha C., A review of particle swarm optimization. Part II: hybridisa-tion, combinatorial, multicriteria and constrained optimization, and indicative applications, NaturalComputing, 7(1):109-124, 2008.
[8] Baskar S., Suganthan P. N., A novel concurrent particle swarm optimization. In Proc. IEEE Congresson Evolutionary Computation, 792-796, 2004.
[9] Bedau M.A., McCaskill J.S., Packard N.H., et.al., Open problems in artificial life. Artificial Life,VI:363-76, 2000.
[10] Beni G., The concept of cellular robotic systems. In: Proc. of the IEEE Int. Symp. on IntelligentControl, 57-62, 1988.
[11] Beni G, Wang J. Swarm intelligence. In: Proc of the 7th annual meeting of the robotics society ofJapan. 425-428, 1989.
[12] Bergh F. V. D., An analysis of particle swarm optimizers. PhD thesis, Department of ComputerScience, University of Pretoria, Pretoria, South Africa, 2002.
[13] Bergh F. V. D., Engelbrecht A. P., Effect of swarm size on cooperative particle swarm optimizaters.In Proc. Genetic and Evolutionary Computation Conference, 2001.
[14] Bergh F. V. D., Engelbrecht A. P., A new locally convergent particle swarm optimizer. In: Proceed-ings of the IEEE conference systems, man and cybernetics, Hammamet, Tunisia, 2002.
[15] Bergh F. V. D., Engelbrecht A.P., A Cooperative Approach to Particle Swarm optimization. IEEETransactions on Evolutionary Computation, 8(3):225-239, 2004.
[16] Bergh F. V. D., Engelbrecht, A. P., A study of particle swarm optimization particle trajectories.Information Sciences, 176: 937-971, 2006.
[17] Beyer H. G., Theory of evolution strategies, Springer, 2001.
[18] Blum C., Roli A., Metaheuristics in combinatorial optimization: Overview and conceptual compar-ison. ACM Computing Surveys, 35(3):268-308, 2003.
[19] Brits R., Engelbrecht A.P., Bergh F. V. D., A niching particle swarm optimizer. In: Proceedings ofthe fourth Asia-Pacific conference on simulated evolution and learning, 2002.
[20] Box G. E. P., Jenkins G. M., Reinse G. C., Time Series Analysis: Forecasting and Control. Engle-wood Cliffs, NJ: Prentice-Hall, 1994.
[21] Campana E. F., Fasano G., Pinto A., Dynamic system analysis and initial particles position in par-ticle swarm optimization. In Proceedings of the IEEE swarm intelligence symposium, Indianapolis.Piscataway, 2006.
[22] Campana E. F., Fasano G., Peri D., Pinto A., Particle swarm optimization: Efficient globally conver-gent modifications. Proceedings of the III European conference on computational mechanics, solids,structures and coupled problems in engineering, Lisbon, Portugal, 2006.
[23] Casillas J., Cordon O., del Jesus M. J., Herrera F., Genetic tuning of fuzzy rule deep structurespreserving interpretability for linguistic modeling. IEEE Transactions on Fuzzy Systems, 13(1):13-29, 2005.
[24] Castro L. N. D., Fundamentals of natural computing: an overview. Physics of Life Reviews, 4(1):1-36, 2007.
[25] Chang X. G., Wei L., Farrell J., A C-means clustering based fuzzy modeling method. The NinthIEEE International Conference on Fuzzy Systems, 937-940, 2000.
[26] Chen C. C., A PSO-based method for extracting fuzzy rules directly from numerical data, Cybernet-ics and Systems, 37(7):707-723, 2006.
[27]陈泓娟,班晓娟等,人工生命的概念、内容和方法,北京科技大学学报,24(3):353-256,2002。
[28] Chiu S. L., Fuzzy model identification based on cluster estimation. Journal of Intelligent and FuzzySystems, 2(3):267-278,1994.
[29] Chiu S., Method and Software for Extracting Fuzzy Classification Subtractive Clustering, BiennialConference of the North American Fuzzy Information Processing Society-NAFIPS, 461-465, 1996.
[30] Clerc M., The swarm and the queen: towards a deterministic and adaptive particle swarm optimiza-tion. In: Proceedings of the IEEE Congress on Evolutionary Computation, 1951-1957, 1999.
[31] Clerc M., Kennedy J., The particle swarm―explosion, stability, and convergence in a multidimen-sional complex space. IEEE Transaction on Evolutionary Computation, 6(1):58-73, 2002.
[32] Combs W. E., Andrews J. E., Combinatorial rule explosion eliminated by a fuzzy rule configuration.IEEE Transactions on Fuzzy Systems, 6(1):1-11, 1998.
[33] Cordon O., Herrera F., A Two-Stage Evolutionary Process for Designing TSK Fuzzy Rule-BasedSystems. IEEE Transactions on Systems, Man, Cybernetics. B, Cybernetics, 29(6):703-715, 1999.
[34] Cordon O., Herrera F., Gomide F., Hoffmann F., Magdalena L., Ten years of genetic fuzzy systems:Current framework and new trends, in Proc. IFSA and NAFIPS, 1241-1246, 2001.
[35]崔万照,朱长纯等,混沌时间序列的支持向量机预测,物理学报,53(10):3303-3308,2004。
[36] Da Y., Ge X. R., An improved PSO-based ANN with simulated annealing technique, Neurocomput-ing, 63:527-533, 2005.
[37] Dorigo M., Stutzle T., Ant colony optimization. MIT Press, 2004.
[38] Dorigo M., Blum C.. Ant colony optimization theory: A survey. Theoretical Computer Science,344(2-3):243-78, 2005.
[39] Du H., Zhang N., Application of evolving Takagi-Sugeno fuzzy model to nonlinear system identifi-cation, Applied Soft Computing, 8:676-686, 2008.
[40] Eberhart R. C., Shi Y., Particle swarm optimization: developments, applications and resources.Proceedings of the IEEE Congress on Evolutionary Computation, Seoul, Korea, 27-30, 2001.
[41] Eftekhari M., Katebi S. D., Karimi M., Jahanmiri A. H., Eliciting transparent fuzzy model usingdifferential evolution, Applied Soft Computing 8:466-476, 2008.
[42] Engelbrecht A. P., Fundamentals of computational swarm intelligence. John Wiley & Sons, 2006.
[43] El-Abd M., Kamel M., Information exchange in multiple cooperating swarms. In Proc. IEEE SwarmIntelligence Symposium, 138-142, 2005.
[44] El-Abd M. and Kamel M. A taxonomy of cooperative search algorithms. In Proc. 2nd InternationalWorkshop on Hybrid Metaheuristics, LNCS 3636, 32-41, 2005.
[45] El-Abd M., Kamel M., Cooperative Particle Swarm Optimizers: A Powerful and Promising Ap-proach, Studies in Computational Intelligence, 31:239-259, Springer, Berlin, 2006.
[46] Fogel D. B., Evolutionary computation: the fossil record. The IEEE Press, 1998.
[47] Garrett S., How do we evaluate artificial immune systems. Evolutionary Computation, 13(2):145-78,2005.
[48] Ge H. W., Liang Y. C., Marchese M., A modified particle swarm optimization-based dynamic re-current neural network for identifying and controlling nonlinear systems. Computers and Structures,85:1611-1622, 2007.
[49] Ge H. W., Qian F., Liang Y. C., Du W. L., Wang L., Identification and control of nonlinear systemsby a dissimilation particle swarm optimization-based Elman neural network. Nonlinear Analysis:Real World Applications, 9:1345-1360, 2008.
[50] Geva A. B., ScaleNet-multiscale neural network architecture for time series prediction. IEEE Trans.on Neural Networks, 9(6):1471-1482, 1998.
[51] Goldberg D. E., Genetic algorithms in search, optimization and machine learning. Reading, MA:Addison-Wesley, 1989.
[52] Higashi N., Iba H., Particle swarm optimization with Gaussian mutation. In: Proceedings of theIEEE swarm intelligence symposium 2003, Indianapolis, Indiana, 72-79, 2003.
[53] Higashitani M., Ishigame A., Yasuda K., Particle Swarm Optimization Considering the Concept ofPredator-Prey Behavior, IEEE Congress on Evolutionary Computation, Vancouver, Canada, 434-437, 2006.
[54] Homaifar A., Mccormick E., Simultaneous design of membership functions and rule sets for fuzzycontrollers using genetic algorithms, IEEE Transactions on Fuzzy Systems, 3(2):129–139, 1995.
[55] Iyoda E. M., Nobuhara H., Hirota K., A solution for the N-bit parity problem using a single multi-plicative neuron. Neural Processing Letter, 18:233-238, 2003.
[56] Juang C. F., A hybrid of genetic algorithm and particle swarm optimization for recurrent networkdesign. IEEE Transactions on Systems, Man, Cybernetics, Part B: Cybernetics, 34(2):997-1006,2004.
[57] Kadirkamanathan V., Selvarajah K., Fleming P. J., Stability analysis of the particle dynamics inparticle swarm optimizer. IEEE Transactions on Evolutionary Computation, 10(3):245-255, 2006.
[58] Kang S. J., Woo C. H., Hwang H. S., Woo K. B., Evolutionary Design of Fuzzy Rule Base forNonlinear System Modeling and Control, IEEE Trans. Fuzzy Syst., 8(1):37-45, 2000.
[59] Karr C., Genetic algorithms for fuzzy controllers. AI Expert, 6(2):26-33, 1991.
[60] Kennedy J., Eberhart R.C., Particle swarm optimization. Proceedings of IEEE International Confer-ence on Neural Networks, 1942-1948, Perth, Australia, 1995.
[61] Kennedy J. The particle swarm: social adaptation of knowledge. In: Proceedings of the internationalconference on evolutionary computation, IEEE, Piscataway, NJ, 303-308, 1997.
[62] Kennedy J., Eberhart R. C., A discrete binary version of the particle swarm algorithm. Proceedingsof the World Multiconference on Systemics, Cybernetics and Informatics, 4104-4109, Piscataway,NJ, 1997.
[63] Kennedy J., The behavior of particles. Evolutionary programming VII: proceedings of the 7-th an-nual conference on evolutionary programming, 581-589, San Diego, 1998.
[64] Kennedy J., Eberhart R., Shi Y., Swarm intelligence. Morgan Kaufmann, 2001.
[65] Khosla A., Kumar S., Aggarwal K. K., A Framework for Identification of Fuzzy Models throughParticle Swarm Optimization, IEEE Indicon Conference, Chennai, India, 388-391, 2005.
[66] Khosla A., Kumar S., Ghosh K. R., A Comparison of Computational Efforts between Particle SwarmOptimization and Genetic Algorithm for Identification of Fuzzy Models, Annual Conference of theNorth American Fuzzy Information Processing Society - NAFIPS, 245-250, 2007.
[67] Kim K. J., Cho S. B., Evolutionary ensemble of diverse artificial neural networks using speciation.Neurocomputing, 71:1604-1618, 2008.
[68] Kim M. S., Kim C. H., Lee J. J., Evolving compact and interpretable Takagi-Sugeno fuzzy modelswith a new encoding scheme, IEEE Transactions on Systems, Man, Cybernetics, Part B: Cybernet-ics, 36(5):1006-1023, 2006.
[69] Koch C., Computation and single neuron. Nature, 385:207-210. 1997.
[70] Koch C., Segev, I., The role of single neurons in information processing. Nature neuroscience sup-plement, 3:1171-1177, 2000.
[71] Koza J. R., Genetic programming: on the programming of computers by means of natural selection.MIT Press, 1992.
[72] Krohling R. A., Coelho L. S., Coevolutionary Particle Swarm Optimization Using Gaussian Dis-tribution for Solving Constrained Optimization Problems, IEEE Transactions on Systems, Man,Cybernetics, Part B: Cybernetics, 36(6):1407-1416, 2006.
[73] Kukolj D., Levi E., Identification of Complex Systems Based on Neural and Takagi-Sugeno FuzzyModel, IEEE Transactions on Systems, Man, Cybernetics, Part B: Cybernetics, 34(1):272-282,2004.
[74] Leung H. F., Lam H. K., Ling S. H., Tam K. S., Tuning of the structure and parameters of neuralnetwork using an improved genetic algorithm, Proc. 27th Annu. Conf. IEEE Industrial ElectronicsSociety, 25-30, 2001.
[75] Leung H. F., Lam H. K., Ling S. H., Tam K. S., Tuning of the structure and parameters of a neuralnetwork using an improved genetic algorithm, 14(3):79-88, 2003.
[76] Li W., Yang Y. P., Yang Z., T-S Fuzzy Modeling Based on Support Vector Learning, ICIC 2006,LNCS 4113, 1294-1299, 2006.
[77]李卫,基于核方法的复杂系统模糊辨识研究,上海交通大学博士学位论文,2008。
[78] Lin Y., Cunningham G. A., A new approach to fuzzy-neural system modeling. IEEE Transactionson Fuzzy Systems, 3(2):190-198, 1995.
[79] Lin C. J., Lin C. T., Reinforcement learning for an ART-based fuzzy adaptive learning control net-work. IEEE Transactions on Neural Networks, 7(3):709-731, 1996.
[80] Lipton R. J., DNA solution of hard computational problems. Science, 268:542-545, 1995.
[81] Liang Y. H., Evolutionary neural network modeling for forecasting the field failure data of repairablesystems. Expert Systems with Applications, 33:1090-1096, 2007.
[82] Liang J. J., Qin A. K., Suganthan P. N., Baskar S., Comprehensive Learning Particle Swarm Opti-mizer for Global Optimization of Multimodal Functions. IEEE Transactions on Evolutionary Com-putation, 10(3):281-285, 2006.
[83] Lindenmayer A., Mathematical models for cellular interaction in development, parts I and II. Journalof Theoretical Biology, 18:280-315, 1968.
[84]刘福才,非线性系统的模糊模型辨识及其应用,北京:国防工业出版社,2006。
[85]刘文斌,朱翔鸥,王向红,陈丽春,DNA计算的研究进展,电子学报,34(11):2053-2058,2006。
[86] Lobjerg M., Rasmussen T. K., Krink T., Hybrid particle swarm optimizer with breeding and sub-populations. In: Proceedings of the genetic and evolutionary computation conference, 2001.
[87]马铭,基于数据驱动的模糊系统建模方法研究,吉林大学博士学位论文,2006。
[88] Mackey M., Glass L., Oscillation and chaos in physiological control systems. Science, 197:287-289,1977.
[89] Mamdani E. H., Application of Fuzzy Algorithms for Simple Dynamic Plant. Proceedings of IEEE,121:1585-1588, 1974.
[90] Mamdani E. H., An experiment in linguistic synthesis with a fuzzy logic controller. InternationalJournal of Man-Machine Studies, 7(1):1-13, 1975.
[91] Manevitz L., Birtar A., Giroli D., Neural network time series forecasting of finite element meshadaptation. Neurocomputing, 63: 447-463, 2005.
[92] Mendes R., Kennedy J., Neves J., The fully informed particle swarm: Simpler, maybe better. IEEETransactions on Evolutionary Computation, 8(3):204-210, 2004.
[93] McCulloch W., Pitts W. H., A logical calculus of the ideas immanent in nervous activity. Bulletin ofMathematical Biophysics, 5:115-133, 1943.
[94] McKenna T., Davis J., Zornetzer S. F., Single Neuron Computation(Neural Nets: Foundations toApplications). Academic Press, 1992.
[95] Miller G. F., Todd P. M., Hegde S. U., Designing neural networks using genetic algorithms, inProc. 3rd Int. Conf. Genetic Algorithms and Their Applications, J. D. Schaffer, Ed. San Mateo, CA:Morgan Kaufmann, 379-384, 1989.
[96] Millonas M. M., Swarms, phase transitions, and collective intelligence. In C. G. Langton (Ed.),Artificial Life III, 417-445. Reading, MA: Addison-Wesley, 1994.
[97] Niu B., Zhu Y. L., He X. X., Wu H., MCPSO: A multi-swarm cooperative particle swarm optimizer.Applied Mathematics and Computation, 185:1050-1062, 2007.
[98] Ozcan E., Mohan C. K., Analysis of a simple particle swarm optimization system. Intelligent Engi-neering Systems Through Artificial Neural Networks, 8:253-258, 1998.
[99] Ozcan E., Mohan C., Particle swarm optimization: surfing the waves. In Proceedings of the IEEEcongress on evolutionary computation 1939-1944, Piscataway, 1999.
[100] Palit A. K., Popovic D., Computational Intelligence in Time Series Forecasting: Theory and Engi-neering Applications. Springer-Verlag London Limited, 2005.
[101] Pedrycz W., Reformat M., Evolutionary Fuzzy Modeling, IEEE Transactions on Fuzzy Systems,11(5):652-665, 2003.
[102] Reyes C. A. P., Coevolutionary fuzzy modeling. Springer, Berlin, 2004.
[103] Percival D. B., Walden A. T.,程正兴著。时间序列分析的小波方法。北京:机械工业出版社,2006。
[104] Poli R., Kennedy J., Blackwell T., Particle swarm optimization: An overview. Swarm Intelligence.,1(1):33-57, 2007.
[105] Poli, R. (2007b, forthcoming). On the moments of the sampling distribution of particle swarmoptimisers. In Proceedings of the workshop on particle swarm optimization: the second decade ofthe genetic and evolutionary computation conference (GECCO), London, 2007.
[106] Poli R., Langdon W. B., Clerc M., Stephens C. R., Continuous optimization theory made easy?Finite-element models of evolutionary strategies, genetic algorithms and particle swarm optimizers.LNCS, Proceedings of the foundations of genetic algorithms workshop, Springer, Berlin, 2007.
[107] Pomares H., Rojas I., Ortega J., Gonzalez J., Prieto A., A systematic approach to a self-generatingfuzzy rule-table for function approximation. IEEE Transactions on Systems, Man, Cybernetics, PartB: Cybernetics, 30(3):431-447, 2000.
[108] Potter M. A., De Jong K. A., A cooperative coevolutionary approach to function optimization, inThe Third Parallel Problem Solving From Nature, 249-257, Springer-Verlag, Berlin, 1994.
[109] Potter M. A., De Jong K. A., Cooperative coevolution: An architecture for evolving coadaptedsubcomponents. Evolutionary Computation, 8(1):1-29, 2000.
[110] Salerno J., Using the particle swarm optimization technique to train a recurrent neural model, in:Ninth International Conference on Tools With Artificial Intelligence (ICTAI’97), IEEE Press, 1997.
[111] Schmitt, M., VC dimension bounds for higher-order neurons. Proceedings of the Ninth Interna-tional Conference on Artificial Neural Networks, 563-568, 1999.
[112] Setnes M., Roubos H., GA-Fuzzy Modeling and Classification: Complexity and Performance.IEEE Transactions on Fuzzy Systems, 8(5):509-522, 2000.
[113] Settles M., Rodebaugh B., Soule T., Comparison of genetic algorithm and particle swarm optimizerwhen evolving a recurrent neural network, in: Genetic and Evolutionary Computation-GECCO,2723:148-149, Chicago, 2003.
[114] Shi Y., Eberhart R. C., A modified particle swarm optimizer. In proceedings of the IEEE Congresson Evolutionary Computation, Piscataway, 69-73, 1998.
[115] Shi Y., Eberhart R. C., Empirical study of particle swarm optimization. Proceding of the IEEECongress on Evolutionary Computation, 1945-1950, Piscataway, 1999.
[116] Shi Y., Eberhart R., Chen Y., Implementation of evolutionary fuzzy systems. IEEE Transactions onFuzzy Systems, 7(2):109-119, 1999.
[117] Shimodaira H., A method for selecting similar learning data in the prediction of time series usingneural networks. Expert Systems with Applications, 10(3-4):429-434, 1996.
[118] Shu-Kai S. F., Zahara E., A hybrid simplex search and particle swarm optimization for uncon-strained optimization, European Journal of Operational Research, 181(2):527-548, 2007.
[119] Song Y., Chen Z. Q., Yuan Z. Z., New Chaotic PSO-Based Neural Network Predictive Control forNonlinear Process. IEEE Transations on Neural Networks, 18(2):595-601, 2007.
[120] Sugeno M., Kang G. T., Structure identification of fuzzy model. Fuzzy Sets and Systems, 28:15-33,1988.
[121] Sugeno M., Yasukawa T., A fuzzy-logic-based approach to qualitative modeling. IEEE Transac-tions on Fuzzy Systems, 1(1):7-31, 1993.
[122] Sun C. T., Rule-based structure identification in adaptive-network-based fuzzy inference system.IEEE Transactions on Fuzzy System, 2(1):64-73, 1994.
[123] Takagi T., Sugeno M., Fuzzy identification of systems and its application to modeling and control,IEEE Transactions on Systems, Man, Cybernetics, Part B: Cybernetics, 15(1):116-132, 1985.
[124] Talbi E., A taxonomy of hybrid metaheuristics. Journal of Heuristics, 8(5):541–564, 2002.
[125]唐春明,高协平,进化神经网络的研究进展,系统工程与电子技术,23(10):93-97,2001。
[126] Tang A. M., Quek C., Ng G.S., GA-TSKfnn: Parameters tuning of fuzzy neural network usinggenetic algorithms. Expert Systems with Applications, 29:769-781, 2005.
[127] Toulouse M., Crainic T. G., Sanso B., An experimental study of the systemic behavior of cooper-ative search algorithms. In Osman I. Voss S., Martello S., Roucairol C., editors, Meta-Heuristics:Advances and Trends in Local Search Paradigms, pages 373-392. Kluwer Academic Publishers,1999.
[128] Toulouse M., Crainic T. G., Sanso B., Thularisaman K., Self organization in cooperative tabusearch algorithms. In Proc. IEEE International Conference on Systmes, Man, and Cybernetics, 3,2379-2384, 1998.
[129] Tsai J. T., Chou J. H., Liu T.K., Tuning the Structure and Parameters of a Neural Network by UsingHybrid Taguchi-Genetic Algorithm, IEEE Transactions on Neural Networks, 17(1):69-80, 2006.
[130]谢晓锋,张文俊,杨之廉,微粒群算法综述,控制与决策,18(2):129-134,2003。
[131] Vapnik V., Statistical Learning Theory, John Wiley and Sons, Inc., New York, 1998.
[132] Wakuya H., Zurada J. M., Bidirectional computing architecture for time series prediction. NeuralNetworks, 14(9):1307-1321, 2001.
[133] Wang L. X., Fuzzy systems as universal approximators. IEEE international conference on fuzzysystems, San Diego, 1163-1170, 1992.
[134] Wang T. Y., Huang C. Y., Applying optimized BPN to a chaotic time series problem. Expert Sys-tems with Applications, 32:193-200, 2007.
[135] Wang H., Kwong S., Jin Y., Wei W., Man K.F., Multi-objective hierarchical genetic algorithmfor interpretable fuzzy rule-based knowledge extraction, Fuzzy Sets and Systems, 149(1):149-186,2005.
[136]王俊年,申群太,沈洪远,周鲜成,基于多种群协同进化微粒群算法的径向基神经网络设计,控制理论与应用,23(2):251-255,2006。
[137]王玫,朱云龙,何小贤,群体智能研究综述,计算机工程,31(22):194-196,2005。
[138] Wang L., Yen J., Extracting fuzzy rules for system modeling using a hybrid of genetic algorithmsand Kalman filter, Fuzzy Sets and Systems, 101:353-362, 1999.
[139] Wong C. C., Chen C. C., A GA-Based Method for Constructing Fuzzy Systems Directly fromNumerical Data. IEEE Transactions on Systems, Man, Cybernetics, Part B: Cybernetics, 30(6):904-911, 2000.
[140]夏培肃,量子计算,计算机研究与发展,38(10):1153-1171,2001。
[141] Yadav R. N., Kalra P. K., John J., Time series prediction with single multiplicative neuron model.Applied Soft Computing, 7:1157-1163, 2007.
[142] Yadav, A., Mishra, D., Yadav, R. N., Ray, S., Kalra, P. K., Time series prediction with singleintegrate-and-fire neuron. Applied Soft Computing, 7:739-745, 2007.
[143] Yager R., Filev D.F., Generation of fuzzy rules by mountain clustering, J. of Intelligent and FuzzySystems, 2(3):209-219, 1994.
[144]阎平凡,张长水编著,人工神经网络与模拟进化计算,清华大学出版社,2005。
[145] Yao X., Liu Y., Towards designing artifieial neural networks by evolution. APPlied Mathematiesand ComPutation, 91:83-90, 1998.
[146] Yao X., Liu Y., A new evolutionary system for evolving artificial neural networks, IEEE Transac-tions on Neural Networks, 8(3):694-713, 1997.
[147] Yao X., Evolving artificial neural networks, Proc. IEEE. 87(9):1423-1447, 1999.
[148] Yen J., Wang L., Simplifying fuzzy rule-based models using orthogonal transformation methods.IEEE Transactions on Systems, Man, Cybernetics, Part B: Cybernetics, 29(1):13-24, 1999.
[149] Yu J. B., Wang S. J., Xi L. F., Evolving artificial neural networks using an improved PSO andDPSO. Neurocomputing, 71:1054-1060, 2008.
[150] Zadeh L. A., Fuzzy Sets, Journal of Information and Control, 8:338-353, 1965.
[151] Zadeh L. A., Fuzzy algorithms, Information and Control, 12:94-102, 1968.
[152] Zadeh L.A., Fuzzy Logic, IEEE Computer Journal, 1:18-18, 1988.
[153] Zhang W. J., Xie X. F., DEPSO: hybrid particle swarm with differential evolution operator. In:IEEE interenational conference on systems, man and cybernetics(SMCC), Washington DC, USA,3816-3821, 2003.
[154] Zhang J. R., Zhang J., Lok T. M., Lyu M. R., A hybrid particle swarm optimization-back-propagation algorithm for feedforward neural network training. Applied Mathematics and Com-putation, 185: 1026-1037, 2007.
[155]张善文等编著,MATLAB在时间序列分析中的应用,西安:西安电子科技大学出版社,2007年4月。
[156]张泽明,人工免疫算法及其应用研究,中国科学技术大学博士学位论文,2007。
[2] Adleman L. M., Molecular computation of solutions to combinatorial problems. Science, 226:1021-1024, 1994.
[3] Alcala-Fdez J., Herrera F., Marquez F., Peregrin A Increasing fuzzy rules cooperation based onevolutionary adaptive inference systems. International Journal of Intelligence Systems, 22(9):1035-1064, 2007.
[4] Angeline P. J., Saunders G. M., Pollack J. P., An evolutionary algorithm that constructs recurrentneural networks. IEEE Trans. on Neural Networks. 5(1):54-65, 1994.
[5] Angeline P. J., Using selection to improve particle swarm optimization. In: Proceedings of the IEEEcongress on evolutionary computation, Anchorage, Alaska, 1998.
[6] Angelov P. P., Buswell R. A., Automatic generation of fuzzy rule-based models from data by geneticalgorithms. Information sciences, 15:17-31, 2003.
[7] Banks A., Vincent J., Anyakoha C., A review of particle swarm optimization. Part II: hybridisa-tion, combinatorial, multicriteria and constrained optimization, and indicative applications, NaturalComputing, 7(1):109-124, 2008.
[8] Baskar S., Suganthan P. N., A novel concurrent particle swarm optimization. In Proc. IEEE Congresson Evolutionary Computation, 792-796, 2004.
[9] Bedau M.A., McCaskill J.S., Packard N.H., et.al., Open problems in artificial life. Artificial Life,VI:363-76, 2000.
[10] Beni G., The concept of cellular robotic systems. In: Proc. of the IEEE Int. Symp. on IntelligentControl, 57-62, 1988.
[11] Beni G, Wang J. Swarm intelligence. In: Proc of the 7th annual meeting of the robotics society ofJapan. 425-428, 1989.
[12] Bergh F. V. D., An analysis of particle swarm optimizers. PhD thesis, Department of ComputerScience, University of Pretoria, Pretoria, South Africa, 2002.
[13] Bergh F. V. D., Engelbrecht A. P., Effect of swarm size on cooperative particle swarm optimizaters.In Proc. Genetic and Evolutionary Computation Conference, 2001.
[14] Bergh F. V. D., Engelbrecht A. P., A new locally convergent particle swarm optimizer. In: Proceed-ings of the IEEE conference systems, man and cybernetics, Hammamet, Tunisia, 2002.
[15] Bergh F. V. D., Engelbrecht A.P., A Cooperative Approach to Particle Swarm optimization. IEEETransactions on Evolutionary Computation, 8(3):225-239, 2004.
[16] Bergh F. V. D., Engelbrecht, A. P., A study of particle swarm optimization particle trajectories.Information Sciences, 176: 937-971, 2006.
[17] Beyer H. G., Theory of evolution strategies, Springer, 2001.
[18] Blum C., Roli A., Metaheuristics in combinatorial optimization: Overview and conceptual compar-ison. ACM Computing Surveys, 35(3):268-308, 2003.
[19] Brits R., Engelbrecht A.P., Bergh F. V. D., A niching particle swarm optimizer. In: Proceedings ofthe fourth Asia-Pacific conference on simulated evolution and learning, 2002.
[20] Box G. E. P., Jenkins G. M., Reinse G. C., Time Series Analysis: Forecasting and Control. Engle-wood Cliffs, NJ: Prentice-Hall, 1994.
[21] Campana E. F., Fasano G., Pinto A., Dynamic system analysis and initial particles position in par-ticle swarm optimization. In Proceedings of the IEEE swarm intelligence symposium, Indianapolis.Piscataway, 2006.
[22] Campana E. F., Fasano G., Peri D., Pinto A., Particle swarm optimization: Efficient globally conver-gent modifications. Proceedings of the III European conference on computational mechanics, solids,structures and coupled problems in engineering, Lisbon, Portugal, 2006.
[23] Casillas J., Cordon O., del Jesus M. J., Herrera F., Genetic tuning of fuzzy rule deep structurespreserving interpretability for linguistic modeling. IEEE Transactions on Fuzzy Systems, 13(1):13-29, 2005.
[24] Castro L. N. D., Fundamentals of natural computing: an overview. Physics of Life Reviews, 4(1):1-36, 2007.
[25] Chang X. G., Wei L., Farrell J., A C-means clustering based fuzzy modeling method. The NinthIEEE International Conference on Fuzzy Systems, 937-940, 2000.
[26] Chen C. C., A PSO-based method for extracting fuzzy rules directly from numerical data, Cybernet-ics and Systems, 37(7):707-723, 2006.
[27]陈泓娟,班晓娟等,人工生命的概念、内容和方法,北京科技大学学报,24(3):353-256,2002。
[28] Chiu S. L., Fuzzy model identification based on cluster estimation. Journal of Intelligent and FuzzySystems, 2(3):267-278,1994.
[29] Chiu S., Method and Software for Extracting Fuzzy Classification Subtractive Clustering, BiennialConference of the North American Fuzzy Information Processing Society-NAFIPS, 461-465, 1996.
[30] Clerc M., The swarm and the queen: towards a deterministic and adaptive particle swarm optimiza-tion. In: Proceedings of the IEEE Congress on Evolutionary Computation, 1951-1957, 1999.
[31] Clerc M., Kennedy J., The particle swarm―explosion, stability, and convergence in a multidimen-sional complex space. IEEE Transaction on Evolutionary Computation, 6(1):58-73, 2002.
[32] Combs W. E., Andrews J. E., Combinatorial rule explosion eliminated by a fuzzy rule configuration.IEEE Transactions on Fuzzy Systems, 6(1):1-11, 1998.
[33] Cordon O., Herrera F., A Two-Stage Evolutionary Process for Designing TSK Fuzzy Rule-BasedSystems. IEEE Transactions on Systems, Man, Cybernetics. B, Cybernetics, 29(6):703-715, 1999.
[34] Cordon O., Herrera F., Gomide F., Hoffmann F., Magdalena L., Ten years of genetic fuzzy systems:Current framework and new trends, in Proc. IFSA and NAFIPS, 1241-1246, 2001.
[35]崔万照,朱长纯等,混沌时间序列的支持向量机预测,物理学报,53(10):3303-3308,2004。
[36] Da Y., Ge X. R., An improved PSO-based ANN with simulated annealing technique, Neurocomput-ing, 63:527-533, 2005.
[37] Dorigo M., Stutzle T., Ant colony optimization. MIT Press, 2004.
[38] Dorigo M., Blum C.. Ant colony optimization theory: A survey. Theoretical Computer Science,344(2-3):243-78, 2005.
[39] Du H., Zhang N., Application of evolving Takagi-Sugeno fuzzy model to nonlinear system identifi-cation, Applied Soft Computing, 8:676-686, 2008.
[40] Eberhart R. C., Shi Y., Particle swarm optimization: developments, applications and resources.Proceedings of the IEEE Congress on Evolutionary Computation, Seoul, Korea, 27-30, 2001.
[41] Eftekhari M., Katebi S. D., Karimi M., Jahanmiri A. H., Eliciting transparent fuzzy model usingdifferential evolution, Applied Soft Computing 8:466-476, 2008.
[42] Engelbrecht A. P., Fundamentals of computational swarm intelligence. John Wiley & Sons, 2006.
[43] El-Abd M., Kamel M., Information exchange in multiple cooperating swarms. In Proc. IEEE SwarmIntelligence Symposium, 138-142, 2005.
[44] El-Abd M. and Kamel M. A taxonomy of cooperative search algorithms. In Proc. 2nd InternationalWorkshop on Hybrid Metaheuristics, LNCS 3636, 32-41, 2005.
[45] El-Abd M., Kamel M., Cooperative Particle Swarm Optimizers: A Powerful and Promising Ap-proach, Studies in Computational Intelligence, 31:239-259, Springer, Berlin, 2006.
[46] Fogel D. B., Evolutionary computation: the fossil record. The IEEE Press, 1998.
[47] Garrett S., How do we evaluate artificial immune systems. Evolutionary Computation, 13(2):145-78,2005.
[48] Ge H. W., Liang Y. C., Marchese M., A modified particle swarm optimization-based dynamic re-current neural network for identifying and controlling nonlinear systems. Computers and Structures,85:1611-1622, 2007.
[49] Ge H. W., Qian F., Liang Y. C., Du W. L., Wang L., Identification and control of nonlinear systemsby a dissimilation particle swarm optimization-based Elman neural network. Nonlinear Analysis:Real World Applications, 9:1345-1360, 2008.
[50] Geva A. B., ScaleNet-multiscale neural network architecture for time series prediction. IEEE Trans.on Neural Networks, 9(6):1471-1482, 1998.
[51] Goldberg D. E., Genetic algorithms in search, optimization and machine learning. Reading, MA:Addison-Wesley, 1989.
[52] Higashi N., Iba H., Particle swarm optimization with Gaussian mutation. In: Proceedings of theIEEE swarm intelligence symposium 2003, Indianapolis, Indiana, 72-79, 2003.
[53] Higashitani M., Ishigame A., Yasuda K., Particle Swarm Optimization Considering the Concept ofPredator-Prey Behavior, IEEE Congress on Evolutionary Computation, Vancouver, Canada, 434-437, 2006.
[54] Homaifar A., Mccormick E., Simultaneous design of membership functions and rule sets for fuzzycontrollers using genetic algorithms, IEEE Transactions on Fuzzy Systems, 3(2):129–139, 1995.
[55] Iyoda E. M., Nobuhara H., Hirota K., A solution for the N-bit parity problem using a single multi-plicative neuron. Neural Processing Letter, 18:233-238, 2003.
[56] Juang C. F., A hybrid of genetic algorithm and particle swarm optimization for recurrent networkdesign. IEEE Transactions on Systems, Man, Cybernetics, Part B: Cybernetics, 34(2):997-1006,2004.
[57] Kadirkamanathan V., Selvarajah K., Fleming P. J., Stability analysis of the particle dynamics inparticle swarm optimizer. IEEE Transactions on Evolutionary Computation, 10(3):245-255, 2006.
[58] Kang S. J., Woo C. H., Hwang H. S., Woo K. B., Evolutionary Design of Fuzzy Rule Base forNonlinear System Modeling and Control, IEEE Trans. Fuzzy Syst., 8(1):37-45, 2000.
[59] Karr C., Genetic algorithms for fuzzy controllers. AI Expert, 6(2):26-33, 1991.
[60] Kennedy J., Eberhart R.C., Particle swarm optimization. Proceedings of IEEE International Confer-ence on Neural Networks, 1942-1948, Perth, Australia, 1995.
[61] Kennedy J. The particle swarm: social adaptation of knowledge. In: Proceedings of the internationalconference on evolutionary computation, IEEE, Piscataway, NJ, 303-308, 1997.
[62] Kennedy J., Eberhart R. C., A discrete binary version of the particle swarm algorithm. Proceedingsof the World Multiconference on Systemics, Cybernetics and Informatics, 4104-4109, Piscataway,NJ, 1997.
[63] Kennedy J., The behavior of particles. Evolutionary programming VII: proceedings of the 7-th an-nual conference on evolutionary programming, 581-589, San Diego, 1998.
[64] Kennedy J., Eberhart R., Shi Y., Swarm intelligence. Morgan Kaufmann, 2001.
[65] Khosla A., Kumar S., Aggarwal K. K., A Framework for Identification of Fuzzy Models throughParticle Swarm Optimization, IEEE Indicon Conference, Chennai, India, 388-391, 2005.
[66] Khosla A., Kumar S., Ghosh K. R., A Comparison of Computational Efforts between Particle SwarmOptimization and Genetic Algorithm for Identification of Fuzzy Models, Annual Conference of theNorth American Fuzzy Information Processing Society - NAFIPS, 245-250, 2007.
[67] Kim K. J., Cho S. B., Evolutionary ensemble of diverse artificial neural networks using speciation.Neurocomputing, 71:1604-1618, 2008.
[68] Kim M. S., Kim C. H., Lee J. J., Evolving compact and interpretable Takagi-Sugeno fuzzy modelswith a new encoding scheme, IEEE Transactions on Systems, Man, Cybernetics, Part B: Cybernet-ics, 36(5):1006-1023, 2006.
[69] Koch C., Computation and single neuron. Nature, 385:207-210. 1997.
[70] Koch C., Segev, I., The role of single neurons in information processing. Nature neuroscience sup-plement, 3:1171-1177, 2000.
[71] Koza J. R., Genetic programming: on the programming of computers by means of natural selection.MIT Press, 1992.
[72] Krohling R. A., Coelho L. S., Coevolutionary Particle Swarm Optimization Using Gaussian Dis-tribution for Solving Constrained Optimization Problems, IEEE Transactions on Systems, Man,Cybernetics, Part B: Cybernetics, 36(6):1407-1416, 2006.
[73] Kukolj D., Levi E., Identification of Complex Systems Based on Neural and Takagi-Sugeno FuzzyModel, IEEE Transactions on Systems, Man, Cybernetics, Part B: Cybernetics, 34(1):272-282,2004.
[74] Leung H. F., Lam H. K., Ling S. H., Tam K. S., Tuning of the structure and parameters of neuralnetwork using an improved genetic algorithm, Proc. 27th Annu. Conf. IEEE Industrial ElectronicsSociety, 25-30, 2001.
[75] Leung H. F., Lam H. K., Ling S. H., Tam K. S., Tuning of the structure and parameters of a neuralnetwork using an improved genetic algorithm, 14(3):79-88, 2003.
[76] Li W., Yang Y. P., Yang Z., T-S Fuzzy Modeling Based on Support Vector Learning, ICIC 2006,LNCS 4113, 1294-1299, 2006.
[77]李卫,基于核方法的复杂系统模糊辨识研究,上海交通大学博士学位论文,2008。
[78] Lin Y., Cunningham G. A., A new approach to fuzzy-neural system modeling. IEEE Transactionson Fuzzy Systems, 3(2):190-198, 1995.
[79] Lin C. J., Lin C. T., Reinforcement learning for an ART-based fuzzy adaptive learning control net-work. IEEE Transactions on Neural Networks, 7(3):709-731, 1996.
[80] Lipton R. J., DNA solution of hard computational problems. Science, 268:542-545, 1995.
[81] Liang Y. H., Evolutionary neural network modeling for forecasting the field failure data of repairablesystems. Expert Systems with Applications, 33:1090-1096, 2007.
[82] Liang J. J., Qin A. K., Suganthan P. N., Baskar S., Comprehensive Learning Particle Swarm Opti-mizer for Global Optimization of Multimodal Functions. IEEE Transactions on Evolutionary Com-putation, 10(3):281-285, 2006.
[83] Lindenmayer A., Mathematical models for cellular interaction in development, parts I and II. Journalof Theoretical Biology, 18:280-315, 1968.
[84]刘福才,非线性系统的模糊模型辨识及其应用,北京:国防工业出版社,2006。
[85]刘文斌,朱翔鸥,王向红,陈丽春,DNA计算的研究进展,电子学报,34(11):2053-2058,2006。
[86] Lobjerg M., Rasmussen T. K., Krink T., Hybrid particle swarm optimizer with breeding and sub-populations. In: Proceedings of the genetic and evolutionary computation conference, 2001.
[87]马铭,基于数据驱动的模糊系统建模方法研究,吉林大学博士学位论文,2006。
[88] Mackey M., Glass L., Oscillation and chaos in physiological control systems. Science, 197:287-289,1977.
[89] Mamdani E. H., Application of Fuzzy Algorithms for Simple Dynamic Plant. Proceedings of IEEE,121:1585-1588, 1974.
[90] Mamdani E. H., An experiment in linguistic synthesis with a fuzzy logic controller. InternationalJournal of Man-Machine Studies, 7(1):1-13, 1975.
[91] Manevitz L., Birtar A., Giroli D., Neural network time series forecasting of finite element meshadaptation. Neurocomputing, 63: 447-463, 2005.
[92] Mendes R., Kennedy J., Neves J., The fully informed particle swarm: Simpler, maybe better. IEEETransactions on Evolutionary Computation, 8(3):204-210, 2004.
[93] McCulloch W., Pitts W. H., A logical calculus of the ideas immanent in nervous activity. Bulletin ofMathematical Biophysics, 5:115-133, 1943.
[94] McKenna T., Davis J., Zornetzer S. F., Single Neuron Computation(Neural Nets: Foundations toApplications). Academic Press, 1992.
[95] Miller G. F., Todd P. M., Hegde S. U., Designing neural networks using genetic algorithms, inProc. 3rd Int. Conf. Genetic Algorithms and Their Applications, J. D. Schaffer, Ed. San Mateo, CA:Morgan Kaufmann, 379-384, 1989.
[96] Millonas M. M., Swarms, phase transitions, and collective intelligence. In C. G. Langton (Ed.),Artificial Life III, 417-445. Reading, MA: Addison-Wesley, 1994.
[97] Niu B., Zhu Y. L., He X. X., Wu H., MCPSO: A multi-swarm cooperative particle swarm optimizer.Applied Mathematics and Computation, 185:1050-1062, 2007.
[98] Ozcan E., Mohan C. K., Analysis of a simple particle swarm optimization system. Intelligent Engi-neering Systems Through Artificial Neural Networks, 8:253-258, 1998.
[99] Ozcan E., Mohan C., Particle swarm optimization: surfing the waves. In Proceedings of the IEEEcongress on evolutionary computation 1939-1944, Piscataway, 1999.
[100] Palit A. K., Popovic D., Computational Intelligence in Time Series Forecasting: Theory and Engi-neering Applications. Springer-Verlag London Limited, 2005.
[101] Pedrycz W., Reformat M., Evolutionary Fuzzy Modeling, IEEE Transactions on Fuzzy Systems,11(5):652-665, 2003.
[102] Reyes C. A. P., Coevolutionary fuzzy modeling. Springer, Berlin, 2004.
[103] Percival D. B., Walden A. T.,程正兴著。时间序列分析的小波方法。北京:机械工业出版社,2006。
[104] Poli R., Kennedy J., Blackwell T., Particle swarm optimization: An overview. Swarm Intelligence.,1(1):33-57, 2007.
[105] Poli, R. (2007b, forthcoming). On the moments of the sampling distribution of particle swarmoptimisers. In Proceedings of the workshop on particle swarm optimization: the second decade ofthe genetic and evolutionary computation conference (GECCO), London, 2007.
[106] Poli R., Langdon W. B., Clerc M., Stephens C. R., Continuous optimization theory made easy?Finite-element models of evolutionary strategies, genetic algorithms and particle swarm optimizers.LNCS, Proceedings of the foundations of genetic algorithms workshop, Springer, Berlin, 2007.
[107] Pomares H., Rojas I., Ortega J., Gonzalez J., Prieto A., A systematic approach to a self-generatingfuzzy rule-table for function approximation. IEEE Transactions on Systems, Man, Cybernetics, PartB: Cybernetics, 30(3):431-447, 2000.
[108] Potter M. A., De Jong K. A., A cooperative coevolutionary approach to function optimization, inThe Third Parallel Problem Solving From Nature, 249-257, Springer-Verlag, Berlin, 1994.
[109] Potter M. A., De Jong K. A., Cooperative coevolution: An architecture for evolving coadaptedsubcomponents. Evolutionary Computation, 8(1):1-29, 2000.
[110] Salerno J., Using the particle swarm optimization technique to train a recurrent neural model, in:Ninth International Conference on Tools With Artificial Intelligence (ICTAI’97), IEEE Press, 1997.
[111] Schmitt, M., VC dimension bounds for higher-order neurons. Proceedings of the Ninth Interna-tional Conference on Artificial Neural Networks, 563-568, 1999.
[112] Setnes M., Roubos H., GA-Fuzzy Modeling and Classification: Complexity and Performance.IEEE Transactions on Fuzzy Systems, 8(5):509-522, 2000.
[113] Settles M., Rodebaugh B., Soule T., Comparison of genetic algorithm and particle swarm optimizerwhen evolving a recurrent neural network, in: Genetic and Evolutionary Computation-GECCO,2723:148-149, Chicago, 2003.
[114] Shi Y., Eberhart R. C., A modified particle swarm optimizer. In proceedings of the IEEE Congresson Evolutionary Computation, Piscataway, 69-73, 1998.
[115] Shi Y., Eberhart R. C., Empirical study of particle swarm optimization. Proceding of the IEEECongress on Evolutionary Computation, 1945-1950, Piscataway, 1999.
[116] Shi Y., Eberhart R., Chen Y., Implementation of evolutionary fuzzy systems. IEEE Transactions onFuzzy Systems, 7(2):109-119, 1999.
[117] Shimodaira H., A method for selecting similar learning data in the prediction of time series usingneural networks. Expert Systems with Applications, 10(3-4):429-434, 1996.
[118] Shu-Kai S. F., Zahara E., A hybrid simplex search and particle swarm optimization for uncon-strained optimization, European Journal of Operational Research, 181(2):527-548, 2007.
[119] Song Y., Chen Z. Q., Yuan Z. Z., New Chaotic PSO-Based Neural Network Predictive Control forNonlinear Process. IEEE Transations on Neural Networks, 18(2):595-601, 2007.
[120] Sugeno M., Kang G. T., Structure identification of fuzzy model. Fuzzy Sets and Systems, 28:15-33,1988.
[121] Sugeno M., Yasukawa T., A fuzzy-logic-based approach to qualitative modeling. IEEE Transac-tions on Fuzzy Systems, 1(1):7-31, 1993.
[122] Sun C. T., Rule-based structure identification in adaptive-network-based fuzzy inference system.IEEE Transactions on Fuzzy System, 2(1):64-73, 1994.
[123] Takagi T., Sugeno M., Fuzzy identification of systems and its application to modeling and control,IEEE Transactions on Systems, Man, Cybernetics, Part B: Cybernetics, 15(1):116-132, 1985.
[124] Talbi E., A taxonomy of hybrid metaheuristics. Journal of Heuristics, 8(5):541–564, 2002.
[125]唐春明,高协平,进化神经网络的研究进展,系统工程与电子技术,23(10):93-97,2001。
[126] Tang A. M., Quek C., Ng G.S., GA-TSKfnn: Parameters tuning of fuzzy neural network usinggenetic algorithms. Expert Systems with Applications, 29:769-781, 2005.
[127] Toulouse M., Crainic T. G., Sanso B., An experimental study of the systemic behavior of cooper-ative search algorithms. In Osman I. Voss S., Martello S., Roucairol C., editors, Meta-Heuristics:Advances and Trends in Local Search Paradigms, pages 373-392. Kluwer Academic Publishers,1999.
[128] Toulouse M., Crainic T. G., Sanso B., Thularisaman K., Self organization in cooperative tabusearch algorithms. In Proc. IEEE International Conference on Systmes, Man, and Cybernetics, 3,2379-2384, 1998.
[129] Tsai J. T., Chou J. H., Liu T.K., Tuning the Structure and Parameters of a Neural Network by UsingHybrid Taguchi-Genetic Algorithm, IEEE Transactions on Neural Networks, 17(1):69-80, 2006.
[130]谢晓锋,张文俊,杨之廉,微粒群算法综述,控制与决策,18(2):129-134,2003。
[131] Vapnik V., Statistical Learning Theory, John Wiley and Sons, Inc., New York, 1998.
[132] Wakuya H., Zurada J. M., Bidirectional computing architecture for time series prediction. NeuralNetworks, 14(9):1307-1321, 2001.
[133] Wang L. X., Fuzzy systems as universal approximators. IEEE international conference on fuzzysystems, San Diego, 1163-1170, 1992.
[134] Wang T. Y., Huang C. Y., Applying optimized BPN to a chaotic time series problem. Expert Sys-tems with Applications, 32:193-200, 2007.
[135] Wang H., Kwong S., Jin Y., Wei W., Man K.F., Multi-objective hierarchical genetic algorithmfor interpretable fuzzy rule-based knowledge extraction, Fuzzy Sets and Systems, 149(1):149-186,2005.
[136]王俊年,申群太,沈洪远,周鲜成,基于多种群协同进化微粒群算法的径向基神经网络设计,控制理论与应用,23(2):251-255,2006。
[137]王玫,朱云龙,何小贤,群体智能研究综述,计算机工程,31(22):194-196,2005。
[138] Wang L., Yen J., Extracting fuzzy rules for system modeling using a hybrid of genetic algorithmsand Kalman filter, Fuzzy Sets and Systems, 101:353-362, 1999.
[139] Wong C. C., Chen C. C., A GA-Based Method for Constructing Fuzzy Systems Directly fromNumerical Data. IEEE Transactions on Systems, Man, Cybernetics, Part B: Cybernetics, 30(6):904-911, 2000.
[140]夏培肃,量子计算,计算机研究与发展,38(10):1153-1171,2001。
[141] Yadav R. N., Kalra P. K., John J., Time series prediction with single multiplicative neuron model.Applied Soft Computing, 7:1157-1163, 2007.
[142] Yadav, A., Mishra, D., Yadav, R. N., Ray, S., Kalra, P. K., Time series prediction with singleintegrate-and-fire neuron. Applied Soft Computing, 7:739-745, 2007.
[143] Yager R., Filev D.F., Generation of fuzzy rules by mountain clustering, J. of Intelligent and FuzzySystems, 2(3):209-219, 1994.
[144]阎平凡,张长水编著,人工神经网络与模拟进化计算,清华大学出版社,2005。
[145] Yao X., Liu Y., Towards designing artifieial neural networks by evolution. APPlied Mathematiesand ComPutation, 91:83-90, 1998.
[146] Yao X., Liu Y., A new evolutionary system for evolving artificial neural networks, IEEE Transac-tions on Neural Networks, 8(3):694-713, 1997.
[147] Yao X., Evolving artificial neural networks, Proc. IEEE. 87(9):1423-1447, 1999.
[148] Yen J., Wang L., Simplifying fuzzy rule-based models using orthogonal transformation methods.IEEE Transactions on Systems, Man, Cybernetics, Part B: Cybernetics, 29(1):13-24, 1999.
[149] Yu J. B., Wang S. J., Xi L. F., Evolving artificial neural networks using an improved PSO andDPSO. Neurocomputing, 71:1054-1060, 2008.
[150] Zadeh L. A., Fuzzy Sets, Journal of Information and Control, 8:338-353, 1965.
[151] Zadeh L. A., Fuzzy algorithms, Information and Control, 12:94-102, 1968.
[152] Zadeh L.A., Fuzzy Logic, IEEE Computer Journal, 1:18-18, 1988.
[153] Zhang W. J., Xie X. F., DEPSO: hybrid particle swarm with differential evolution operator. In:IEEE interenational conference on systems, man and cybernetics(SMCC), Washington DC, USA,3816-3821, 2003.
[154] Zhang J. R., Zhang J., Lok T. M., Lyu M. R., A hybrid particle swarm optimization-back-propagation algorithm for feedforward neural network training. Applied Mathematics and Com-putation, 185: 1026-1037, 2007.
[155]张善文等编著,MATLAB在时间序列分析中的应用,西安:西安电子科技大学出版社,2007年4月。
[156]张泽明,人工免疫算法及其应用研究,中国科学技术大学博士学位论文,2007。