免疫混合算法及其在数据挖掘和优化中的应用研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
生物免疫系统是一个高度进化的生物系统,从计算的角度来看,生物免疫系统是一个高度并行、分布、自适应和自组织的系统,具有很强的学习、识别、记忆和特征提取能力。人们基于生物免疫系统开发了人工免疫系统,借鉴免疫系统的功能和原理用于解决复杂问题。本文在深入研究人工免疫系统的基础上,分析了免疫系统在增量学习方面的优势,将其用于弥补PSO算法该方面的缺点,然后又讨论了免疫聚类算法设计模型,最后分析了免疫优化系统目前存在的缺点,并提出了有效的解决办法。
     本文首先对数据分类进行了探讨。当前各个领域中的目标数据越来越庞大,对算法增量学习能力的要求也越来越高。免疫记忆机制作为AIRS增量学习能力的核心,可为其他算法所用。本文针对PSO算法在增量学习方面的弊端,引入AIRS的免疫记忆机制,开发了一种免疫混合PSO增量分类算法。通过在若干UCI标准数据集上进行的仿真,证明该混合算法具有增量学习能力,且在分类准确率方面也比一些经典分类方法具有优势。
     其次分析了聚类问题中的免疫方法,针对目前免疫聚类方法繁多,却没有一个系统的算法设计框架的问题,本文通过对一个成功的免疫聚类算法—aiNet的深入研究和归纳总结,提出了一个系统的免疫聚类算法设计框架。该设计框架将聚类算法的设计分割成了五个主要部分,并对每个部分采用的设计思想进行了细致的阐述,为新算法的设计给出了框架上的指导。
     最后深入探讨了免疫算法在优化问题中的应用,针对opt-aiNet算法种群无规律变异导致其在单目标优化中收敛速度降低的问题,本文对opt-aiNet算法抗体的变异过程进行了改进,引入了PSO算法中粒子飞行的策略,使抗体具有了有方向变异的能力,提出了一种具有双变异机制的opt-aiNet算法。本文还将新算法应用于无线网络规划问题,与无线网络规划中普遍应用的GA相比能更快更好地发现全局最优解,同时和传统opt-aiNet相比在搜索效率上有了较大提高。
Artificial immune system (AIS) was developed based on biological immune system which is a highly parallel, distributed, adaptive and self-organizing system, and has a strong learning, recognition, memory,,and feature extraction capabilities. In this dissertation an immune memory strategy was used to make up the weakness of PSO. Then a framework for algorithm designing was discussed. Furthermore a shortcoming of immune optimization algorithm was studied, and an effective solution was proposed. The main contributions of this dissertation are described as follows:
     Firstly, classification problem was discussed. Due to the scale of target data for classification task was growing larger, a incremental learning technology was required. In order to make up the drawbacks of PSO in incremental learning abilities, the AIRS memory strategy was injected, and a hybird algorithm--AIR-PSO was presentd. Later AIR-PSO was tested on a number of UCI standard data sets. It showed that the hybrid algorithm had the ability of incremental learning, and also had the advantage in classification accuracy.
     Secondly, a general framework for immune clustering algorithm was discussed. Based on a depth study on aiNet process, a general framework for immune clustering algorithms was proposed. The framework was build up by five parts, and each part adopted a lot of crucial methods. The framework gave a systematic guidance for the design of new algorithms.
     Finally, the immune optimization algorithm was studied. Opt-aiNet algorithm encountered a lower convergence rate in single objective problems sometimes. Studies have shown that the random mutation of the population may lead to this problem. Then an oriented mutaion process inspired by PSO evolution strategies was proposed, and a bi-mutaion opt-aiNet was raised up. After that the bi-mutaion opt-aiNet was applied to the wireless network planning, and achieved a better result than GA and the traditional opt-aiNet.
引文
[1]Pedrycz W. Computational intelligence and visual computing:an emerging technology for software engineering[J]. Soft Computing.2002, vol.7:33-44.
    [2]Timmis J, Knight T. Artificial immune system:Using the immune system as inspiration for data mining. Data Mining:A Heuristic Approach. Hershey:Idea Publishing Group,2001.
    [3]De Castro L N, Timmis J. Artificial immune systems as a novel soft computing paradigm[J]. Soft Computing.2003, vol.7:526-544.
    [4]Dasgupta D, Zhou J. Reviewing the development of AIS in last five years. In Proceedings of IEEE Congress on Evolutionary Computation[C]. Canberra, Australia,2003.
    [5]De Castro L N, Van Zuben F J. Artificial Immune System:part I:basic theory and application[M] School of Electrical and Computer Engineering, State University of Campinas, Campinas-SR. Brazil:Technical Report RT-DCA 01.1999.
    [6]林学颜,张玲.现代细胞与分子免疫学[M].北京:科学出版社,1999.
    [7]刘新民.实用内分泌学[M].北京:人民军医出版社,1986.
    [8]史轶蘩.协和内分泌和代谢学[M].北京:科学出版社,1999.
    [9]陈孝文,江黎明,叶锋.肾内分泌学[M].广州:广东科技出版社,1994.
    [10]Colaco C. Acquired Wisdom in Innate Immunity.[J]. Immunology Today 1998, vol. 19(1):50.
    [11]Medzhitov R, Janeway Jr C A. Innate Immunity:Impact on the Adaptive Immune Response[J]. Current Opinion in Immunology.1997, vol.9:4-9.
    [12]Zinkernagel R M, Kelly J. How Antigen Influences Immunity[J]. The Immunologist. 1997, vol.415:114-120.
    [13]Sprent J.T and B Memory Cells[J]. Cell.1994, vol.76:315-322.
    [14]Bere C, Ziegner M. The Maturation of the Immune Response[J]. Immunology Today. 1993, vol.14(8):400-402.
    [15]黄席樾,张著洪,何传江.现代智能算法理论及应用[M].北京:科学出版社,2005.
    [16]Talmage D W. History of Immunology. Basic and Clinical Immunology. Seventh Edition. Chapter 1:Prentice-Hall International Inc.,1991.
    [17]Klein J. History of Immunology. Immunology, The science of self-nonself Discrimination.Chapter 2. John Wiley Sons,1982.
    [18]陈慰峰.免疫学进展:回顾与展望.香山科学会议(第173次)“免疫学在生命科学和医学发展中的作用”[C].北京,2001:2-9
    [19]Burnet F M. The Clonal Selection Theory of Acquired Immunity[M]. London: Cambridge University Press.1959.
    [20]Burnet F M. The clonal selection and after. Theoretical Innmuology. New York: Marcel Dekker Inc,1978.
    [21]Jerne N K. The immune system[J]. Scientific American.1973, vol.229(1):52-60.
    [22]Jerne N K. Towards a network theory of the immune system[M]. Polish:Scientific Publishers.1974.
    [23]Farmer J D, Packard N H, Perelson A S. The Immune System, Adaptation and Machine Learning[J]. Physical D.1986, vol.2:187-204.
    [24]Ishida Y. Fully Distributed Diagnosis by PDP LearningAlgorithm:Towards Immune Network PDP Model. In Proceedings of International Joint Conference on Neural Networks[C]. Washington, D.C:IEEE Service Center,1990:777-782.
    [25]Forrest S, Perelson A S, Allen L. Self-Nonself Discrimination in a Computer. In Proceedings of the 1994 IEEE Symposium on Research in Security and Privacy[C]. Los Alamitos, CA:IEEE Press,1994:271-281.
    [26]Forrest S, Pelson A, Cherukuri R. Self-nonself discrimination in a computer. In Proceedings of 1994 IEEE Computer Society Symposium on Research in Security and Privacy[C]. Los Almitos, CA, USA:IEEE Computer Society 1994:202-212.
    [27]Ishiguro A, Watanable R, Uchikawa Y. Emergent Construction of Artificial Immune Networks for Autonomous Mobile Robots. In Proceedings of IEEE International Conference on Intelligent Robots and Systems Man, and Cybernetics[C]. ATRIA,Grenoble,France 1997:1222-1228.
    [28]Ishida Y. A distributed approach to computer virus detection and neutralization by autonomous and heterogeneous agents. In Proceedings of 4th International Symposium on Autonomous Decentralized Systems[C]. Tokyo,Japan,1999:328-334
    [29]Bradley D W, Tyrell A M. Immunotronics:Hardware fault tolerance inspired by the immune system[J]. Evolvable Systems:From Biology to Hardware.2000, vol.1801: 11-20.
    [30]Kim J, Bentley P J. Towards an artificial immune system for network intrusion detection:An investigation of clonal selection with a negative selection operator. In Proceedings of Congress on Evolutionary Computation[C]. Honolulu, USA,2002:1015-1020.
    [31]Tarakanov A, Dasgupta D. An immune chip architecture and its emulation. In Proceedings of the 2002 NASA/DoD Conference on Evolvable Hardware[C]. Washington,DC,USA,2002.
    [32]Dasgupta D, Yu Senhua, Majumdar N S. MILA-Multilevel Immune Learning Algorithm. In Proceedings of Genetic and Evolutionary Computation Conference[C]. Berlin Heidelberg:Springer-Verlag,2003:183-194.
    [33]焦李成,杜海峰,刘芳.免疫优化计算、学习与识别[M].北京:科学出版社,2006.
    [34]Usama M Fayyad. Advanced in Knowledge discovery and data mining[M]. Califoria: AAAI/MIT PRESS.1996.
    [35]钟晓,马少平,张钹.数据挖掘综述[J].模式识别与人工智能.2001,vol.14(1):48-55.
    [36]张伟,刘勇国,彭军.数据挖掘发展研究[J].计算机科学.2001,vol.28(7):79-81.
    [37]Han J W, Kamber M.数据挖掘概念与技术[M].北京:机械工业出版社,2001.
    [38]莫宏伟,吕淑萍.基于人工免疫系统的数据挖掘技术原理与应用[J].计算机工程与应用.2004,vol.14:28-33.
    [39]Bersini H, Varela F. Hints for Adaptive Problem Solving Gleaned from Immune Network. In Proceedings of Parallel Problem Solving from Nature[C]. Berlin Heidelberg:Springer-Verlag,1990:343-354.
    [40]Hunt J E, Cooke D E. An Adaptive, Distributed Learning System Based on Immune System. In Proceedings of IEEE International Conference on System, Man and Cybernetics[C]. Vancouver:IEEE Press,1995:2494-2499.
    [41]Carter J. The immune system as a model for pattern recognition and classification[J]. Journal of American Medical Informatics Association.2000, vol.7(1):28-41.
    [42]Timmis J, Neal M. A resource limited artificial immune system for data analysis[J]. Knowledge Based Systems.2001, vol.14(3-4):121-130.
    [43]Watkins A, Timmis J. Artificial immune recognition system (AIRS):Revisions and refinements. In Proceedings of the 1st International Conference on Artificial Immune Systems [C]. University of Kent at Canterbury,2002:173-181.
    [44]莫宏伟.人工免疫网络记忆分类器原理与应用研究[D].哈尔滨工程大学博士论文,2005.
    [45]莫宏伟,吕淑萍.基于人工免疫网络记忆的新型分类器研究[J].计算机工程与应用.2004,vol.40(36):28-32,46.
    [46]莫宏伟,管凤旭,吕淑萍.人工免疫网络记忆分类器信息恢复系统应用[J].计算机应用.2005,vol.25(12):271-273.
    [47]莫宏伟,徐立芳.人工免疫记忆分类器类别不均匀分布分类研究[J].计算机工程与应用.2005,vol.41(32):9-11,18.
    [48]莫宏伟,徐立芳.人工免疫网络记忆分类器网络文本分类研究[J].计算机工程与应用.2005,vol.41(33):24-27.
    [49]Timmis J, On parameter Adjustment of the Immune Inspired Machine Learning Algorithm AINE[R]. Technical Report. Computing Laboratory, University of Kent at Canterbury, Canterbury, Kent,2000.
    [50]De Castro L N, Von Zuben F J. aiNET:An Artificial Immune Network for Data Analysis. In Data Mining:A Heuristic Approach, Chapter XII. USA:Idea Group Publishing,2001.
    [51]刘静,钟伟才,刘芳.免疫进化聚类算法[J].电子学报.2001,vol.(21):1868-1872.
    [52]马文萍,尚荣华,焦李成.免疫克隆优化聚类技术[J].西安电子科技大学学报(自然科学版).2007,vol.34(6):911-915,921.
    [53]行小帅,潘进,焦李成.免疫规划+K均值混合聚类算法[J].计算机科学.2003,vol.30(4):150-152,158.
    [54]行小帅,潘进,焦李成.基于免疫规划的K-means聚类算法[J].计算机学报.2003,vol.26(5):605-610.
    [55]薄华,马缚龙,焦李成.基于免疫K-means聚类的无监督SAR图像分割[J].模式识别与人工智能.2008,vol.21(3):376-380.
    [56]Goodman D, Boggess L, Watkins A. Artificial Immune System Classification of Multiple-Class Problems. In Proceedings of the Artificial Neural Networks in Engineering[C]. New York:ASME Press,2002:179-184.
    [57]Cover T M, Hart P E. Nearest neighbor pattern classification[J]. IEEE Transactions on Information Theory.1967, vol.13(1):21-27.
    [58]Jerne N K. Clonal Selection in a Lymphocyte Network. Cellular Selection and Regulation in the Immune Response. New York:Raven Press,1974.
    [59]Elena Deza, Michel Marie Deza. Encyclopedia of Distances[M]. Springer.2009.
    [60]De Castro L N, Von Zuben F J. The Clonal Selection Algorithm with Engineering Applications. In Proceedings of Genetic and Evolutionary Computation Conference [C]. San Francisco, CA,:Morgan Kauffmann,2000:36-37.
    [61]陆德源.现代免疫学[M].上海:上海科技教育出版社,1998.
    [62]肖人彬,王磊.人工免疫系统:原理、模型、分析及展望[J].计算机学报.2002,vol.25(12):1281-1293.
    [63]杜海峰,公茂果,焦李成.用于高维函数优化的免疫记忆克隆规划算法[J].自然科学进展.2004,vol.14(8):925-933
    [64]Kennedy J, Eberhar R. Particle Swarm Optimization. Proceedings of IEEE International Conference on Neural Networks[C]. Perth, Australia:IEEE Press,1995:1942-1948.
    [65]Handl J, Meyer B. Ant-based and swarm-based clustering[J]. Swarm Intelligence. 2007, vol.:95-113.
    [66]Das S, Abraham A, Konar A. Automatic clustering using an improved differential evolution algorithm[J]. IEEE Transactions on Systems Man and Cybernetics.2008, vol.38(1):1-20.
    [67]Omran M G, Salman A, Engelbrecht A P. Engelbrecht, Dynamic clustering using particle swarm optimization with application in image segmentation[J]. Pattern Anal Appliccation.2005, vol.8:332-344.
    [68]Hema C R, Paulraj M P, Yaacob S. Particle Swarm Optimization Neural Network based Classification of Mental Tasks. In Proceedings of 4th Kuala Lumpur International Conference on Biomedical Engineering [C]. Kuala Lumpur, Malaysia: Springer 2008:883-888.
    [69]Alejandro Cervantes, Ines Galvan, Pedro Isasi. Michigan Particle Swarm Optimization for Prototype Reduction in Classification Problems[J]. New Generation Computing. 2009, vol.27(3):239-257.
    [70]Omran M G, Engelbrecht A P, Salman A A. Particle swarm optimization for pattern recognition and image processing[J]. Swarm Intelligence in Data Mining.2006, vol. 34:125-151.
    [71]Sousa T, Silva A, Neves A. Particle swarm based data mining algorithms for classification tasks[J]. Parallel Comput.2004, vol.30(5/6):767-783.
    [72]Alejandro Cervantes, Ines Maria Galvan, Pedro Isasi. An adaptive Michigan approach PSO for nearest prototype classification. Proceedings of International Work-Conference on the Interplay Between Natural and Artificial Computation[C]. La Manga del Mar Menor, Spain,2007:287-296.
    [73]Xindi Cai, Wunsch D C. Engine data classification with simultaneous recurrent network using a hybrid PSO-EA algorithm. In Proceedings of IEEE International Joint Conference on Neural Networks [C]. Montreal,Canada:IEEE Presser,2005:2319-2323.
    [74]Venkatalakshmi K, Shalinie S M. Classification of multispectral images using support vector machines based on PSO and k-means clustering. Proceedings of International Conference on Intelligent Sensing and Information Processing[C]. Bangalore,India: IEEE Press,2005:127-133.
    [75]Thorsten Joachims. A Probabilistic Analysis of the Rocchio Algorithm with TFIDF for Text Catagorization. In Proceedings of the 14th International Conference on Machine Learning [C]. Madison, Wisconsin USA,1997:143-151.
    [76]Siegelmann H T, Sontag E D. Turing computability with neural nets[J]. Applied Mathematics Letters.1991, vol.4(6):77-80.
    [77]Watkins A, Timmis J. Artificial Immune Recognition System (AIRS):An Immune-Inspired Supervised Learning Algorithm[J]. Genetic Programming and Evolvable Machines.2004, vol.5(3):291-317.
    [78]Witten I H, Frank E. Data Mining:Practical Machine Learning Tool and Technique with Java Implementation[M]. San Francisco:Morgan Kaufmann.2000.
    [79]Aha D, Kibler D. Instance-based learning algorithms[J]. Machine Learning.1991, vol. 6:37-66.
    [80]Ross Quinlan. C4.5:Programs for Machine Learning[M]. San Mateo, CA:Morgan Kaufmann Publishers.1993.
    [81]Ron Kohavi. Scaling up the accuracy of naive-bayes classifiers:a decision tree hybrid. In Proceedings of the Second Internarional Conference on Knowledge Discovery and Data Mining[C]. Menlo Park:AAAI Press,1996:202-207.
    [82]Breiman L. Bagging predictors[J]. Machine Learning.1996, vol.24:123-140.
    [83]Hofmeyr S A, Forrest S. Immunity by design:an artificial immune system. In Proceedings of Genetic and Evolutionary Computation Conference[C]. Orlando, Florida:Morgan Kaufmann,1999.
    [84]Freitas A A, Timmis J. Revisiting the foundations of artificial immune systems:A problem-oriented perspective[J]. IEEE Transactions on Evolutionary Computation. 2003, vol.11(4):521-540
    [85]Liao T W, Zhang Z, Mount C R. Similarity measures for retrieval in case-based reasoning systems[J]. Applied Artificial Intelligence.1998, vol.12:267-288.
    [86]De Castro L N, Van Zuben F J. Learning and Optimization Using the Clonal Selection Principle[J]. IEEE Transactions on Evoltionary Computation, Special Issue on Artificial Immune Systems.2002, vol.6(3):239-251.
    [87]李涛.计算机免疫学[M].北京:电子工业出版社,2004.
    [88]Timmis J, Edmonds C. A Comment on Opt-AiNET:An Immune Network Algorithm for Optimisation. In Proceedings of the Genetic and Evolutionary Computation Conference[C]. New York:Springer-Verlag,2004:308-317.
    [89]De Castro L N, Timmis J. An Artificial Immune Network for Multimodal Function Optimisation. In Proceedings of IEEE World Congress on Evolutionary Computation[C]. Honolulu, Hawaii USA:IEEE Computer Society Press,2002:669-674.
    [90]Chun J S, Kim M K, Jung H K. Shape optimization of electromagnetic devices using immune algorithm[J]. IEEE Transactions on Magnetics.1997, vol.33(2):1876-1879.
    [91]Gaspar, Collard P. Two models of immunization for time independent optimization. In Proceedings of IEEE International Conference on Systems, Man, and Cybernetics[C],2000:113-118.
    [92]Jiao Licheng, Gong Maoguo, Shang Ronghua. Clonal selection with immune dominance and energy based multi-objective optimization. In Proceedings of the 3rd International Conference on Evolutionary Multi-Criterion Optimization[C]. Berlin: Springer,2005:474-489.
    [93]王磊,潘进,焦李成.免疫规划[J].计算机学报.2000,vol.23(8):806-812.
    [94]Endoh S, Toma N, Yamada K. Immune algorithm for n-TSP. In Proceedings of IEEE International Conference on Systems, Man, and Cybernetics[C]. San Diego, CA, USA,1998:3844-3849.
    [95]王磊,潘进,焦李成.免疫算法[J].电子学报.2000,vol.28(7):74-78.
    [96]王煦法,张显俊,曹先彬.一种基于免疫原理的遗传算法[J].小型微型计算机系统.1999,vol.20(2):117-120.
    [97]刘克胜,曹先彬,郑浩然.基于免疫算法的TSP问题求解[J].计算机工程与应用.2000,vol.26(1):1-2.
    [98]Huang S J. An immune-base optimization method to capacitor placement in a radial distribution system[J]. IEEE Transactions on Power Delivery.2000, vol.15(2): 744-749.
    [99]Chun J S, Lim J P, Jung H K. Optimal design of synchronous motor with parameter correction using immune algorithm [J]. IEEE Transactions on Energy Conversion. 1999, vol.14(3):610-615.
    [100]曹先彬,郑振,刘克胜.免疫进化策略及其在二次布局求解中的应用[J].计算机工程与应用.2000,vol.26(3):1-2.
    [101]曹先彬,刘克胜,王煦法.基于免疫遗传算法的装箱问题求解[J].小型微型计算机系统.2000,vol.21(4):361-363.
    [102]Mon K, Yuskiyama M, Fukuda T. Adaptive scheduling system inspired by immune system. In Proceedings of 1998 IEEE International Conference on Systems, Man and Cybernetics[C]. San Diego, CA, USA:IEEE Press,1998:3833-3837.
    [103]Hart E, Ross P, Nelson J. Producing robust schedules via an artificial immune system. In Proceedings of IEEE International Conference on Evolutionary Computation[C]. Anchorage, Alaska:IEEE Press,1998:464-469.
    [104]Bianchi G. Performance analysis of the IEEE 802.11 distributed coordination function[J]. IEEE Journal on Selected Areas in Communications.2000, vol.18(3): 535-547.
    [105]刘乃安,张联峰,何广法.无线局域网(WLAN)——原理、技术与应用[M].西安:西安电子科技大学出版社,2004.
    [106]Kai Lieska, Erkki Laitinen, Jaakko Lahteenmaki. Radio Coverage Optimization with Genetic Algorithms. In Proceedings of IEEE International Symposium on Personal, Indoor and Mobile Radio Communications[C]. Boston:IEEE Press,1998:318-322.
    [107]陈建民.地空通信的天线高度与多径干扰[J].无线电通信技术.2000,vol.26(1):44-45,47.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700