Hopfield神经网络的改进及其在无线通信优化中的应用
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
智能优化算法已随着时代的需求逐渐成为一个成熟的演化计算方法。Hopfield神经网络就作为典型的并行智能优化算法,以其独特的算法优越性而得到了几十年之久的长足发展,现已经成为一种理论与应用研究都较成熟完备的智能优化算法。
     本论文的主要贡献和创新点如下:
     介绍了Hopfield神经网络的原理,并针对其在应用中所呈现出的缺陷与不足进行了改进,并将改进后的HNN优化算法应用到通信领域中一些优化问题的解决上。本课题主要提出了三种Hopfield(?)经网络的改进算法,分别为动态步长HNN、模拟退火HNN与动态步长混沌HNN算法。本课题还将改进后的Hopfield神经网络用于解决经典组合优化问题——旅行商问题、认知无线电中最佳频谱资源利用问题以及最大化无线传感器网络的生命周期问题。
     研究了在认知多载波网络中子载波功率分配算法,并结合Overlay与Underlay两种模型各自的优缺点,提出了一种混合频谱接入算法。本文针对HNN易陷入局部极值的问题,借鉴模拟退火算法的原理,提出了模拟退火-Hopfield神经网络,并将该优化算法应用于实现认知无线电系统的遍历容量最大化问题中。实验结果表明模拟退火-Hopfield神经网络可有效跳出局部极值,提高了取得全局最优解的概率,同时实验表明,混合频谱接入算法可比传统算法取得更好的遍历容量。
     提出了基于tent映射和动态步长的Hopfield神经网络。用TSP问题验证了此算法的性能优于传统HNN。本文还实现了对传统LEACH分簇协议的改进算法,实现了最优簇头选择与网络生命周期最大化。结果证明此优化算法可以使得簇头的分布更加均匀,并有效延长网络的生命周期,延缓了节点的死亡时间。
In recent years, Intelligent Optimization Algorithms has become a mature intelligent optimization algorithm, more and more researchers to join in this field. Hopfield neural networks as a typical intelligent optimization algorithms has been rapid developed because its unique advantage. Now it has been an all aspects relatively complete intelligent optimization technology.
     This paper introduces the theory of Hopfield neural networks briefly, aim at the shortage in the using of the Hopfield neural networks we proposed many improved algorithms, and then give some applications in the field of communication.
     The main contributions of this dissertation are as follows:
     This paper mainly proposed three improved Hopfield neural networks algorithms, which are dynamic step Hopfield neural networks、simulated annealing Hopfield neural networks and dynamic step chaotic Hopfield neural networks. They are effectively in high speed calculating for optimization problems especially for Non-Polynomial problems, and these improved algorithms not only increase the rate of convergence but also improve the veracity of the optimal solutions. This paper also use the improved HNN to solve traveling salesman problem、optimization spectrum using problem in cognitive radio and prolonging the lifetime of the wireless sensor networks.
     We solve the optimization power allocation problem based on cognitive radio network system. We propose a Hybrid Spectrum Access (HSA) method which considers the total transmit power constraint, the peak power constraint and the primary users'tolerance. In order to solve this combinational optimization problem and achieve the global optimal solution, we derived a Simulated Annealing-Hopfield neural networks (SA-HNN). The simulation results of the optimized ergodic capacity shows that the proposed optimization problem can be solved more efficiently and better by SA-HNN than HNN or Simulated Annealing (SA), and the proposed HSA method by SA-HNN can achieve a better ergodic capacity than the traditional methods.
     In wireless sensor networks (WSNs), making use of the energy efficiently is becoming increasingly important, we improves the well known cluster-based LEACH(Low-Energy Adaptive Clustering Hierarchy) protocol by defining a new cost function, which aims to minimize the intra-cluster distance and the energy consumption of the network. Moreover, this paper aims at the local optimization and the convergent rate problem of the Hopfield neural networks(HNN), and proposes an improved HNN which is based on dynamic step and tent map chaotic search algorithm and we test the performance of this network by using the TSP. Thus, we solve the optimization protocol by the improved HNN. Our protocol is compared with the traditional LEACH, simulation results demonstrate that the proposed protocol can achieve longer network lifetime.
     In the end we summarize the characteristics of the application of the algorithm and give future research trends of the Hopfield neural networks.
引文
[1]W. B. Lee and B. J. Sheu "Modified Hopfield neural networks for retrieving optimal solutions", IEEE trans. on neural networks, vol.2, no.1,1991.
    [2]Shou-wei Li. Analysis of Contrasting Neural Network with Small-World Network[C].2008, Page(s):57-60.
    [3]J. Hopfield and D. Tank "Neural computation of decision optimization problem", Bio. Cyber., vol.53, pp.141-1521985.
    [4]E. G. Larsson, M. Skoglund, "Cognitive radio in a frequency planned environment: some basic limits", to appear in IEEE Transactions on Wireless Communications, 2008.
    [5]A. Sahai, R. Tandra and N. Hoven, "Opportunistic spectrum use for sensor networks: the need for local cooperation", IEEE Internacional Conference on Communications, 2006.
    [6]N. Devroye, P. Mitran, V. Tarokh, "Limits on Communications in a Cognitive Radio Channel", IEEE Communications Magazine, vol.44 no 6, pp.44-49, June 2006.
    [7]Tian D, Georganas N. A Coverage Preserving Node Scheduling Scheme for Large Wireless Sensor Networks [A]. The 1st ACM International Workshop on Wireless Sensor Networks and Applications [C].2002:32-41.
    [8]Sun Limin and so on, Wireless sensor network, The Tsinghua University press [M], Beijing, pp.68-73,April 2005.
    [9]I.F. Akyildiz, W. Su, Y. Sankarasubramaniam and E. Cayirci, "Wireless sensor networks:A survey" Elsevier Computer Networks, vol.38(4), Dec.2002, pp. 393-422.
    [10]Park, Dong-Chul, Keum, Kyo-Reen, "A shortest path routing algorithm using Hopfield neural network with an improved energy function" International Journal of General Systems", v 38, n 7, p 777-791, October 2009.
    [11]Yulong Liu, Mingyan Jiang, Dongfeng Yuan, "Cross-layer Resource Allocation Optimization by HNN in OFDMA-Based Wireless Mesh Networks" ICNC'09(IEEE) Volume:1; 2009 Page(s):119-123.
    [12]Sheikhan, Mansour, Hemmati, Ehsan, "PSO-Optimized Hopfield Neural Network-Based Multipath Routing for Mobile Ad-hoc Networks" International Journal of Computational Intelligence Systems, v 5, n 3, p 568-581, June 2012.
    [13]J. Mitola, and G. Maguire, "Cognitive radio:Making software radios more personal," IEEE Pers. Commun., vol.6, no.4, pp.13-18, Aug.1999.
    [14]S. Haykin, "Cognitive radio:Brain-empowered wireless communications," IEEE J. Select. Areas Commun., vol.23, no.2, pp.201-220, Feb.2005.
    [15]A. Ghasemi, and E. S. Sousa, "Fundamental limits of spectrum-sharingin fading environments," IEEE Trans. Wireless Commun., vol.6, no.2,pp.649-658, Feb. 2007.
    [16]Mhatre V, Rosenberg C, Kofinan D, Mazumdar R, Shroff N. A Minimum Cost Heterogenous Sensor Network with a Lifetime Constraint[J]. IEEE Transactions on Mobile Computing,2005,4(1):4-15.
    [17]Younis O and Fahmy S. HEED:A Hybrid,Energy-efficient,Distributed Clustering Approach for Ad Hoc Sensor Networks[J]. IEEE Transactions on Mobile Computering,2004,3(4):660-669.
    [18]朱海燕.多频道技术在无线传感器网络中的应用[D].南京邮电大学学位论文,2009.
    [19]闻新,周露,王丹力,熊晓英.MATLAB神经网络应用设计[M].科学出版社2000.
    [20]王伟.人工神经网络原理—入门与应用[M].北京航空航天大学出版社1995.10.
    [21]高隽.人工神经网络原理及仿真实例[M].机械工业出版社,2003.8.
    [22]Abhijit S. Pandya, Robert B. Macy;徐勇,荆涛译.神经网络模式识别及其实现[M].电子工业出版社1999.6.
    [23]刘希玉,刘弘.人工神经网络与微粒群优化[M].北京邮电大学出版社2008.03.
    [24]Yamashita, K.; Ohta, M.; Jiang, W.; Reducing peak-to-average power ratio of multicarrier modulation by Hopfield neural network[J]. Electronics Letters Volume:38, Issue:22 2002, pp.1370-1371.
    [25]Luis G. Morelli, Guillermo Abramson, and Marcelo N. Kuperman. Associative memory on a small-world neural network[C]. Eur. Phys. J. B,2004,38:495-500.
    [26]Hopfield,J.J. Neural networks and physical systems with emergent collective computational abilities[C]. Proceedings of the National Academy of Sciences,USA, vol.79, pp.2554-2558.
    [27]Pedro M. Talavan, Javier Yanez, "Parameter setting of the Hopfield network applied to TSP", Original Research Article Neural Networks, Vol.15, Issue 3, April 2002, Pages 363-373.
    [28]魏海坤.神经网络结构设计的理论与方法[M].国防工业出版社2005.
    [29]Hopfield,J.J. Neurons with graded response have collective computational properties like those of two-state neurons[C]. Proceedings of the National Academy of Sciences,USA,vol.81,pp.3088-3092.
    [30]焦李成.神经网络计算[M].西安电子科技大学出版社1995.
    [31]陈国良.神经计算及其在组合优化中的应用[M].计算机研究与发展1992.
    [32]Zou Dexuan, Liu Haikuan, Gao Liqun, Li Steven. "An improved differential evolution algorithm for the task assignment problem". Engineering Applications of Artificial Intelligence, v 24, n 4, p 616-624, June 2011.
    [33]Salman Ayed, Ahmad Imtiaz, Al-Madani Sabah. "Particle swarm optimization for task assignment problem". Microprocessors and Microsystems, v 26, n 8, p 363-371, November 10,2002.
    [34]J. Ni and F. Li "A variable step-size matrix normalized subbandadaptive filter", IEEE Trans. Audio, Speech,Lang. Process., vol.18, no.6, pp.1290-12992010.
    [35]Sitjongsataporn, Suchada, "New variable step-size order statistic LMS-based frequency domain equalisation for OFDM systems", Intelligent Signal Processing and Communications Systems (ISPACS),2011 International Symposium on Digital Object Identifier, pp.1-4.2011.
    [36]N.Li, YZhang and Y.Hao, "A New Variable Tap-length LMS Algorithm With Variable Step Size", in Proc. IEEE Int. Conl on Mechatronics and Automation (ICMA), pp.525-529, Aug.2008.
    [37]LiuHongxia, ChenShiliang, ZhouYongquan, "An improved simulating fishing strategy optimization algorithm by using dynamic step", Journal of Information and Computational Science, v 7, n 13, p 2715-2721, December 2010.
    [38]Reuther Christiane, Einwich Karsten, "A SystemC AMS extension for controlled modules and dynamic step sizes", Forum on Specification and Design Languages, p 90-97,2012.
    [39]Hopfield,J.J and Tank D.. Neural computation in decisions in optimization problems[C]. Biological Cybernetics,1985(52):141-152.
    [40]孙守宇,郑君里.Hopfield网络求解TSP的一种改进算法和理论证明[J];电子学报,1995,1(23):73-78.
    [41]Xue Hongquan, Wei Shengmin, Yang Lin, "An improved immune algorithm for solving TSP problem". Advanced Materials Research, v 468-471, p 678-682,2012.
    [42]F. Jolai, A. Ghanbari, "Integrating data transformation techniques with Hopfield neural networks for solving travelling salesman problem," Expert Systems with Applications, Volume 37, Issue 7, pp.5331-5335, July.2010.
    [43]Calabuig, D.; Monserrat, J.F.; Martin-Sacristan, D.; Cardona, N.. Joint Dynamic Resource Allocation for Coupled Heterogeneous Wireless Networks Based on Hopfield Neural Networks[C]; Vehicular Technology Conference,2008. VTC Spring 2008. IEEE 2008,pp.2131-2135.
    [44]Sekihara Kensuke, Haneishi Hideaki, Ohyama Nagaaki, "Details of simulated annealing algorithm to estimate parameters of multiple current dipoles using biomagnetic data". IEEE Transactions on Medical Imaging, v 11, n 2, p 293-299, Jun 1992.
    [45]Zhang Rui, Wu Cheng, "A simulated annealing algorithm based on bottleneck jobs for the open shop scheduling problem", Proceedings of the World Congress on Intelligent Control and Automation (WCICA), p 4448-4452,2008.
    [46]Lv Pin, Yuan Lin, Zhang Jinfang, "Cloud theory-based simulated annealing algorithm and application", Engineering Applications of Artificial Intelligence, v 22, n 4-5, p 742-749, June 2009.
    [47]S. Haykin, "Cognitive radio:Brain-empowered wireless communications," IEEE J.select. Areas Commun., vol.23, no.2, pp.201-220, Feb.2005.
    [48]A.Ghasemi, and E. S. Sousa, "Fundamental limits of spectrum-sharing constrants," IEEE Trans. Wirless Commun., vol.6, no.2, pp.649-658, Feb.2007.
    [49]M. Gastpar, "On capacity under receive and spatial spectrum-sharing constraints," IEEE Trans. Inf. Theory, vol.53, no.2, pp.471-487, Feb.2007.
    [50]Jackson, W.C., McDowell, M.E., "Simulated annealing with dynamic perturbations:a methodology for optimization," IEEE Conf. AAC.1990.
    [51]L.P. Wang, Li, S., Tian F.Y, Fu, and X.J, "A noisy chaotic neural network for solving combinatorial optimization problem:Stochastic chaotic simulated annealing," IEEE Trans. System, Man, Cybern, Part B-Cybernetics, vol.34, pp.2119-2125,2004.
    [52]Jin Qingqing, Zhang Haixia, Yuan Dongfeng, "Hybrid opportunistic spectrum access and power allocation for secondary link communication", Proceedings-IEEE Military Communications Conference MILCOM, p 762-766,2010.
    [53]Chiuan-Hsu Chen, and Chin-Liang Wang, "An Efficient Power Allocation Algorithm for Multiuser OFDM-Based Cognitive Radio Systems," IEEE Conf. Commun. WCNC.2010.5506450, July.2010.
    [54]Sheng Chen, En Cheng; Fei Yuan, "Study on chaotic sequence for shallow sea acoustics networks", Proceedings of the 2009 Pacific-Asia Conference on Circuits, Communications and System, PACCS 2009, p 640-643,2009.
    [55]Shan Liang, Qiang Hao, Li Jun, Wang Zhi-Quan. "Chaotic optimization algorithm based on Tent map". Kongzhi yu Juece/Control and Decision, v 20, n 2, p 179-182, February 2005.
    [56]Heinzelman W B, Chandrakasan A P, Balakrishnan H. An Application-specific Protocol Architecture for Wireless Microsensor Networks. IEEE Transactions on Wireless Communications,2002,1(4):660-670.
    [57]Kong, Hyung Yun. Energy efficient cooperative LEACH protocol for wireless sensor networks. Journal of Communications and Networks,2010,12(4):358-365.
    [58]李素叶.无线传感器网络跨层优化算法研究.山东大学硕士学位论文,2009:20.
    [59]Raymnond D R, Marchany R C, Brownfield M I, Midkiff S F. Effects of Denial-of-Sleep Attacks on Wireless Sensor Network MAC Protocols[J]. IEEE Transactions on Vhieular Technology,2009,58(1):367-380.
    [60]高强.无线传感器网络生命周期的跨层优化研究[D].上海交通大学硕士学位论文,2008:2.
    [61]Chen Z H, Khokhar A.Self Organization and Energy Efficient TDMA MAC Protocol by Wake Up for Wireless Sensor Networks[C]. IEEE Communications Society Conference on Sensor and Ad Hoc Communications and Networks,2004: 335-341.
    [62]肖伟茂.一种基于LEACH的无线传感器网络路由算法[D].西安电子科技大学硕士学位论文,2006.
    [63]W.Ye, J. Heidemann, and D. Estrin. Medium access control with coordinated adaptive sleeping for wireless sensor networks. IEEE/ACM Trans. Netw (2004), Vol.12, No.3, pp.493-506.
    [64]R. Verdone, D. Dardari, G. Mazzini and A. Conti, Wireless Sensor and Actuator Networks Technologies, Analysis and Design, London:Academic Press, London, 2008.
    [65]Wang H, Agoulmine N, Maode M, Jin Y L. Network Lifetime Optimization in Wireless Sensor Networks[J]. IEEE Journal on Selected Areas in Communications, 2010,28(7):1127-1137.
    [66]Janos Levendovszky. Novel Load Balancing Algorithms Ensuring Uniform Packet Loss Probabilities for WSN. Vehicular Technology Conference (VTC Spring), IEEE 73rd, pp.1-5,15-18 May 2011.
    [67]N. M. Abdul Latiff, C. C. Tsimenidis, B. S. Sharif. Energy-Aware Clustering for Wireless Sensor Networks using Particle Swarm Optimization. Indoor and Mobile Radio Communications (PIMRC), IEEE 18th International Conference, pp.1-5,3-7 Sept.2007.
    [68]Kim S J, Wang X D, Madihian M. Distributed Joint Routing and Medium Access Control for Lifetime Maximization of Wireless Sensor Networks[J]. IEEE Transactions on Wireless Communications,2007,6(7):2669-2677.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700