摘要
研究了定向天线自组织网的邻居发现问题,提出了一种基于Q-Learning的邻居发现算法,并利用大型网络仿真软件OPNET对定向天线自组织网进行建模仿真。基于Q-Learning的邻居发现算法在不知道任何邻居节点先验信息的情况下,通过Q-Learning机制确定每次邻居扫描的收/发模式,并根据当次扫描结果确定回报值,学习扫描中的经验,能够达到提高邻居发现效率的目的。利用三级建模机制搭建了基于OPNET的仿真模型,并利用天线模型编辑器对定向天线进行了建模。基于OPNET的仿真结果表明,提出的算法相比于基于扫描的算法能够提高邻居发现的效率。
Neighbor discovery problem in directional antenna Ad Hoc networks is studied. A Q-Learning neighbor discovery algorithm is proposed, and a simulation model for directional antenna Ad Hoc networks based on OPNET software is setup. This algorithm makes a decision of transmitting and receiving mode for every neighbor scanning without the information of neighbor position through the Q-Learning mechanism. The reward value is determined according to the current scanning result, and the experiences are learned in order to improve the neighbor discovery efficiency. The simulation model based on OPNET software is constructed using three-layer modeling mechanism. Then the directional antenna is modeled by the antenna modeling editor. The simulation result based on OPNET shows that the proposed algorithm has a better efficiency of neighbor discovery compared with the scan based algorithm.
引文
[1]ZHANG Z,LI B.Neighbor Discovery in Mobile Ad Hoc Selfconfiguring Networks with Directional Antennas:Algorithms and Comparisons[J].IEEE Transactions on.Wireless Communications(S1536-1276),2008,7(5):1540-1549.
[2]王昕羽,张航,孟旭东.一种使用定向天线的Ad Hoc网络邻居发现算法[J].无线电工程,2014,44(2):9-12.WANG Xin-yu,ZHANG Hang,MENG Xu-dong.Advanced Neighbor Discovery Algorithm with Directional Antennas in Ad Hoc Networks[J].Radio Engineering,2014,44(2):9-12.
[3]景中源,曾浩祥,李大双,等.定向Ad hoc网络中一种带冲突避免的邻居发现算法[J].通信技术,2015,48(5):582-588.JING Zhongyuan,ZENG Haoyang,LI Dashuang,et al.A Neighbor Discovery Algorithm with Collision Avoidance in Ad hoc Networks Using Directional Antennas[J].Communications Technology,2015,48(5):582-588.
[4]Watkin C,Dayan P.Q-Learning[J].Machine Learning(S0885-6125),1992,8(3):279-292.
[5]黄影,严定宇,李男.动态频谱接入的Q学习优化算法[J].西安电子科技大学学报,2015,42(6):179-183.HUANG Ying,YAN Dingyu,LI Nan.Optimization Algorithm for Dynamic Spectrum Access Based on Q-Learning in Cognitive Radio Networks[J].Journal of Xidian University,2015,42(6):179-183.
[6]于俊,刘全,傅启明,等.基于优先级扫描Dyna结构的贝叶斯Q学习方法[J].通信学报,2013,34(11):129-139.YU Jun,LIU Quan,FU Qi-ming,et al.Bayesian Q Learning Method with Dyna Architecture and Prioritized Sweeping[J].Journal on Communications,2013,34(11):129-139.
[7]陈寅,宋杨,费敏锐.基于Simulink和OPNET的NCS联合仿真平台的设计与开发[J].系统仿真学报,2013,25(7):1518-1523.CHEN Yin,SONG Yang,FEI Min-rui.Design and Development of Cosimulation Platform for NCS Based on Simulink and OPNET[J].Journal of System Simulation,2013,25(7):1518-1523.
[8]Dao Van Phuong,左加阔,Bui Thi Oanh,等.水声通信信道中的OPNET建模与仿真[J].东南大学学报(自然科学版),2014,44(3):477-481.Dao Van Phuong,Zuo Jiakuo,Bui Thi Oanh,et al.Modeling and Simulation of Underwater Acoustic Communication Channel Using OPNET[J].Journal of Southeast University(Natural Science Edition),2014,44(3):477-481.
[9]李楠,宗鹏,Saeid AGHAEINEZHADFIROUZJA.基于OPNET的低轨卫星网络路由仿真与优化[J].飞行器测控学报,2013,32(5):408-413.LI Nan,ZONG Peng,Saeid AGHAEINEZHADFIROUZJA.OPNET Based Simulation and Optimization of Routing Protocols in LEO Satellite Networks[J].Journal of Spacecraft TT&C Technology,2013,32(5):408-413.
[10]塞西.计算机网络仿真OPNET实用指南[M].北京:机械工业出版社,2014.S.Sethi.The Practical OPNET User Guide for Computer Network Simulation[M].Beijing:China Machine Press,2014.
[11]李默,孙岘,赵亮.OPNET天线建模及无线管道阶段仿真研究[J].无线电通信技术,2015,41(1):60-63.LI Mo,SUN Xian,ZHAO Liang.Research on Antenna Modeling and Wireless Pipeline Stage Simulation Based on OPNET[J].Radio Communications Technology,2015,41(1):60-63.
[12]肖学森.三维天线建模及天线三维增益的有效性算法研究[D].北京:北京邮电大学,2012.XIAO Xue-sen.Modeling for 3D Antenna and a Novel Algorithm for Calculating Three-dimensional Gain of Antennas[D].Beijing:Beijing University of Posts and Telecommunication,2012.