一种基于Q-Learning策略的自适应移动物联网路由新算法
|
摘要
针对移动物(车)联网的路由问题,通过对车辆的运动特点及造成链路断裂的原因进行的详细分析,我们建立了链路维持时间模型,并将维持时间作为设计路由算法的重要参数. Q-Learning作为一种启发式机器学习策略,能够通过与周围环境交互来动态地调整路由路径.基于此,我们设计了一种自适应的路由新算法.它将学习任务分散在每一个车辆节点中,通过周期性的与周围节点交换信标信息来维护可靠的路由路径.利用NS-2模拟器对该算法的性能进行了评估,结果表明,在不同的网络场景中,该算法在递交率、端到端的延时以及平均跳数等方面均表现出很好的效果.
In order to solve the routing problem of mobile IOT(IOV),based on our analyzing the details about motion characteristics of the vehicle and the reasons that cause links down,we set up link model of the duration time and using the duration time as key parameter to design the newrouting method. Q-Learning as a kind of heuristic machine learning strategy is able to dynamically adjust the routing path through interaction with the surrounding environment. So a kind of newrouting algorithm with adaptivity for mobile IOT based on Q-learning has been presented in this paper. It distributes the learning task into each vehicle node and maintains the reliable routing path by continuously exchanging the beacon information with the neighbor nodes. With the NS-2 simulator,the performance of the algorithm is tested. The results showthat it has better performances on delivery,end-to-end delay and average hops in many mobile applications.
In order to solve the routing problem of mobile IOT(IOV),based on our analyzing the details about motion characteristics of the vehicle and the reasons that cause links down,we set up link model of the duration time and using the duration time as key parameter to design the newrouting method. Q-Learning as a kind of heuristic machine learning strategy is able to dynamically adjust the routing path through interaction with the surrounding environment. So a kind of newrouting algorithm with adaptivity for mobile IOT based on Q-learning has been presented in this paper. It distributes the learning task into each vehicle node and maintains the reliable routing path by continuously exchanging the beacon information with the neighbor nodes. With the NS-2 simulator,the performance of the algorithm is tested. The results showthat it has better performances on delivery,end-to-end delay and average hops in many mobile applications.
引文
[1]Namboodiri V,Gao L. Prediction-based routing for vehicular ad hoc netw orks[J]. IEEE Transactions on Vehicular Technology,2007,56(4):2332-2345.
[2]Zhang D G. A new approach and system for attentive mobile learning based on seamless migration[J]. Applied Intelligence,2012,36(1):75-89.
[3]Liu S. Novel unequal clustering routing protocol considering energy balancing based on netw ork partition&distance for mobile education[J]. Journal of Netw ork and Computer Applications,2017,88(15):1-9.
[4]Ma Z. A novel compressive sensing method based on SVD sparse random measurement matrix in w ireless sensor netw ork[J]. Engineering Computations,2016,33(8):2448-2462.
[5]Zhang X D. Design and implementation of embedded un-interruptible pow er supply system(EUPSS)for w eb-based mobile application[J]. Enterprise Information Systems,2012,6(4):473-489.
[6]Song X D. Extended AODV routing method based on distributed minimum transmission(DM T)for WSN[J]. International Journal of Electronics and Communications,2015,69(1):371-381.
[7]Zhao C P. A new medium access control protocol based on perceived data reliability and spatial correlation in w ireless sensor netw ork[J]. Computers&Electrical Engineering,2012,38(3):694-702.
[8]Zhang D G,Liang Y P. A kind of novel method of serviceaw are computing for uncertain mobile applications[J].M athematical and Computer M odelling,2013,57(3-4):344-356.
[9] Zhang D G,Li G. An energy-balanced routing method based on forw ard-aw are factor for w ireless sensor netw ork[J]. IEEE Transactions on Industrial Informatics,2014,10(1):766-773.
[10]Ma Z. Shadow detection of moving objects based on multisource information in internet of things[J]. Journal of Experimental&Theoretical Artificial Intelligence,2017,29(3):649-661.
[11]Zhang D G. A novel image de-noising method based on spherical coordinates system[J]. EURASIP Journal on Advances in Signal Processing,2012,2012(110):1-10.DOI:10. 1186/1687-6180-2012-110.
[12] Eiza M H. An evolving graph-based reliable routing scheme for VANETs[J]. IEEE Transactions on Vehicular Technology,2013,62(4):1493-1504.
[13]Yan G J,Olariu S. A probabilistic analysis of link duration in vehicular ad hoc netw orks[J]. IEEE Transactions on Intelligent Transportation Systems,2011,12(5):41227-41236.
[14]张德干.基于局域世界的WSN拓扑加权演化模型[J].电子学报,2012,40(5):1000-1004.ZHANG De-gan. Local-w orld w eighted topology evolving model for w ireless sensor netw orks[J]. Acta Electronica Sinica,2012,40(5):1000-1004.(in Chinese)
[15]钟远.一种不可信环境下的匿名位置辅助路由激励机制[J].电子学报,2013,41(3):475-480.ZHONG Yuan. An anonymous incentive mechanism for location-aided routing in untrusted M ANET scenarios[J].Acta Electronica Sinica,2013,41(3):475-480.(in Chinese)
[16]张德干.一种基于前向感知因子的WSN能量均衡路由方法[J].电子学报,2014,42(1):113-118.ZHANG De-gan. A kind of routing protocol based on forw ard-aw are factor for energy balance[J]. Acta Electronica Sinica,2014,42(1):113-118.(in Chinese)
[17]Zhang D G. A novel approach to mapped correlation of ID for RFID anti-collision[J]. IEEE Transactions on Services Computing,2014,7(4):741-748.
[18]Zhu Y N. A new constructing approach for a weighted topology of w ireless sensor netw orks based on local-w orld theory for the internet of things(IOT)[J]. Computers&M athematics w ith Applications,2012,64(5):1044-1055.
[19] Song X D. New agent-based proactive migration method and system for big data environment(BDE)[J]. Engineering Computations,2015,32(8):2443-2466.
[20] Zhang D G. A kind of novel VPF-based energy-balanced routing strategy for w ireless mesh netw ork[J]. International Journal of Communication Systems,2017,30(6):1-15.
[21] Wang X. New clustering routing method based on PECE for WSN[J]. EURASIP Journal on Wireless Communications and Netw orking,2015,2015(162):1-13. DOI:10.1186/s13638-015-0399-x.
[22]Zheng K. Novel quick start(QS)method for optimization of TCP[J]. Wireless Netw orks,2016,22(1):211-222.
[23]Zheng K. A novel multicast routing method with minimum transmission for WSN of cloud computing service[J].Soft Computing,2015,19(7):1817-1827.
[2]Zhang D G. A new approach and system for attentive mobile learning based on seamless migration[J]. Applied Intelligence,2012,36(1):75-89.
[3]Liu S. Novel unequal clustering routing protocol considering energy balancing based on netw ork partition&distance for mobile education[J]. Journal of Netw ork and Computer Applications,2017,88(15):1-9.
[4]Ma Z. A novel compressive sensing method based on SVD sparse random measurement matrix in w ireless sensor netw ork[J]. Engineering Computations,2016,33(8):2448-2462.
[5]Zhang X D. Design and implementation of embedded un-interruptible pow er supply system(EUPSS)for w eb-based mobile application[J]. Enterprise Information Systems,2012,6(4):473-489.
[6]Song X D. Extended AODV routing method based on distributed minimum transmission(DM T)for WSN[J]. International Journal of Electronics and Communications,2015,69(1):371-381.
[7]Zhao C P. A new medium access control protocol based on perceived data reliability and spatial correlation in w ireless sensor netw ork[J]. Computers&Electrical Engineering,2012,38(3):694-702.
[8]Zhang D G,Liang Y P. A kind of novel method of serviceaw are computing for uncertain mobile applications[J].M athematical and Computer M odelling,2013,57(3-4):344-356.
[9] Zhang D G,Li G. An energy-balanced routing method based on forw ard-aw are factor for w ireless sensor netw ork[J]. IEEE Transactions on Industrial Informatics,2014,10(1):766-773.
[10]Ma Z. Shadow detection of moving objects based on multisource information in internet of things[J]. Journal of Experimental&Theoretical Artificial Intelligence,2017,29(3):649-661.
[11]Zhang D G. A novel image de-noising method based on spherical coordinates system[J]. EURASIP Journal on Advances in Signal Processing,2012,2012(110):1-10.DOI:10. 1186/1687-6180-2012-110.
[12] Eiza M H. An evolving graph-based reliable routing scheme for VANETs[J]. IEEE Transactions on Vehicular Technology,2013,62(4):1493-1504.
[13]Yan G J,Olariu S. A probabilistic analysis of link duration in vehicular ad hoc netw orks[J]. IEEE Transactions on Intelligent Transportation Systems,2011,12(5):41227-41236.
[14]张德干.基于局域世界的WSN拓扑加权演化模型[J].电子学报,2012,40(5):1000-1004.ZHANG De-gan. Local-w orld w eighted topology evolving model for w ireless sensor netw orks[J]. Acta Electronica Sinica,2012,40(5):1000-1004.(in Chinese)
[15]钟远.一种不可信环境下的匿名位置辅助路由激励机制[J].电子学报,2013,41(3):475-480.ZHONG Yuan. An anonymous incentive mechanism for location-aided routing in untrusted M ANET scenarios[J].Acta Electronica Sinica,2013,41(3):475-480.(in Chinese)
[16]张德干.一种基于前向感知因子的WSN能量均衡路由方法[J].电子学报,2014,42(1):113-118.ZHANG De-gan. A kind of routing protocol based on forw ard-aw are factor for energy balance[J]. Acta Electronica Sinica,2014,42(1):113-118.(in Chinese)
[17]Zhang D G. A novel approach to mapped correlation of ID for RFID anti-collision[J]. IEEE Transactions on Services Computing,2014,7(4):741-748.
[18]Zhu Y N. A new constructing approach for a weighted topology of w ireless sensor netw orks based on local-w orld theory for the internet of things(IOT)[J]. Computers&M athematics w ith Applications,2012,64(5):1044-1055.
[19] Song X D. New agent-based proactive migration method and system for big data environment(BDE)[J]. Engineering Computations,2015,32(8):2443-2466.
[20] Zhang D G. A kind of novel VPF-based energy-balanced routing strategy for w ireless mesh netw ork[J]. International Journal of Communication Systems,2017,30(6):1-15.
[21] Wang X. New clustering routing method based on PECE for WSN[J]. EURASIP Journal on Wireless Communications and Netw orking,2015,2015(162):1-13. DOI:10.1186/s13638-015-0399-x.
[22]Zheng K. Novel quick start(QS)method for optimization of TCP[J]. Wireless Netw orks,2016,22(1):211-222.
[23]Zheng K. A novel multicast routing method with minimum transmission for WSN of cloud computing service[J].Soft Computing,2015,19(7):1817-1827.