基于POMDP的主动雷达制导弹干扰措施优化方法
|
摘要
以主动雷达弹对抗为背景,研究了单平台机载电子对抗资源的调度问题。为解决导弹导引头状态观测不确定性问题,引入部分可观测马尔科夫决策过程(POMDP)理论,分析了POMDP模型的要素,建立了针对主动雷达制导导弹的干扰资源优化POMDP模型,并利用最优策略可达空间的连续近似法(SARSOP)进行求解。将电子支援措施(ESM)的观测值输出与电子干扰措施(ECM)的优化策略相结合,提出了一种基于POMDP的电子对抗资源实时调度优化算法。仿真结果表明,该方法能够实现目标状态不确定情况下的干扰资源有效调度,相比现有的调度策略,可以使导引头更多维持在搜索状态,更少停留在稳定跟踪状态。
Taking an active radar missile countermeasure as background,this paper studies the single-platform airborne electronic countermeasure(ECM)scheduling problem.In order to solve the uncertainty problem of missile seeker state observation,the partially observable Markov decision process(POMDP)theory is introduced.The elements of POMDP model are analyzed,an optimization model of ECM resources is established for the active radar homing missile,and the solution is solved by successive approximations of the reachable space under optimal policies(SARSOP).A new real-time scheduling optimization algorithm for ECM resources based on POMDP is presented,combined the output of electronic support measure(ESM)with the control strategy of ECM together.The simulation results indicate that the proposed algorithm can realize effective scheduling of ECM resources under the situation where the target state is uncertain compared with the existing approach,the radar missile will stay in seeoch state more and stable tracking state less.
Taking an active radar missile countermeasure as background,this paper studies the single-platform airborne electronic countermeasure(ECM)scheduling problem.In order to solve the uncertainty problem of missile seeker state observation,the partially observable Markov decision process(POMDP)theory is introduced.The elements of POMDP model are analyzed,an optimization model of ECM resources is established for the active radar homing missile,and the solution is solved by successive approximations of the reachable space under optimal policies(SARSOP).A new real-time scheduling optimization algorithm for ECM resources based on POMDP is presented,combined the output of electronic support measure(ESM)with the control strategy of ECM together.The simulation results indicate that the proposed algorithm can realize effective scheduling of ECM resources under the situation where the target state is uncertain compared with the existing approach,the radar missile will stay in seeoch state more and stable tracking state less.
引文
[1]王星.航空电子对抗原理[M].北京:国防工业出版社,2008:12-16.WANG X.Principles of Avionics Electronic Countermeasures[M].Beijing:National Defense Industry Press,2008:12-16.(in Chinese)
[2]陈辉.雷达干扰辅助决策研究[D].西安:西安电子科技大学,2014.CHEN H.A Study of Assistant Decision-making for Radar Jamming[D].Xi'an:Xidian University,2014.(in Chinese)
[3]陈凯.对相控阵雷达的智能干扰决策技术研究[D].西安:西安电子科技大学,2012.CHEN K.Research on Intelligent Jamming Decisionmaking Technology against Phased-Array Rad-ar[D].Xi'an:Xidian University,2012.(in Chinese)
[4] BROOKS R R,JING E P,GRIFFIN C.Game and Information Theory Analysis of Electronic Countermeasures in Pursuit-evasion Games[C]//IEEE Trans Syst Man Cyber Part A Syst Hum 2008,38(6):1281-1294.
[5] NOROUZI T,NOROUZI Y.Scheduling the Usage of Radar and Jammer During Peace and War Time[C]//IET Radar Sonar Navig,2008,6(9):929-936.
[6] ANDREA D.Introduction to Modern EW Systems[M].Boston:Artech House Inc,2012.
[7]万开方,高晓光,李波,等.基于部分可观测马尔科夫决策过程的多被动传感器组网协同反隐身探测任务规划[J].兵工学报,2015,36(4):731-742.(in Chinese)WAN K F,GAO X G,LI B,et al.Mission Planning of Passive Networked Sensors for Cooperative AntiStealth Detection Based on POMDP[J].Acta Armamentarii,2015,36(4):731-742.(in Chinese)
[8] DANIEL A,BERNHARD W.Closed-Loop Safety Assessment of Uncertain Roadmaps[J].Autonomous Robots,2015,40(2):267-289.
[9] ZHANG S H,WANG H J,ZHANG H G,et al.Optimal Spectrum Access Algorithm Based on POMDP in Cognitive Networks[J].International Journal of Electronic Communication,2015,69(6):943-949.
[10]QIAO X,WANG Z,CHEN H X,et al.Replenishment Control Policies for a Production/Inventory System with Invisible Stock Loss[J].IFAC-Papers Online,2015,48(3):1762-1767.
[11]周志华.机器学习[M].北京:清华大学出版社,2016:319-339.ZHOU Z H.Machine Learning[M].Beijing:Tsinghua University Press,20016:319-339.(in Chinese)
[12]PINEAU J,GORDON G,THRUN S.Point-Based Value Iteration:An AnytimeAlgorithm for POMDPs[C]//In Proceedings of the 18th IJCAI,2003:1025-1032.
[13]SMITH T,SIMMONS R.Heuristic Search Value Iteration for POMDPs[C]//In Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence(UAI),2004:520-527.
[14]SHANI G,BRAFMAN R L,SHIMONY S E.Forward Search Value Iteration for POMDPs[C]//In Proc Int Conf on Artificial Intelligence,2007:2619-2624.
[15]HANNA K,DAVID H,LEE W S.SARSOP:Effcient Point-Based POMDP Planning by Approximating Optimally Reachable Belief Spaces[C]//In Proc Robotics:Science&Systems,2008.
[16]VISNEVSKI N,KRISHNAMURTHY V,HAYKIN S,et al.Multi-Function Radar Emitter Modelling:A Stochastic Discrete Event System Approach[C]//In Proceedings of IEEE Conference Decision and Control,2003.
[2]陈辉.雷达干扰辅助决策研究[D].西安:西安电子科技大学,2014.CHEN H.A Study of Assistant Decision-making for Radar Jamming[D].Xi'an:Xidian University,2014.(in Chinese)
[3]陈凯.对相控阵雷达的智能干扰决策技术研究[D].西安:西安电子科技大学,2012.CHEN K.Research on Intelligent Jamming Decisionmaking Technology against Phased-Array Rad-ar[D].Xi'an:Xidian University,2012.(in Chinese)
[4] BROOKS R R,JING E P,GRIFFIN C.Game and Information Theory Analysis of Electronic Countermeasures in Pursuit-evasion Games[C]//IEEE Trans Syst Man Cyber Part A Syst Hum 2008,38(6):1281-1294.
[5] NOROUZI T,NOROUZI Y.Scheduling the Usage of Radar and Jammer During Peace and War Time[C]//IET Radar Sonar Navig,2008,6(9):929-936.
[6] ANDREA D.Introduction to Modern EW Systems[M].Boston:Artech House Inc,2012.
[7]万开方,高晓光,李波,等.基于部分可观测马尔科夫决策过程的多被动传感器组网协同反隐身探测任务规划[J].兵工学报,2015,36(4):731-742.(in Chinese)WAN K F,GAO X G,LI B,et al.Mission Planning of Passive Networked Sensors for Cooperative AntiStealth Detection Based on POMDP[J].Acta Armamentarii,2015,36(4):731-742.(in Chinese)
[8] DANIEL A,BERNHARD W.Closed-Loop Safety Assessment of Uncertain Roadmaps[J].Autonomous Robots,2015,40(2):267-289.
[9] ZHANG S H,WANG H J,ZHANG H G,et al.Optimal Spectrum Access Algorithm Based on POMDP in Cognitive Networks[J].International Journal of Electronic Communication,2015,69(6):943-949.
[10]QIAO X,WANG Z,CHEN H X,et al.Replenishment Control Policies for a Production/Inventory System with Invisible Stock Loss[J].IFAC-Papers Online,2015,48(3):1762-1767.
[11]周志华.机器学习[M].北京:清华大学出版社,2016:319-339.ZHOU Z H.Machine Learning[M].Beijing:Tsinghua University Press,20016:319-339.(in Chinese)
[12]PINEAU J,GORDON G,THRUN S.Point-Based Value Iteration:An AnytimeAlgorithm for POMDPs[C]//In Proceedings of the 18th IJCAI,2003:1025-1032.
[13]SMITH T,SIMMONS R.Heuristic Search Value Iteration for POMDPs[C]//In Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence(UAI),2004:520-527.
[14]SHANI G,BRAFMAN R L,SHIMONY S E.Forward Search Value Iteration for POMDPs[C]//In Proc Int Conf on Artificial Intelligence,2007:2619-2624.
[15]HANNA K,DAVID H,LEE W S.SARSOP:Effcient Point-Based POMDP Planning by Approximating Optimally Reachable Belief Spaces[C]//In Proc Robotics:Science&Systems,2008.
[16]VISNEVSKI N,KRISHNAMURTHY V,HAYKIN S,et al.Multi-Function Radar Emitter Modelling:A Stochastic Discrete Event System Approach[C]//In Proceedings of IEEE Conference Decision and Control,2003.