Adaptive Dynamic Programming for Nonlinear Impulse Systems
详细信息 查看官网全文
- 英文论文题名：Adaptive Dynamic Programming for Nonlinear Impulse Systems
- 论文作者：Xiaohua Wang ; Yanru Lian ; Zhonghua Miao
- 英文论文作者：Xiaohua Wang ; Yanru Lian ; Zhonghua Miao ; School of Mechatronics Engineering and Automation ; Shanghai University ; Shanghai Key Laboratory of Power Station Automation Technology of Shanghai University
- 年：2017
- 作者机构：School of Mechatronics Engineering and Automation,Shanghai University;Shanghai Key Laboratory of Power Station Automation Technology of Shanghai University;
- 英文论文关键词：Nonlinear Fixed-time Impulse Systems ; Optimal Control ; Adaptive Dynamic Programming(ADP) ; Variational Method
- 会议召开时间：2017-07-26
- 会议录名称：第36届中国控制会议论文集（B）
- 英文会议录名称：Proceedings of the 36th Chinese Control Conference（B）
- 语种：英文
- 分类号：TP13
- 学会代码：KZLL
- 会议名称：第36届中国控制会议
- 会议地点：中国辽宁大连
- 主办单位：中国自动化学会控制理论专业委员会
- 学会名称：中国自动化学会控制理论专业委员会
- 页数：6
- 文件大小：440k
- 原文格式：D
- 会议级别：全国
摘要
Impulse systems describe impulsive phenomena and consider instantaneous impact on the states of the system. Optimal control of nonlinear impulse system hardly obtains analytical solutions considering the impulse nature. A new numerical algorithm based Adaptive dynamic programming(ADP) herein provides numerical approximation to the optimal control solutions. The difficulty designing ADP algorithm in such system lies in the policy update part. Variational method is adopted for policy update between two consecutive impulses. Simulations are presented for algorithm validations.
Impulse systems describe impulsive phenomena and consider instantaneous impact on the states of the system. Optimal control of nonlinear impulse system hardly obtains analytical solutions considering the impulse nature. A new numerical algorithm based Adaptive dynamic programming(ADP) herein provides numerical approximation to the optimal control solutions. The difficulty designing ADP algorithm in such system lies in the policy update part. Variational method is adopted for policy update between two consecutive impulses. Simulations are presented for algorithm validations.
Impulse systems describe impulsive phenomena and consider instantaneous impact on the states of the system. Optimal control of nonlinear impulse system hardly obtains analytical solutions considering the impulse nature. A new numerical algorithm based Adaptive dynamic programming(ADP) herein provides numerical approximation to the optimal control solutions. The difficulty designing ADP algorithm in such system lies in the policy update part. Variational method is adopted for policy update between two consecutive impulses. Simulations are presented for algorithm validations.
引文
[1]Derong Liu,Hongliang Li,Ding Wang.Self-Learning Optimal Control Based on Data:the Research Progress and Prospect[J].Automation Journal,2013,39(11):1858-1870
[2]Huaguang Zhang,Xin Zhang,Yanhong Luo,Jun Yang.Review of Adaptive Dynamic Programming[J].Automation Journal,2013,39(4):303-311
[3]Vrabie D,Pastravanu O,Abu-Khalaf M,et al.Adaptive optimal control for continuous-time linear systems based on policy iteration[J].Automatica,2009,45(2):477-484
[4]Vrabie D,Lewis F.Neural network approach to continuoustime direct adaptive optimal control for partially unknown nonlinear systems[J].Neural Networks,2009,22(3):237C246
[5]Vamvoudakis K G,Lewis F L.Online actor Ccritic algorithm to solve the continuous-time infinite horizon optimal control problem[J].Automatica,2010,46(5):878-888
[6]Vamvoudakis K,Vrabie D,Lewis F.Online policy iteration based algorithms to solve the continuous-time infinite horizon optimal control problem[C]Adaptive Dynamic Programming and Reinforcement Learning,2009.ADPRL’09.IEEE Symposium on.IEEE,2009:36-41
[7]Dierks T,Jagannthan S.Optimal control of affine nonlinear discrete-time systems[C]Control and Automation,2009.MED’09.17th Mediterranean Conference on.IEEE,2009:1390-1395
[8]Dierks T,Jagannathan S.Optimal tracking control of affine nonlinear discrete-time systems with unknown internal dynamics[C]Decision and Control,2009 held jointly with the 200928th Chinese Control Conference.CDC/CCC 2009.Proceedings of the 48th IEEE Conference on.IEEE,2009:6750-6755
[9]Liu xinzhi,Practical stability of control system with impulse with impulse effects,J.Math.Anal.Appl.166(1992)563-576.
[10]F.A.Mc Rae,Practical Stability of Impulse Control System,J.Math.Anal.Apple.181(1994)656-672.
[11]V.Lakshmikantham,D.D.Bainov,P.S.Simenonov.Theory of Impulsive Differential Equations[M]Singapore:World scientific,1989.
[12]Xinzhi Liu and Allan R.Willms.Impulsive Controllability of Linear Dynamic Systems with Applications to Maneuvers of Spaceraft[J]Mathmatical Problems in Engineering,1996,2:277-199.
[13]Valeriano A.de Oliveira,Fernando L.Pereira and Geraldo N.Silva.Invariance for Impulsive Control Systems[M]Conference on Decision and Control Maui,Newyoke,2003.
[14]Dai Xin Li.The Research of Two Types of Impulse Differential Systems[D].Shandong Normal university,Master’s Thesis,2005.
[15]Xiaohua Wang,Yueyue Xing,Zhonghua Miao.Online adaptive dynamic programming algorithm for linear fixedtime impulse hybrid systems[C].Chinese Automation Congress(CAC),27-29 Nov.2015,821-825.
[2]Huaguang Zhang,Xin Zhang,Yanhong Luo,Jun Yang.Review of Adaptive Dynamic Programming[J].Automation Journal,2013,39(4):303-311
[3]Vrabie D,Pastravanu O,Abu-Khalaf M,et al.Adaptive optimal control for continuous-time linear systems based on policy iteration[J].Automatica,2009,45(2):477-484
[4]Vrabie D,Lewis F.Neural network approach to continuoustime direct adaptive optimal control for partially unknown nonlinear systems[J].Neural Networks,2009,22(3):237C246
[5]Vamvoudakis K G,Lewis F L.Online actor Ccritic algorithm to solve the continuous-time infinite horizon optimal control problem[J].Automatica,2010,46(5):878-888
[6]Vamvoudakis K,Vrabie D,Lewis F.Online policy iteration based algorithms to solve the continuous-time infinite horizon optimal control problem[C]Adaptive Dynamic Programming and Reinforcement Learning,2009.ADPRL’09.IEEE Symposium on.IEEE,2009:36-41
[7]Dierks T,Jagannthan S.Optimal control of affine nonlinear discrete-time systems[C]Control and Automation,2009.MED’09.17th Mediterranean Conference on.IEEE,2009:1390-1395
[8]Dierks T,Jagannathan S.Optimal tracking control of affine nonlinear discrete-time systems with unknown internal dynamics[C]Decision and Control,2009 held jointly with the 200928th Chinese Control Conference.CDC/CCC 2009.Proceedings of the 48th IEEE Conference on.IEEE,2009:6750-6755
[9]Liu xinzhi,Practical stability of control system with impulse with impulse effects,J.Math.Anal.Appl.166(1992)563-576.
[10]F.A.Mc Rae,Practical Stability of Impulse Control System,J.Math.Anal.Apple.181(1994)656-672.
[11]V.Lakshmikantham,D.D.Bainov,P.S.Simenonov.Theory of Impulsive Differential Equations[M]Singapore:World scientific,1989.
[12]Xinzhi Liu and Allan R.Willms.Impulsive Controllability of Linear Dynamic Systems with Applications to Maneuvers of Spaceraft[J]Mathmatical Problems in Engineering,1996,2:277-199.
[13]Valeriano A.de Oliveira,Fernando L.Pereira and Geraldo N.Silva.Invariance for Impulsive Control Systems[M]Conference on Decision and Control Maui,Newyoke,2003.
[14]Dai Xin Li.The Research of Two Types of Impulse Differential Systems[D].Shandong Normal university,Master’s Thesis,2005.
[15]Xiaohua Wang,Yueyue Xing,Zhonghua Miao.Online adaptive dynamic programming algorithm for linear fixedtime impulse hybrid systems[C].Chinese Automation Congress(CAC),27-29 Nov.2015,821-825.