Discrete-Time Stable Generalized Self-Learning Optimal Control With Approximation Errors | |
Wei, Qinglai1,2; Li, Benkai1; Song, Ruizhuo3 | |
刊名 | IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS |
2018-04-01 | |
卷号 | 29期号:4页码:1226-1238 |
关键词 | Adaptive Critic Designs Adaptive Dynamic Programming (Adp) Approximate Dynamic Programming Generalized Policy Iteration (Gpi) Neural Networks Neurodynamic Programming Nonlinear Systems Optimal Control Reinforcement Learning |
DOI | 10.1109/TNNLS.2017.2661865 |
文献子类 | Article |
英文摘要 | In this paper, a generalized policy iteration (GPI) algorithm with approximation errors is developed for solving infinite horizon optimal control problems for nonlinear systems. The developed stable GPI algorithm provides a general structure of discrete-time iterative adaptive dynamic programming algorithms, by which most of the discrete-time reinforcement learning algorithms can be described using the GPI structure. It is for the first time that approximation errors are explicitly considered in the GPI algorithm. The properties of the stable GPI algorithm with approximation errors are analyzed. The admissibility of the approximate iterative control law can be guaranteed if the approximation errors satisfy the admissibility criteria. The convergence of the developed algorithm is established, which shows that the iterative value function is convergent to a finite neighborhood of the optimal performance index function, if the approximate errors satisfy the convergence criterion. Finally, numerical examples and comparisons are presented. |
WOS关键词 | DYNAMIC-PROGRAMMING ALGORITHM ; ZERO-SUM GAMES ; NONLINEAR-SYSTEMS ; TRACKING CONTROL ; UNKNOWN DYNAMICS ; VALUE-ITERATION ; CONTROL SCHEME ; REINFORCEMENT ; DESIGN |
WOS研究方向 | Computer Science ; Engineering |
语种 | 英语 |
WOS记录号 | WOS:000427859600037 |
内容类型 | 期刊论文 |
源URL | [http://ir.ia.ac.cn/handle/173211/13634] |
专题 | 复杂系统管理与控制国家重点实验室_平行控制 |
作者单位 | 1.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Beijing 100049, Peoples R China 3.Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China |
推荐引用方式 GB/T 7714 | Wei, Qinglai,Li, Benkai,Song, Ruizhuo. Discrete-Time Stable Generalized Self-Learning Optimal Control With Approximation Errors[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,2018,29(4):1226-1238. |
APA | Wei, Qinglai,Li, Benkai,&Song, Ruizhuo.(2018).Discrete-Time Stable Generalized Self-Learning Optimal Control With Approximation Errors.IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,29(4),1226-1238. |
MLA | Wei, Qinglai,et al."Discrete-Time Stable Generalized Self-Learning Optimal Control With Approximation Errors".IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 29.4(2018):1226-1238. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论