• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Tang, G. (Tang, G..) | Wang, D. (Wang, D..) | Li, X. (Li, X..) | Ren, J. (Ren, J..) | Liu, N. (Liu, N..)

Indexed by:

CPCI-S EI Scopus

Abstract:

In this paper, a value-iteration-based off-policy Q-learning algorithm is developed. The proposed algorithm solves the optimal regulation problem of nonlinear systems with unknown dynamics. Under the off-policy mechanism, the algorithm utilizes the behavioral policy for full exploration, which is beneficial to avoid the target policy from falling into the local optimal solution. In addition, a relaxation factor is introduced to adjust the convergence rate of the cost function sequence. To implement the algorithm, the critic network and the action network are used to approximate the optimal Q-function and the optimal control policy, respectively. Finally, a simulation example is presented to demonstrate the effectiveness of the proposed algorithm. © 2024 IEEE.

Keyword:

Q-learning convergence rate Adaptive dynamic programming discrete-time nonlinear systems value iteration

Author Community:

  • [ 1 ] [Tang G.]Beijing University Of Technology, Faculty Of Information Technology, Beijing, China
  • [ 2 ] [Wang D.]Beijing University Of Technology, Faculty Of Information Technology, Beijing, China
  • [ 3 ] [Li X.]Beijing University Of Technology, Faculty Of Information Technology, Beijing, China
  • [ 4 ] [Ren J.]Beijing University Of Technology, Faculty Of Information Technology, Beijing, China
  • [ 5 ] [Liu N.]Beijing University Of Technology, Faculty Of Information Technology, Beijing, China

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Source :

Year: 2024

Page: 2717-2722

Language: English

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 7

Affiliated Colleges:

Online/Total:374/10592797
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.