• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Wang, Ding (Wang, Ding.) (Scholars:王鼎) | Hu, Qinna (Hu, Qinna.) | Liu, Ao (Liu, Ao.) | Qiao, Junfei (Qiao, Junfei.)

Indexed by:

EI Scopus SCIE

Abstract:

In this article, a swarm-intelligence-based value iteration (VI) algorithm is constructed to resolve the optimal control issue for continuous-time (CT) nonlinear systems. By leveraging the evolutionary concept of particle swarm optimization (PSO), the challenge of gradient vanishing is effectively overcome compared to traditional adaptive dynamic programming (ADP). Specifically, a PSO-based action network is implemented to perform policy improvement, eliminating the reliance on gradient information. Furthermore, within the ADP framework, the swarm-intelligence-based VI algorithm for CT systems is developed to address the challenges associated with constraints of initial admissible conditions and the difficulty of selecting probing signals in the traditional policy iteration method. The theoretical analysis is provided to show the convergence of the developed VI algorithm and the stability of the closed-loop system, respectively. Finally, under affine and non-affine backgrounds, two simulations are conducted to demonstrate the effectiveness and optimality of the established swarm-intelligence-based VI scheme for CT systems.

Keyword:

Intelligent optimal control Reinforcement learning Continuous-time nonlinear systems Value iteration Adaptive dynamic programming Particle swarm optimization

Author Community:

  • [ 1 ] [Wang, Ding]Beijing Univ Technol, Sch Informat Sci & Technol, Beijing 100124, Peoples R China
  • [ 2 ] [Wang, Ding]Beijing Univ Technol, Beijing Key Lab Computat Intelligence & Intelligen, Beijing 100124, Peoples R China
  • [ 3 ] [Wang, Ding]Beijing Univ Technol, Beijing Inst Artificial Intelligence, Beijing 100124, Peoples R China
  • [ 4 ] [Wang, Ding]Beijing Univ Technol, Beijing Lab Smart Environm Protect, Beijing 100124, Peoples R China

Reprint Author's Address:

  • 王鼎

    [Wang, Ding]Beijing Univ Technol, Sch Informat Sci & Technol, Beijing 100124, Peoples R China

Show more details

Related Keywords:

Source :

SWARM AND EVOLUTIONARY COMPUTATION

ISSN: 2210-6502

Year: 2025

Volume: 95

1 0 . 0 0 0

JCR@2022

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 8

Affiliated Colleges:

Online/Total:546/10579871
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.