• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Zhang, Yongnan (Zhang, Yongnan.) | Zhou, Yonghua (Zhou, Yonghua.)

Indexed by:

EI Scopus SCIE

Abstract:

Multi-agent deep reinforcement learning (MADRL) is a promising learning-based data-driven approach, particularly when it is applied to traffic signal control (TSC) in a large-scale urban road network. However, the present MADRL-based TSC methods still deserve further studies at the aspects of mutual coordination among multiple agents and computing efficiency of training algorithms. In this study, we propose an adaptive value decomposition-based multi-agent actor-critic (AVDMAC) approach using a parallel training algorithm for cooperative traffic network flow control. Firstly, the original centralized actor-critic reinforcement learning tasks are decomposed into several local learning tasks, where each actor-critic agent optimizes its control decisions in response to local environment feedback. Additionally, multiple agents striving towards a common objective are coordinated through an adaptive factorization model. In this model, weight coefficients are adaptively assigned to the action-value function of distributed agents by aggregating local rewards, so as to form a global joint actionvalue function that considers the individual contribution differences among local decisions. Further, we develop the parallel training formulations and implementation algorithm for AVDMAC approach based on Spark cloud in order to relieve of the time consumption load during MADRL training. Numerical experiments demonstrate the advantages at convergence, computational efficiency, and control performance of the AVDMAC approach.

Keyword:

Multi-agent deep reinforcement learning Traffic network flow Adaptive value decomposition network Parallel training Cooperative control

Author Community:

  • [ 1 ] [Zhang, Yongnan]Beijing Univ Technol, Coll Metropolitan Transportat, Beijing 100124, Peoples R China
  • [ 2 ] [Zhou, Yonghua]Beijing Jiaotong Univ, Sch Automat & Intelligence, Beijing 100044, Peoples R China

Reprint Author's Address:

  • [Zhou, Yonghua]Beijing Jiaotong Univ, Sch Automat & Intelligence, Beijing 100044, Peoples R China

Show more details

Related Keywords:

Related Article:

Source :

NEUROCOMPUTING

ISSN: 0925-2312

Year: 2025

Volume: 623

6 . 0 0 0

JCR@2022

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 4

Affiliated Colleges:

Online/Total:280/10623685
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.