• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Wang, Zhuwei (Wang, Zhuwei.) | Jin, Senfan (Jin, Senfan.) | Liu, Lihan (Liu, Lihan.) | Fang, Chao (Fang, Chao.) | Li, Meng (Li, Meng.) | Guo, Song (Guo, Song.)

Indexed by:

EI Scopus SCIE

Abstract:

Connected cruise control (CCC) refers to a type of advanced driver assistance system combined with wireless vehicle-to-vehicle (V2V) communication technology to improve control stability and driving safety. However, it is urgent to investigate intelligent control algorithms to improve the adaptability of CCC in complex traffic environment. In addition, the effect of communication delays attributed to shared wireless communications on the performance degradation of the intelligent CCC design cannot be ignored. In this study, the design of deep reinforcement learning (DRL) controller for CCC system in high-dynamic traffic scenarios is investigated, which considers both time-varying leading velocity and communication delays. To be more specific, an intelligent CCC algorithm based on deep deterministic policy gradient (DDPG) is developed. According to the training samples obtained from interacting with the traffic environment, the actor network and the critic network are trained to maximize the quadratic reward function determined by state errors and control inputs for generating intelligent control strategies. In particular, the effect of previous control strategies is considered in vehicle dynamics analysis, optimization problem formulation and Markov decision process (MDP) definition to compensate the performance degradation attributed to communication delays. Lastly, the effectiveness and convergence of the proposed DRL-based CCC controller are verified through numerical simulations with various conditions. The superior performance of the proposed algorithm is shown by comparing with existing traditional algorithms and state-of-the-art DRL algorithms. © 1967-2012 IEEE.

Keyword:

Markov processes Adaptive control systems Interactive computer systems Adaptive cruise control Deep learning Automobile drivers Advanced driver assistance systems Controllers Reinforcement learning Vehicles Real time systems Heuristic algorithms

Author Community:

  • [ 1 ] [Liu, Lihan]Beijing Wuzi University, School of Information, Beijing; 101149, China
  • [ 2 ] [Fang, Chao]Beijing University of Technology, Faculty of Information Technology, Beijing; 100081, China
  • [ 3 ] [Fang, Chao]Purple Mountain Laboratory: Networking, Communications and Security, Nanjing; 210096, China
  • [ 4 ] [Guo, Song]The Hong Kong Polytechnic University, Department of Computing, 999077, Hong Kong

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Source :

IEEE Transactions on Vehicular Technology

ISSN: 0018-9545

Year: 2022

Issue: 8

Volume: 71

Page: 9011-9025

6 . 8

JCR@2022

6 . 8 0 0

JCR@2022

ESI Discipline: ENGINEERING;

ESI HC Threshold:49

JCR Journal Grade:1

CAS Journal Grade:2

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 29

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 16

Affiliated Colleges:

Online/Total:252/10703164
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.