• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Yang, Ruyue (Yang, Ruyue.) | Wang, Ding (Wang, Ding.) (Scholars:王鼎) | Li, Menghua (Li, Menghua.) | Cui, Chengyu (Cui, Chengyu.) | Qiao, Junfei (Qiao, Junfei.)

Indexed by:

EI Scopus SCIE

Abstract:

Wastewater treatment plays a crucial role in urban society, requiring efficient control strategies to optimize its performance. In this paper, we propose an enhanced offline reinforcement learning (RL) approach for wastewater treatment. Our algorithm improves the learning process. It uses a transition filter to sort out low- performance transitions and employs prioritized approximation loss to achieve prioritized experience replay with uniformly sampled loss. Additionally, the variational autoencoder is introduced to address the problem of distribution shift in offline RL. The proposed approach is evaluated on a nonlinear system and wastewater treatment simulation platform, demonstrating its effectiveness in achieving optimal control. The contributions of this paper include the development of an improved offline RL algorithm for wastewater treatment and the integration of transition filtering and prioritized approximation loss. Evaluation results demonstrate that the proposed algorithm achieves lower tracking error and cost.

Keyword:

Adaptive dynamic programming Variational autoencoder Offline reinforcement learning Wastewater treatment

Author Community:

  • [ 1 ] [Yang, Ruyue]Beijing Univ Technol, Sch Informat Sci & Technol, Beijing, Peoples R China
  • [ 2 ] [Wang, Ding]Beijing Univ Technol, Sch Informat Sci & Technol, Beijing, Peoples R China
  • [ 3 ] [Li, Menghua]Beijing Univ Technol, Sch Informat Sci & Technol, Beijing, Peoples R China
  • [ 4 ] [Qiao, Junfei]Beijing Univ Technol, Sch Informat Sci & Technol, Beijing, Peoples R China
  • [ 5 ] [Yang, Ruyue]Beijing Univ Technol, Beijing Key Lab Computat Intelligence & Intelligen, Beijing, Peoples R China
  • [ 6 ] [Wang, Ding]Beijing Univ Technol, Beijing Key Lab Computat Intelligence & Intelligen, Beijing, Peoples R China
  • [ 7 ] [Li, Menghua]Beijing Univ Technol, Beijing Key Lab Computat Intelligence & Intelligen, Beijing, Peoples R China
  • [ 8 ] [Qiao, Junfei]Beijing Univ Technol, Beijing Key Lab Computat Intelligence & Intelligen, Beijing, Peoples R China
  • [ 9 ] [Yang, Ruyue]Beijing Univ Technol, Beijing Lab Smart Environm Protect, Beijing, Peoples R China
  • [ 10 ] [Wang, Ding]Beijing Univ Technol, Beijing Lab Smart Environm Protect, Beijing, Peoples R China
  • [ 11 ] [Li, Menghua]Beijing Univ Technol, Beijing Lab Smart Environm Protect, Beijing, Peoples R China
  • [ 12 ] [Qiao, Junfei]Beijing Univ Technol, Beijing Lab Smart Environm Protect, Beijing, Peoples R China
  • [ 13 ] [Yang, Ruyue]Beijing Univ Technol, Beijing Inst Artificial Intelligence, Beijing, Peoples R China
  • [ 14 ] [Wang, Ding]Beijing Univ Technol, Beijing Inst Artificial Intelligence, Beijing, Peoples R China
  • [ 15 ] [Li, Menghua]Beijing Univ Technol, Beijing Inst Artificial Intelligence, Beijing, Peoples R China
  • [ 16 ] [Cui, Chengyu]Beijing Univ Technol, Beijing Inst Artificial Intelligence, Beijing, Peoples R China
  • [ 17 ] [Qiao, Junfei]Beijing Univ Technol, Beijing Inst Artificial Intelligence, Beijing, Peoples R China
  • [ 18 ] [Cui, Chengyu]State Grid Corp China, State Grid Beijing Chaoyang Power Supply Branch, Beijing, Peoples R China

Reprint Author's Address:

  • [Qiao, Junfei]Beijing Univ Technol, Sch Informat Sci & Technol, Beijing, Peoples R China;;[Qiao, Junfei]Beijing Univ Technol, Beijing Key Lab Computat Intelligence & Intelligen, Beijing, Peoples R China;;[Qiao, Junfei]Beijing Univ Technol, Beijing Lab Smart Environm Protect, Beijing, Peoples R China;;[Qiao, Junfei]Beijing Univ Technol, Beijing Inst Artificial Intelligence, Beijing, Peoples R China

Show more details

Related Keywords:

Source :

NEUROCOMPUTING

ISSN: 0925-2312

Year: 2025

Volume: 636

6 . 0 0 0

JCR@2022

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 7

Affiliated Colleges:

Online/Total:489/10578067
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.