• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Mughal, Fahad Razaque (Mughal, Fahad Razaque.) | He, Jingsha (He, Jingsha.) | Hussain, Saqib (Hussain, Saqib.) | Zhu, Nafei (Zhu, Nafei.) | Lakhan, Abdullah Raza (Lakhan, Abdullah Raza.) | Khokhar, Muhammad Saddam (Khokhar, Muhammad Saddam.)

Indexed by:

Scopus SCIE

Abstract:

BackgroundThe rapid evolution of Internet of Things (IoT) technologies has driven innovations across domains such as robotics, autonomous systems, and environmental control. However, effectively learning graph-based representations within these dynamic and heterogeneous systems remains a significant challenge, especially when scalability and adaptability are required.AimsThis study aims to develop and evaluate a novel meta-reinforcement learning (meta-RL) framework that combines Deep Q-Networks (DQNs) with Graph Convolutional Networks (GCNs) to learn adaptive and efficient representations of graph clusters. The primary objective is to enhance cluster-based representation learning by integrating reinforcement learning with graph aggregation policies.MethodsWe propose a cluster policy-GNN model that formulates optimal graph aggregation as a Markov Decision Process (MDP). The framework incorporates a cluster meta-policy to guide node-specific aggregation strategies and utilizes a combination of DQN and GCN for adaptive graph representation. Training involves clustering nodes based on policy-determined hops and batching to ensure efficient GNN training. A custom reward function drives the reinforcement learning process to prioritize computational focus on the most informative subgraphs.ResultsOur experimental results, benchmarked on real-world graph datasets, demonstrate that the proposed framework significantly outperforms existing state-of-the-art methods, including static GNNs, alternating graph-regularized networks, and causal-aware neural architecture search models. The learned cluster policies effectively enhance representation learning by dynamically adjusting to the structural heterogeneity of input graphs. Improvements were observed across various domains and scales, validating the flexibility and generalizability of the method.ConclusionThe proposed meta-RL framework with integrated DQN and GCN modules offers a powerful and scalable approach for graph cluster representation learning. By introducing adaptive, node-specific aggregation strategies guided by reinforcement learning, the method effectively captures complex graph structures and surpasses current techniques. Future work may explore real-time adaptation and deployment in more dynamic IoT-based applications.

Keyword:

Internet of Things resource management cooperative learning data transmission heterogeneous cluster networks meta-reinforcement learning

Author Community:

  • [ 1 ] [Mughal, Fahad Razaque]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China
  • [ 2 ] [He, Jingsha]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China
  • [ 3 ] [Hussain, Saqib]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China
  • [ 4 ] [Zhu, Nafei]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China
  • [ 5 ] [Mughal, Fahad Razaque]Xian Univ Finance & Econ, Sch Informat, Xian, Peoples R China
  • [ 6 ] [Lakhan, Abdullah Raza]Dawood Univ Engn & Technol, Lab Cybersecur & Artificial Intelligence, Karachi, Pakistan
  • [ 7 ] [Khokhar, Muhammad Saddam]Yangzhou Univ, Sch Artificial Intelligence, Yangzhou, Jiangsu, Peoples R China

Reprint Author's Address:

  • [Zhu, Nafei]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China

Show more details

Related Keywords:

Source :

SOFTWARE-PRACTICE & EXPERIENCE

ISSN: 0038-0644

Year: 2025

3 . 5 0 0

JCR@2022

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 7

Affiliated Colleges:

Online/Total:596/10598599
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.